Messages in this thread Patch in this message | | | Date | Mon, 29 Oct 2012 16:27:36 -0400 | From | Steven Rostedt <> | Subject | [PATCH 25/32] sched: Update rq clock on tickless CPUs before calling check_preempt_curr() |
| |
From: Frederic Weisbecker <fweisbec@gmail.com>
check_preempt_wakeup() of fair class needs an uptodate sched clock value to update runtime stats of the current task.
When a task is woken up, activate_task() is usually called right before ttwu_do_wakeup() unless the task is already in the runqueue. In this case we need to update the rq clock manually in case the CPU runs tickless because ttwu_do_wakeup() calls check_preempt_wakeup().
Signed-off-by: Frederic Weisbecker <fweisbec@gmail.com> Cc: Alessio Igor Bogani <abogani@kernel.org> Cc: Andrew Morton <akpm@linux-foundation.org> Cc: Avi Kivity <avi@redhat.com> Cc: Chris Metcalf <cmetcalf@tilera.com> Cc: Christoph Lameter <cl@linux.com> Cc: Daniel Lezcano <daniel.lezcano@linaro.org> Cc: Geoff Levand <geoff@infradead.org> Cc: Gilad Ben Yossef <gilad@benyossef.com> Cc: Hakan Akkan <hakanakkan@gmail.com> Cc: Ingo Molnar <mingo@kernel.org> Cc: Kevin Hilman <khilman@ti.com> Cc: Max Krasnyansky <maxk@qualcomm.com> Cc: Paul E. McKenney <paulmck@linux.vnet.ibm.com> Cc: Peter Zijlstra <peterz@infradead.org> Cc: Stephen Hemminger <shemminger@vyatta.com> Cc: Steven Rostedt <rostedt@goodmis.org> Cc: Sven-Thorsten Dietrich <thebigcorporation@gmail.com> Cc: Thomas Gleixner <tglx@linutronix.de> --- kernel/sched/core.c | 17 ++++++++++++++++- 1 file changed, 16 insertions(+), 1 deletion(-)
diff --git a/kernel/sched/core.c b/kernel/sched/core.c index f0fa54d..320abee 100644 --- a/kernel/sched/core.c +++ b/kernel/sched/core.c @@ -1353,6 +1353,12 @@ static int ttwu_remote(struct task_struct *p, int wake_flags) rq = __task_rq_lock(p); if (p->on_rq) { + /* + * Ensure check_preempt_curr() won't deal with a stale value + * of rq clock if the CPU is tickless. BTW do we actually need + * check_preempt_curr() to be called here? + */ + update_nohz_rq_clock(rq); ttwu_do_wakeup(rq, p, wake_flags); ret = 1; } @@ -1530,8 +1536,17 @@ static void try_to_wake_up_local(struct task_struct *p) if (!(p->state & TASK_NORMAL)) goto out; - if (!p->on_rq) + if (!p->on_rq) { ttwu_activate(rq, p, ENQUEUE_WAKEUP); + } else { + /* + * Even if the task is on the runqueue we still + * need to ensure check_preempt_curr() won't + * deal with a stale rq clock value on a tickless + * CPU + */ + update_nohz_rq_clock(rq); + } ttwu_do_wakeup(rq, p, 0); ttwu_stat(p, smp_processor_id(), 0); -- 1.7.10.4
| |