Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934911AbcCPNKP (ORCPT ); Wed, 16 Mar 2016 09:10:15 -0400 Received: from casper.infradead.org ([85.118.1.10]:56720 "EHLO casper.infradead.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S933966AbcCPNKL (ORCPT ); Wed, 16 Mar 2016 09:10:11 -0400 Date: Wed, 16 Mar 2016 14:10:08 +0100 From: Peter Zijlstra To: "Rafael J. Wysocki" Cc: Vincent Guittot , Michael Turquette , "rjw@rjwysocki.net" , linux-kernel , "linux-pm@vger.kernel.org" , Juri Lelli , Steve Muckle , Morten Rasmussen , Dietmar Eggemann , Michael Turquette Subject: Re: [PATCH 5/8] sched/cpufreq: pass sched class into cpufreq_update_util Message-ID: <20160316131008.GW6344@twins.programming.kicks-ass.net> References: <1457932932-28444-1-git-send-email-mturquette+renesas@baylibre.com> <1457932932-28444-6-git-send-email-mturquette+renesas@baylibre.com> <20160315212520.GF6344@twins.programming.kicks-ass.net> <20160315220609.30639.67271@quark.deferred.io> <20160316074123.GP6344@twins.programming.kicks-ass.net> <20160316085339.GU6344@twins.programming.kicks-ass.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2012-12-30) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3112 Lines: 76 On Wed, Mar 16, 2016 at 01:39:10PM +0100, Rafael J. Wysocki wrote: > On Wed, Mar 16, 2016 at 9:53 AM, Peter Zijlstra wrote: > > On Wed, Mar 16, 2016 at 09:29:59AM +0100, Vincent Guittot wrote: > >> I wonder if it's really worth passing per sched_class request to > >> sched_util ? sched_util is about selecting a frequency based on the > >> utilization of the CPU, it only needs a value that reflect the whole > >> utilization. Can't we sum (or whatever the formula we want to apply) > >> utilizations before calling cpufreq_update_util > > > > So I've thought the same; but I'm conflicted, its a shame to compute > > anything if the call then doesn't do anything with it. > > > > And keeping a structure of all the various numbers to pass in also has > > cost of yet another cacheline to touch. > > In principle we can use high-order bits of util and max to encode the > information on where they come from. > > Of course, that translates to additional ifs in the governor, but I > guess they are unavoidable anyway. Another thing we can do, for as long as we have the indirect function call anyway, is stuff extra pointers in that same cacheline we pull the function from. Something like the below; there's room for 8 pointers (including the function pointer) in a cacheline. That would allow the callback to fetch whatever data it feels is required (could be all of it). We could also put a u64 *now = &rq->clock in, which would leave another 4 pointers for DL/RT support. And since we're then back to 1-2 arguments on the function, we can add a flags/mask field to indicate what changed (and if the function throttles, it can keep a mask of all that changed since last time it actually did something, or allow punching through the throttle if our minimum guarantee changes or whatnot). (this would of course require we allocate struct update_util_data with the proper alignment thingies etc..) Then again, maybe this is somewhat overboard :-) diff --git a/include/linux/sched.h b/include/linux/sched.h index ba49c9efd0b2..d34d75c5cc93 100644 --- a/include/linux/sched.h +++ b/include/linux/sched.h @@ -3236,8 +3236,10 @@ static inline unsigned long rlimit_max(unsigned int limit) #ifdef CONFIG_CPU_FREQ struct update_util_data { - void (*func)(struct update_util_data *data, - u64 time, unsigned long util, unsigned long max); + unsigned long *cfs_util_avg; + unsigned long *cfs_util_max; + + void (*func)(struct update_util_data *data, u64 time); }; void cpufreq_set_update_util_data(int cpu, struct update_util_data *data); diff --git a/kernel/sched/cpufreq.c b/kernel/sched/cpufreq.c index 928c4ba32f68..de5b20b11de3 100644 --- a/kernel/sched/cpufreq.c +++ b/kernel/sched/cpufreq.c @@ -32,6 +32,9 @@ void cpufreq_set_update_util_data(int cpu, struct update_util_data *data) if (WARN_ON(data && !data->func)) return; + data->cfs_util_avg = &cpu_rq(cpu)->cfs.avg.util_avg; + data->cfs_util_max = &cpu_rq(cpu)->cpu_capacity_orig; + rcu_assign_pointer(per_cpu(cpufreq_update_util_data, cpu), data); } EXPORT_SYMBOL_GPL(cpufreq_set_update_util_data);