Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:6 as permitted sender) client-ip=2620:137:e000::3:6;
Date:   Sat, 28 Oct 2023 22:52:50 +0800
From:   Chen Yu <yu.c.chen@intel.com>
To:     Julia Lawall <julia.lawall@inria.fr>
CC:     Keisuke Nishimura <keisuke.nishimura@inria.fr>,
        Ingo Molnar <mingo@redhat.com>,
        Peter Zijlstra <peterz@infradead.org>,
        Vincent Guittot <vincent.guittot@linaro.org>,
        <linux-kernel@vger.kernel.org>,
        "Dietmar Eggemann" <dietmar.eggemann@arm.com>,
        Mel Gorman <mgorman@suse.de>,
        "Valentin Schneider" <vschneid@redhat.com>,
        Ricardo Neri <ricardo.neri-calderon@linux.intel.com>,
        Tim Chen <tim.c.chen@linux.intel.com>
Subject: Re: [PATCH] sched/fair: Fix the decision for load balance
Message-ID: <ZT0gQskmc//KxYyD@chenyu5-mobl2.ccr.corp.intel.com>
References: <20231027171742.1426070-1-keisuke.nishimura@inria.fr>
 <ZTyfoIBpm3lxd8Dy@chenyu5-mobl2.ccr.corp.intel.com>
 <alpine.DEB.2.22.394.2310280836100.3338@hadrien>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <alpine.DEB.2.22.394.2310280836100.3338@hadrien>
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?w/jjMEXFICrw6wo/zdn78vnnagABO16H4QVv2lKJwPa0nstHgb8aMR56S7RC?=
 =?us-ascii?Q?MgRk23rIBVwC2DoiII+Z2y2QYrH23kDvxO8E2aOxrXNu7sxb6pt3ku3jlwst?=
 =?us-ascii?Q?XNcOaAqMA7s9iQr++wek4mSt4DnjDjxG35UMfxyq3kjQP1/JEpTWdl0jn6Jk?=
 =?us-ascii?Q?UjamKaQBhmhIsEe8tiXpg+7Qi8lhcjGmSnN1k4ZEP0l4yZFHwtJ2Gni+5im7?=
 =?us-ascii?Q?OQbbWG1jBl0zkdz53UBTebmcBL+TMuvJ9I3MC4MqY9E4oKus7JUSBs9E0RBs?=
 =?us-ascii?Q?bwl0Oc2GRMl2xZFgwLpUkFKo+39uCWNDFyWXhcGt9OlPfFsumufrIXbTkoGI?=
 =?us-ascii?Q?CkxxqjEjiBNSfwvgp/hGXziXTsBOxwjjXgU9oHxsICG/L/9i+PmZ0FrVzF4e?=
 =?us-ascii?Q?9UuWyB0ZoTGQ+K28aJpHOh637cjbqoP6g/SwPV+rXxoddZK7xMEG4RS9a9Cn?=
 =?us-ascii?Q?YwGyFS9/AP1E8QJ0p55IvZfUMlanPk6n4LaNhY+OoxVhMobWhEEPvKNC4wj6?=
 =?us-ascii?Q?5TNas6D2sPlkMCRA0B4SI7HQ6XGr4L9shkbE3aP4Lnwdg8jmzOI1NPhjYDIY?=
 =?us-ascii?Q?KF0RWSNlPm0AK03NEloWEOudh67IcLNPqM6ueCmYuBhcfeT9N1syf+7p8wbP?=
 =?us-ascii?Q?MEJOooxRYM7Y6xsKFNlbFlGOXVqM1GFMAHBesx3KoK76Nph/trMuqDiRPQNa?=
 =?us-ascii?Q?tUCuY5xmqXIUbuRzUbTXV8Thu5ri4Q2TwEuihRF6WkW09WZps9PRAsdxJkXF?=
 =?us-ascii?Q?cFfoY+H3LmkkR47C43O8r0yyoEA+yIeVQqBiX7A0Dr3xuT28KFz7o4x6rjO6?=
 =?us-ascii?Q?L6ggwFu/IK8E/eJ2b6s1Clpz4XO7TKwcWV7dzKlZCRbTfOYFpkjbIaIZBTBR?=
 =?us-ascii?Q?O+e+yLelbEn+c7aBS3ulI/s4ZD5c32aioa2zPxIHg3dHkXJcunG4T4IB+LPW?=
 =?us-ascii?Q?7Wsgc0VvfhVPGdYq1woIDbpneQ1F4F49X9FJVd4NzhWxR2nVHpZen2jnpG+0?=
 =?us-ascii?Q?2HkfQc+WELTv4z6/BTTyaj9Lkh9dl+kzds9FU3NhdwzJyjl+qeIyz2l9O7Ae?=
 =?us-ascii?Q?X7SSTosqDtVnQkgjM3fpDoaPEz18Y2gBmjT4uke7hESJKu0mZhb2fbURKWw2?=
 =?us-ascii?Q?f5J+s1ckH5XsQdaCWTykp0aRo4MZzhZczx675cpK2N4g2QOMQmuFD100tQNZ?=
 =?us-ascii?Q?e96Yc6BRCJRRdVTBeRxxMjv6zxG31F+j0SRWKyDnVC8tH/9YtAH6JUcEXpU9?=
 =?us-ascii?Q?2BxPx8c9zmj7Y6SOe7svdl/ytD2k9k4k3puedoD9EpYA7jJ0hQSAkGIfva7K?=
 =?us-ascii?Q?Y59XQeUuAGqbkNhtZIHa4iRaxcN0j8GsfkcOOWGosrc00NQ6kM+pqnFlp9cU?=
 =?us-ascii?Q?zGT/BQSQv/PNk/I3ecUOtNaRFiRM5nJlq43+P7wzGlcJJcETAloNIDrbe61O?=
 =?us-ascii?Q?7cYj25nU7acZGclnVanIgbkr3u0lfJwPD/KlVoODqki7yek5KawR7vlBLAGq?=
 =?us-ascii?Q?F3Bj4/iEBmvhEuv/Shf1UX8pEn07A5fMFhtPvnivq8DoOaOFSwH7Ggt5LVj1?=
 =?us-ascii?Q?rh3j31vkj0Snhfgo0+/CdO8fEtIa1qRVUYKxzSHX?=
X-MS-Exchange-CrossTenant-Network-Message-Id: e539d884-37f5-4f50-5bf5-08dbd7c5963c
X-MS-Exchange-CrossTenant-AuthSource: MN0PR11MB6206.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Oct 2023 14:53:04.3528
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: WVTzCDGZOerbxpbhdKyV61gLo/k5PJQMLjWi0lHKi07Xs8zc8Q07t+8vRynd5YUjO/BGCo7AnxZFzAyzTw5WLA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR11MB6062
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on pete.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (pete.vger.email [0.0.0.0]); Sat, 28 Oct 2023 07:58:39 -0700 (PDT)

On 2023-10-28 at 08:37:59 +0200, Julia Lawall wrote:
> 
> 
> On Sat, 28 Oct 2023, Chen Yu wrote:
> 
> > On 2023-10-27 at 19:17:43 +0200, Keisuke Nishimura wrote:
> > > should_we_balance is called for the decision to do load-balancing.
> > > When sched ticks invoke this function, only one CPU should return
> > > true. However, in the current code, two CPUs can return true. The
> > > following situation, where b means busy and i means idle, is an
> > > example because CPU 0 and CPU 2 return true.
> > >
> > >         [0, 1] [2, 3]
> > >          b  b   i  b
> > >
> > > This fix checks if there exists an idle CPU with busy sibling(s)
> > > after looking for a CPU on an idle core. If some idle CPUs with busy
> > > siblings are found, just the first one should do load-balancing.
> > >
> > > Fixes: b1bfeab9b002 ("sched/fair: Consider the idle state of the whole core for load balance")
> > > Signed-off-by: Keisuke Nishimura <keisuke.nishimura@inria.fr>
> > > ---
> > >  kernel/sched/fair.c | 5 +++--
> > >  1 file changed, 3 insertions(+), 2 deletions(-)
> > >
> > > diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c
> > > index 2048138ce54b..eff0316d6c7d 100644
> > > --- a/kernel/sched/fair.c
> > > +++ b/kernel/sched/fair.c
> > > @@ -11083,8 +11083,9 @@ static int should_we_balance(struct lb_env *env)
> > >  		return cpu == env->dst_cpu;
> > >  	}
> > >
> > > -	if (idle_smt == env->dst_cpu)
> > > -		return true;
> > > +	/* Is there an idle CPU with busy siblings? */
> > > +	if (idle_smt != -1)
> > > +		return idle_smt == env->dst_cpu;
> > >
> > >  	/* Are we the first CPU of this group ? */
> > >  	return group_balance_cpu(sg) == env->dst_cpu;
> >
> > Looks reasonable to me, if there is other idle SMT(from half-busy core)
> > in the system, we should leverage that SMT to do the periodic lb.
> > Per my understanding,
> 
> That's not the goal of this patch.  The goal of this patch is to avoid
> doing return group_balance_cpu(sg) == env->dst_cpu;

Yes, I mean, without this patch, we could incorrectly choose the current
non idle CPU rather than that idle SMT, but actually we should let that
idle SMT to do the idle lb.

thanks,
Chenyu

> when a half-busy core
> has been identified that is different from env->dst_cpu.
> 
> julia
> 
> >
> > Reviewed-by: Chen Yu <yu.c.chen@intel.com>
> >
> > thanks,
> > Chenyu
> >