Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp1219738pxb; Thu, 28 Jan 2021 10:42:30 -0800 (PST) X-Google-Smtp-Source: ABdhPJzhUHZIqOhVzFA2LzAvRvSpQda4Q1lF1gUZS+zhF7dOysKd6xQBspEJNRcwBmbETTfAq+qg X-Received: by 2002:a05:6402:524a:: with SMTP id t10mr1090182edd.270.1611859350320; Thu, 28 Jan 2021 10:42:30 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1611859350; cv=none; d=google.com; s=arc-20160816; b=QJJ9GNn8QWpdwF1XufAfx0prYcz6/bzpgRuKV4I5qwFp/tPt7SeefLOHzRhvRLA/mw i7BxxxmnA8Od7+UMbKQ3H0PcJW7sefJo4K41FU6j2/PVOM10o2pNiaoKVCsGpBHhuRF+ XVSPZFOjmrm0+9X/VjvkZvDMMNJThngcMbJBUqXc6Gi/Ck9mO+sQ1KCewWBpX2sgAGov Lz2sLyy943Qx+lOs9+5o29yEPL56I7FwimCbiLCPHrC+a2ahwX7OKRWJCgFrMheMyW1a uCY1WidCT7z2wT9oERHccuEfzrp5YCe5SECoOx3CxiFNpUIIqxV8uxcoAfVsClv1dZs/ pbTw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from; bh=UGnuxRknUZn9bGYYhUzH0eFux6lfhjXSiU4OUI7+GEk=; b=ih51cARbAT+jGSOrDJE5Yk7w5uHJEcxXYKHiWZDu7NF0cJ5T4nejCqm3syL7aPEqk+ EpL7NRgHUBeHHvBXHdTIfJ+xKX3tmnCftqZtv3+kyY/xYcpU/ptz4q4miC5EPPtnwEG4 MyIA7RHJRNc8nDoUPba3i7zlkFE87WZwGdrs4gLm3vIb+38uXOGgWAcpGWbJs9x4lt5x Km0zSKXc0Fade82BbmRMpxCZfIWtn+MDgVTY8H0FcVEThiC25AyfP292Bce4a3Hv1oxK D4H/asz7Lq7e8Xh8VzOnNbplQUX6Itavl2Tl1jaMr7A9FW82AvocY02jSowdXXjNbHyZ Ntyg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=arm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id bm10si3600528edb.372.2021.01.28.10.42.03; Thu, 28 Jan 2021 10:42:30 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=arm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232151AbhA1SlH (ORCPT + 99 others); Thu, 28 Jan 2021 13:41:07 -0500 Received: from foss.arm.com ([217.140.110.172]:37448 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232088AbhA1SfI (ORCPT ); Thu, 28 Jan 2021 13:35:08 -0500 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 188901509; Thu, 28 Jan 2021 10:32:19 -0800 (PST) Received: from e113632-lin.cambridge.arm.com (e113632-lin.cambridge.arm.com [10.1.194.46]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 9FA0C3F719; Thu, 28 Jan 2021 10:32:17 -0800 (PST) From: Valentin Schneider To: linux-kernel@vger.kernel.org Cc: Peter Zijlstra , Ingo Molnar , Vincent Guittot , Dietmar Eggemann , Morten Rasmussen , Qais Yousef , Quentin Perret , Pavan Kondeti , Rik van Riel Subject: [PATCH 8/8] sched/fair: Relax task_hot() for misfit tasks Date: Thu, 28 Jan 2021 18:31:41 +0000 Message-Id: <20210128183141.28097-9-valentin.schneider@arm.com> X-Mailer: git-send-email 2.27.0 In-Reply-To: <20210128183141.28097-1-valentin.schneider@arm.com> References: <20210128183141.28097-1-valentin.schneider@arm.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Misfit tasks can and will be preempted by the stopper to migrate them over to a higher-capacity CPU. However, when runnable but not current misfit tasks are scanned by the load balancer (i.e. detach_tasks()), the task_hot() ratelimiting logic may prevent us from enqueuing said task onto a higher-capacity CPU. Align detach_tasks() with the active-balance logic and let it pick a cache-hot misfit task when the destination CPU can provide a capacity uplift. Signed-off-by: Valentin Schneider --- kernel/sched/fair.c | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index cba9f97d9beb..c2351b87824f 100644 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -7484,6 +7484,17 @@ static int task_hot(struct task_struct *p, struct lb_env *env) if (env->sd->flags & SD_SHARE_CPUCAPACITY) return 0; + /* + * On a (sane) asymmetric CPU capacity system, the increase in compute + * capacity should offset any potential performance hit caused by a + * migration. + */ + if (sd_has_asym_cpucapacity(env->sd) && + env->idle != CPU_NOT_IDLE && + !task_fits_capacity(p, capacity_of(env->src_cpu)) && + cpu_capacity_greater(env->dst_cpu, env->src_cpu)) + return 0; + /* * Buddy candidates are cache hot: */ -- 2.27.0