Received: by 2002:a25:c205:0:0:0:0:0 with SMTP id s5csp840211ybf; Fri, 28 Feb 2020 08:36:39 -0800 (PST) X-Google-Smtp-Source: APXvYqwGyykwW/m5n+GWtby6aognVM9ELn/4J1gnAZWWcZLgeKlmpEyG+SC59aGsKgcHwlR9+T0e X-Received: by 2002:a05:6830:1643:: with SMTP id h3mr3897113otr.70.1582907799159; Fri, 28 Feb 2020 08:36:39 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1582907799; cv=none; d=google.com; s=arc-20160816; b=Z9YwyGSN9Hho2ZYuhMHViC5WbYMV3bM6BAorBTKacN8L9NGtDz3E291mDhGsjCOsB9 uKRpKZO6d6SRjH6ltEYTo7QyJSZ1QZwgX/tvRX/gqi7vRaO/Xb7j3KXDUrZXC0+/KZ42 s4iLQvC0z626iecMCsA1yGHpj/8GIFELGSRVUfF9DC38A0Kwgl/TUi+WOJak3hG4gQNG k67oSCzVPlNNgloXsT5A6wD47nwzwmhSraPOt8pw38zt3PvVqtZuWo3tIipnQK1hslQV tY0VV2lTX6WFb1syof8lnQewltCdtx/deyKqNtDzyxeHwvOdr2GI7FbAwbMKhd6CVVrP W4Dw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-transfer-encoding:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=HcG/EOqr8+CrfwSO/n77ulX+/pcSO4hIkOvdzBU4ykI=; b=UneuOpnUGVWLNyvMvA7i3YfIo35wSdPbhL5xk1D70kjfdvbW5Pa+y+PZlveBQu4xTH ppxm56Xh2x6j2e2n1KKD+rvXfx7Dl+YyvEAxyEbJWxobPZYGqQExAzbGhZXbk0gcWamB HUGvC0TE82ssr1uJxSfYrYxfFuYiscPQV+scUt3bvehARCTEbNsFpHP2kRvIMr/B3Cg0 rKK2LGXJXy9uww5BRoKKRLVPmLpo6RZ/ra3AZFYcllUKq5dYlKxKjbtprdp/7Dx/XJHk RBlNkuV0q5so4OXa7ayrxjZKC7aPGBEWhXnC8/qDoh5uUQnj4HrjNS+D7ABCNCzgrAGU LcWA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=sEJi1F7K; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 5si260987otr.108.2020.02.28.08.36.26; Fri, 28 Feb 2020 08:36:39 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=sEJi1F7K; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726738AbgB1Qfv (ORCPT + 99 others); Fri, 28 Feb 2020 11:35:51 -0500 Received: from mail-wm1-f66.google.com ([209.85.128.66]:55894 "EHLO mail-wm1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726046AbgB1Qfv (ORCPT ); Fri, 28 Feb 2020 11:35:51 -0500 Received: by mail-wm1-f66.google.com with SMTP id q9so3802736wmj.5 for ; Fri, 28 Feb 2020 08:35:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=HcG/EOqr8+CrfwSO/n77ulX+/pcSO4hIkOvdzBU4ykI=; b=sEJi1F7K5C+WPjvqrp9HyIGTw2H29ojkfm6wa2Y8BrBZ6IDEgfpQX014Yj00Hjp3am D0ndUXBuV8xdg7vnbJea8LEch/4ncITWTbIIbTh0B9FPLPJyK/WxgkI15BHguHlIFb1U iL8c1dGxMO1t0uauBjyIgLI2lKgUbxiJh/MsHbQKt/aqowgM8b24xmeDQim/Utq+i0ty IOD6/gFjloEH9FTzrkpHXzb5+oDNK9nxvQ9QxsXPSCj3/lNZSvpk2jwerbx97hK/m4/J BJVxgIjNVMk5xD6u30d3PZ2mPJDn9jR8XMc1CrljcD45WvV/NQ50UICwJ7uYxZFXYjST zhPQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to:user-agent; bh=HcG/EOqr8+CrfwSO/n77ulX+/pcSO4hIkOvdzBU4ykI=; b=t3am9KSohgCJUGr41jMJgPMlBTpjllTIzgLe5tiWYBQFAiXXz7tIVri9O12/QaW4Cn NbONO6p8b0FGH11oETWqQotdQUEXcWcdDAYg0IyTf2NtRSW8fxLTKlRkkNen9ZtIRjh3 6TP5938sbIklnqp64diXKiM1kpZwhFi3qXBgy0ScXiFbmTWsUsixYgVZzsTrgKANBfsb B85UNQazmqh82f7SuH22lmKILxXDeaaWIeiDGG3jFooUWV+NiFZqZrsqPBL1SUrsNw/Q 7ivHko1mAk/gQwmzg/QkeAoXwM5XykEbZjn/El/JHAqFvJJc9Rr2DHYtUshRghp8ZFAX VFlg== X-Gm-Message-State: APjAAAVc6wJHN9GJuFD3m3VtmE4iyXFLJhgpUj30rulxpgd1bH/jbIP4 TB1CzIdoLBdm83o6CsFniQEOng== X-Received: by 2002:a7b:cb97:: with SMTP id m23mr5343325wmi.37.1582907748312; Fri, 28 Feb 2020 08:35:48 -0800 (PST) Received: from vingu-book ([2a01:e0a:f:6020:9522:3a6c:498:7b7d]) by smtp.gmail.com with ESMTPSA id r6sm13392923wrq.92.2020.02.28.08.35.46 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Fri, 28 Feb 2020 08:35:47 -0800 (PST) Date: Fri, 28 Feb 2020 17:35:45 +0100 From: Vincent Guittot To: Christian Borntraeger Cc: Ingo Molnar , Peter Zijlstra , "linux-kernel@vger.kernel.org" Subject: Re: 5.6-rc3: WARNING: CPU: 48 PID: 17435 at kernel/sched/fair.c:380 enqueue_task_fair+0x328/0x440 Message-ID: <20200228163545.GA18662@vingu-book> References: <1a607a98-f12a-77bd-2062-c3e599614331@de.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Le vendredi 28 f?vr. 2020 ? 16:42:27 (+0100), Christian Borntraeger a ?crit : > > > On 28.02.20 16:37, Vincent Guittot wrote: > > On Fri, 28 Feb 2020 at 16:08, Christian Borntraeger > > wrote: > >> > >> Also happened with 5.4: > >> Seems that I just happen to have an interesting test workload/system size interaction > >> on a newly installed system that triggers this. > > > > you will probably go back to 5.1 which is the version where we put > > back the deletion of unused cfs_rq from the list which can trigger the > > warning: > > commit 039ae8bcf7a5 : (Fix O(nr_cgroups) in the load balancing path) > > > > AFAICT, we haven't changed this since > > So you do know what is the problem? If not is there any debug option or > patch that I could apply to give you more information? No I don't?know what is happening. Your test probably goes through?an unexpected path Would it be difficult for me to reproduce your test env ? There is an optimization in the code which could generate problem if assumption is not true. Could you try the patch below ? --- kernel/sched/fair.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index 3c8a379c357e..beb773c23e7d 100644 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -4035,8 +4035,8 @@ enqueue_entity(struct cfs_rq *cfs_rq, struct sched_entity *se, int flags) __enqueue_entity(cfs_rq, se); se->on_rq = 1; + list_add_leaf_cfs_rq(cfs_rq); if (cfs_rq->nr_running == 1) { - list_add_leaf_cfs_rq(cfs_rq); check_enqueue_throttle(cfs_rq); } } -- 2.17.1 >