Received: by 2002:a25:8b12:0:0:0:0:0 with SMTP id i18csp1518356ybl; Tue, 13 Aug 2019 14:09:25 -0700 (PDT) X-Google-Smtp-Source: APXvYqymvYc75BN63HSmVSSC5yB/hrMzPgwvNDEVg6oWrPxOy4/OAggxw0RklgiSz7Ly7MJpzFBW X-Received: by 2002:a17:90a:9905:: with SMTP id b5mr4147573pjp.70.1565730565193; Tue, 13 Aug 2019 14:09:25 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1565730565; cv=none; d=google.com; s=arc-20160816; b=iiq1z5Ni1pb2GADmg5KZlJHwxf/RMqFoslRycn0RtuiHqhJ9wAtCSRWXpFImaDX8iw KxyVve5xroCguGKDd1vuLlLGYIIcPtG/CgYHuX6Nrmg9EE5UguG9V0Qdx75ZGcWuiHqn Nfygjaw+qBk+7Af3raAdEAUZUsCmsE+fd7GLXlBEmH3dr1QkYk1wRbb2kHaiid0iMufe HZkgpNo8hBjNDLDLaKZhVBYLRVC/c0ihNBv+/dcQ/mwjACS43PBVJQY69r+2UrlYctVx eXingZJRm98F5zx1YgTakW7Zt4I1dov/7S9eH4G8+hX30dCAroGlndyFngmvu+5f+pYa IYsg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:reply-to:message-id :subject:cc:to:from:date; bh=Ocx/VqxT+5VJcqJaFXLR5gt+TxkYe6thcWS4DKUMKro=; b=KRqzj6r/hnQI3eRejqI+28KMbXVzeALKFQ2e4/Jkr/97Y6oDmbuXUsO7hO2P6J8RdY ZqVNsgMzdQo2fPQOwDXyMeCh4yRY32Z+jqfXw16QUA7hBTbBukH7vqd8sO/x3/8KU7N4 Y1Su7h1o+ONP+R/dD3q99Dd7RT8U7J6+oSExGUENfFN0CMBURgvl5NoAp/8hggA2qO1d bBkrvWvgoaLbLbYjvGyokftRpLWDOUaVxm4ll8SRQnNyMZWVEw/BpU+A62jSnCSz3nOl 9YgLh7Jtr4C4SJqcN+cn5Qb32e/WKyzwRpzDkGl72mUv050qO8iX1UxWp7ZDAAe8rnAK CpXw== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id s9si33479659pgc.305.2019.08.13.14.09.09; Tue, 13 Aug 2019 14:09:25 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727215AbfHMVG4 (ORCPT + 99 others); Tue, 13 Aug 2019 17:06:56 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:60282 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726690AbfHMVGz (ORCPT ); Tue, 13 Aug 2019 17:06:55 -0400 Received: from pps.filterd (m0098413.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x7DL2VBm125517; Tue, 13 Aug 2019 17:06:14 -0400 Received: from pps.reinject (localhost [127.0.0.1]) by mx0b-001b2d01.pphosted.com with ESMTP id 2uc43d9m2j-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 13 Aug 2019 17:06:14 -0400 Received: from m0098413.ppops.net (m0098413.ppops.net [127.0.0.1]) by pps.reinject (8.16.0.27/8.16.0.27) with SMTP id x7DL2sF8127910; Tue, 13 Aug 2019 17:06:13 -0400 Received: from ppma03dal.us.ibm.com (b.bd.3ea9.ip4.static.sl-reverse.com [169.62.189.11]) by mx0b-001b2d01.pphosted.com with ESMTP id 2uc43d9m25-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 13 Aug 2019 17:06:13 -0400 Received: from pps.filterd (ppma03dal.us.ibm.com [127.0.0.1]) by ppma03dal.us.ibm.com (8.16.0.27/8.16.0.27) with SMTP id x7DL58iR021867; Tue, 13 Aug 2019 21:06:12 GMT Received: from b01cxnp22033.gho.pok.ibm.com (b01cxnp22033.gho.pok.ibm.com [9.57.198.23]) by ppma03dal.us.ibm.com with ESMTP id 2u9nj709nk-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 13 Aug 2019 21:06:12 +0000 Received: from b01ledav003.gho.pok.ibm.com (b01ledav003.gho.pok.ibm.com [9.57.199.108]) by b01cxnp22033.gho.pok.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id x7DL6CDU49742232 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 13 Aug 2019 21:06:12 GMT Received: from b01ledav003.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 1A242B2067; Tue, 13 Aug 2019 21:06:12 +0000 (GMT) Received: from b01ledav003.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id EF222B2064; Tue, 13 Aug 2019 21:06:11 +0000 (GMT) Received: from paulmck-ThinkPad-W541 (unknown [9.70.82.154]) by b01ledav003.gho.pok.ibm.com (Postfix) with ESMTP; Tue, 13 Aug 2019 21:06:11 +0000 (GMT) Received: by paulmck-ThinkPad-W541 (Postfix, from userid 1000) id 340F816C0E5D; Tue, 13 Aug 2019 14:06:13 -0700 (PDT) Date: Tue, 13 Aug 2019 14:06:13 -0700 From: "Paul E. McKenney" To: Frederic Weisbecker Cc: rcu@vger.kernel.org, linux-kernel@vger.kernel.org, mingo@kernel.org, jiangshanlai@gmail.com, dipankar@in.ibm.com, akpm@linux-foundation.org, mathieu.desnoyers@efficios.com, josh@joshtriplett.org, tglx@linutronix.de, peterz@infradead.org, rostedt@goodmis.org, dhowells@redhat.com, edumazet@google.com, fweisbec@gmail.com, oleg@redhat.com, joel@joelfernandes.org Subject: Re: [PATCH RFC tip/core/rcu 14/14] rcu/nohz: Make multi_cpu_stop() enable tick on all online CPUs Message-ID: <20190813210613.GA19957@linux.ibm.com> Reply-To: paulmck@linux.ibm.com References: <20190802151435.GA1081@linux.ibm.com> <20190802151501.13069-14-paulmck@linux.ibm.com> <20190812210232.GA3648@lenoir> <20190812232316.GT28441@linux.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190812232316.GT28441@linux.ibm.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-TM-AS-GCONF: 00 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2019-08-13_06:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=916 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1906280000 definitions=main-1908130201 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Aug 12, 2019 at 04:23:16PM -0700, Paul E. McKenney wrote: > On Mon, Aug 12, 2019 at 11:02:33PM +0200, Frederic Weisbecker wrote: > > On Fri, Aug 02, 2019 at 08:15:01AM -0700, Paul E. McKenney wrote: > > > The multi_cpu_stop() function relies on the scheduler to gain control from > > > whatever is running on the various online CPUs, including any nohz_full > > > CPUs running long loops in kernel-mode code. Lack of the scheduler-clock > > > interrupt on such CPUs can delay multi_cpu_stop() for several minutes > > > and can also result in RCU CPU stall warnings. This commit therefore > > > causes multi_cpu_stop() to enable the scheduler-clock interrupt on all > > > online CPUs. > > > > > > Signed-off-by: Paul E. McKenney > > > --- > > > kernel/stop_machine.c | 9 ++++++++- > > > 1 file changed, 8 insertions(+), 1 deletion(-) > > > > > > diff --git a/kernel/stop_machine.c b/kernel/stop_machine.c > > > index b4f83f7bdf86..a2659f61ed92 100644 > > > --- a/kernel/stop_machine.c > > > +++ b/kernel/stop_machine.c > > > @@ -20,6 +20,7 @@ > > > #include > > > #include > > > #include > > > +#include > > > #include > > > > > > /* > > > @@ -187,15 +188,19 @@ static int multi_cpu_stop(void *data) > > > { > > > struct multi_stop_data *msdata = data; > > > enum multi_stop_state curstate = MULTI_STOP_NONE; > > > - int cpu = smp_processor_id(), err = 0; > > > + int cpu, err = 0; > > > const struct cpumask *cpumask; > > > unsigned long flags; > > > bool is_active; > > > > > > + for_each_online_cpu(cpu) > > > + tick_nohz_dep_set_cpu(cpu, TICK_DEP_MASK_RCU); > > > > Looks like it's not the right fix but, should you ever need to set an > > all-CPUs (system wide) tick dependency in the future, you can use tick_set_dep(). Except that I am not finding anything resembling tick_set_dep() in current mainline. What should I be looking for instead? Thanx, Paul