Received: by 2002:ac0:a594:0:0:0:0:0 with SMTP id m20-v6csp4910322imm; Mon, 14 May 2018 15:43:32 -0700 (PDT) X-Google-Smtp-Source: AB8JxZrFw2PigT6lWyFFoTt5hfPeKJsTCK0k91Nip9ARRzp5wwnCkoSI8i4gOp1pvzytli3ayjuq X-Received: by 2002:a17:902:b60b:: with SMTP id b11-v6mr11815640pls.330.1526337812703; Mon, 14 May 2018 15:43:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1526337812; cv=none; d=google.com; s=arc-20160816; b=XOqvOvR7k/IjHpRPpEjms0HbXU6VG0hQzyXIEZJ/nWPh8kZvdH9y7Wpke3hR0ukxzq XVlxD01/Y5JsxeLKlI8fQKvxtg3bKPrcvz24Bj2vhh2GFfioeazbTlAQd9y5Muez16oa CtRmrllUNqRR87o3ubuJ4bK9JxO6+cERZg0rk4tU7HZrpBgn91nIqiuv96/Ap+1xbxJe sNloMuIbWkCKJdZpkv7xtzwAZsno4oDj6PuJOskQvI8jcDv2mRpmMzV2FfYCf6seTWbp hlSKFIkRee5t/0JATGIrCcv3PZHUx4d9Zpj11d007Nhs9U66+7kxppTmV7xO7BKE4VUZ CG5A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:user-agent:in-reply-to :content-disposition:mime-version:references:reply-to:subject:cc:to :from:date:arc-authentication-results; bh=/Tz2fh7sFKFfU7xHGhIWV1zCwiJbjEPHqXSz8CvulNU=; b=ozMsJdLzKBaG8KUTXA3NpgTBBDfgTIrBFAlEsA0dC1GqxF30hQwnqcSAE2eDKxNcuE Sd+3YQMcMSfu0m/kvB45PCwORq8btYfjtZeU6uCWQAPKasf/zp+7b7s5DtX2JU04qLWm Tb69gYcVYDs82iVeJYYPbJx53pNgZgs2TO66HYYhSSTUKDKKY8W8+JnM+2am/kTgFUlR TDTL07dsDPOQg7cqL38d/P2oniUIf7pYqL/zSWA51Lfor67TvgUVENLVnJj2t9+PsPtR yq0tifDJhVgSR0tn8+tVDBvlnBfljIn7/yH5f6sbdb/Y60yUa0V3x6wtIElFDkC+GIvw xRjQ== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id t23-v6si6970174pgv.360.2018.05.14.15.43.18; Mon, 14 May 2018 15:43:32 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=ibm.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752218AbeENWkk (ORCPT + 99 others); Mon, 14 May 2018 18:40:40 -0400 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:45688 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1752049AbeENWkj (ORCPT ); Mon, 14 May 2018 18:40:39 -0400 Received: from pps.filterd (m0098417.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id w4EMe6ef122890 for ; Mon, 14 May 2018 18:40:38 -0400 Received: from e13.ny.us.ibm.com (e13.ny.us.ibm.com [129.33.205.203]) by mx0a-001b2d01.pphosted.com with ESMTP id 2hyg9pertc-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 14 May 2018 18:40:38 -0400 Received: from localhost by e13.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Mon, 14 May 2018 18:40:37 -0400 Received: from b01cxnp22034.gho.pok.ibm.com (9.57.198.24) by e13.ny.us.ibm.com (146.89.104.200) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Mon, 14 May 2018 18:40:32 -0400 Received: from b01ledav003.gho.pok.ibm.com (b01ledav003.gho.pok.ibm.com [9.57.199.108]) by b01cxnp22034.gho.pok.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id w4EMeWq953674134; Mon, 14 May 2018 22:40:32 GMT Received: from b01ledav003.gho.pok.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id E59E4B2052; Mon, 14 May 2018 19:42:29 -0400 (EDT) Received: from paulmck-ThinkPad-W541 (unknown [9.70.82.108]) by b01ledav003.gho.pok.ibm.com (Postfix) with ESMTP id AE669B204E; Mon, 14 May 2018 19:42:29 -0400 (EDT) Received: by paulmck-ThinkPad-W541 (Postfix, from userid 1000) id 6529616C377F; Mon, 14 May 2018 15:42:03 -0700 (PDT) Date: Mon, 14 May 2018 15:42:03 -0700 From: "Paul E. McKenney" To: Nicholas Piggin Cc: linux-kernel@vger.kernel.org, mingo@kernel.org, jiangshanlai@gmail.com, dipankar@in.ibm.com, akpm@linux-foundation.org, mathieu.desnoyers@efficios.com, josh@joshtriplett.org, tglx@linutronix.de, peterz@infradead.org, rostedt@goodmis.org, dhowells@redhat.com, edumazet@google.com, fweisbec@gmail.com, oleg@redhat.com, joel.opensrc@gmail.com, torvalds@linux-foundation.org, npiggin@gmail.com Subject: Re: [PATCH tip/core/rcu 0/21] Contention reduction for v4.18 Reply-To: paulmck@linux.vnet.ibm.com References: <20180423030258.GA23370@linux.vnet.ibm.com> <20180514164233.7c7bff00@roar.ozlabs.ibm.com> <20180514160907.GX26088@linux.vnet.ibm.com> <20180515082120.1dbc32b5@roar.ozlabs.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180515082120.1dbc32b5@roar.ozlabs.ibm.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-TM-AS-GCONF: 00 x-cbid: 18051422-0008-0000-0000-000003076A89 X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00009026; HX=3.00000241; KW=3.00000007; PH=3.00000004; SC=3.00000260; SDB=6.01032366; UDB=6.00527774; IPR=6.00811497; MB=3.00021114; MTD=3.00000008; XFM=3.00000015; UTC=2018-05-14 22:40:37 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 18051422-0009-0000-0000-0000393FF5C3 Message-Id: <20180514224203.GQ26088@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-05-14_06:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 impostorscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1709140000 definitions=main-1805140224 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, May 15, 2018 at 08:21:20AM +1000, Nicholas Piggin wrote: > On Mon, 14 May 2018 09:09:07 -0700 > "Paul E. McKenney" wrote: > > > On Mon, May 14, 2018 at 04:42:33PM +1000, Nicholas Piggin wrote: > > > On Sun, 22 Apr 2018 20:02:58 -0700 > > > "Paul E. McKenney" wrote: > > > > > > > Hello! > > > > > > > > This series reduces lock contention on the root rcu_node > > > > structure, and is also the first precursor to TBD changes to > > > > consolidate the three RCU flavors (RCU-bh, RCU-preempt, and > > > > RCU-sched) into one. > > > > > > Hi Paul, > > > > > > I've been running your rcu/dev branch and haven't noticed any > > > problems yet. The irqsoff latency improvement is a little hard to > > > measure because the scheduler, but I've tried turning balancing > > > parameters right down and I'm yet to see any sign of RCU in traces > > > (down to about 100us on a 176 CPU machine), so that's great. > > > > Good to hear!!! > > Yep, as in, various other latencies are down to 100us, and still > no sign of RCU, so RCU must be sitting somewhere below that. Sometimes you get lucky. ;-) > > > (Not that RCU was ever the worst contributor to latency as I said, > > > just that I noticed those couple of traces where it showed up.) > > > > > > Thanks very much for the fast response, sorry I've taken a while to > > > test. > > > > Would you be willing to give me a Tested-by on that series of patches? > > Yes of course, for your rcu/dev series > > Tested-by: Nicholas Piggin Thank you very much! The rcu/dev branch has been a bit dynamic of late, so I am going to apply your Tested-by up to the merge point, which is 434533a52e8d ("Merge branches 'exp.2018.04.20a', 'fixes.2018.04.30a', 'lock.2018.04.22a' and 'torture.2018.04.20a' into HEAD"). That will allow me to send my pull request, and we can work out which of the more recent commits I can apply your Tested-by to later. ;-) > Let me know if you make any other changes you'd like me to test before > merge. Will do, and thank you again! There are some additional commits that should further reduce RCU's latency, but they won't be going in until the v4.19 merge window, that is, the one after this coming one. Thanx, Paul