Received: by 2002:a05:6358:11c7:b0:104:8066:f915 with SMTP id i7csp187719rwl; Thu, 30 Mar 2023 14:18:09 -0700 (PDT) X-Google-Smtp-Source: AKy350bWbZ08R5NkupHC+48/JgVM/0ZmeAwuPxBAJ46aQB+wMAiSgjEAIke+yTGhwrA/EVv4UQab X-Received: by 2002:a05:6a20:6914:b0:e3:ffc1:552a with SMTP id q20-20020a056a20691400b000e3ffc1552amr3008129pzj.2.1680211088885; Thu, 30 Mar 2023 14:18:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1680211088; cv=none; d=google.com; s=arc-20160816; b=L8Nl+TTpr8GQ24aR9qdmE69AB59e11JqqefQmACYhwKBP71KVvjFwFgPQjCKvfHk1g 6juEsBeGHnmpsNRWRldBS6ZPeyYvi4/baF0Sb4XX7ImqblJIexf79aWMUm8I89dH246w MVpBT9FqK9yoJ8fqNn2CVwb1uVhx7uyY0b+9+NahzBy9zW3/HbOAmEDFvBoa42UGdWp7 yOyiImaWj5mEROi/XxRfvIU5pCSrnUbtG+QAtY08/+YV04NRUBwzU4KEhlolUbkcDu9K uPrPM6nCtunLfzprGDXgMgadUN60EnzNPxPammBym9Zhj0JrKn7EY6L3qSVjKqU9Jvee QuFw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-transfer-encoding :content-disposition:mime-version:references:reply-to:message-id :subject:cc:to:from:date:dkim-signature; bh=pZ7e5d0Dcpawa1F+I2/HpqL1F24CDR48vQ5dNvzTK40=; b=Ao07IPGxbs2TNRjOLpNpESIZEaRwUjdzubgH1qrWCfNheQda+ORjoQuFlVl723ENC7 nFe1Q1cMuf1lMhhIMeVVC3gxv0x2j44BI7fYXAm2k0ovuTfHldbVtrnWUOcCeY1rKxjS XshloGvj0OaE1pXNWAsOwi+KkBwQe1LlWc6yH5i2RpJ42ud1/OHOW4IWxt4K2e3V1JKB rWJQq9WrhqPk65DrX63sSWIKvTE7NOvWLTsESZ1xNjmxN52/RdCWuDucSsnjb6zajyhX T7a7IyctQkn0IBGNMIaXx1fEONWSt3M3AbIHIcY/7/gHbuJPXtMR3uul+iSnuJEMVSYF dinw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=OeYyum+G; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id d14-20020a630e0e000000b0049b37046fbcsi570542pgl.391.2023.03.30.14.17.56; Thu, 30 Mar 2023 14:18:08 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=OeYyum+G; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229943AbjC3VQs (ORCPT + 99 others); Thu, 30 Mar 2023 17:16:48 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:44990 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230039AbjC3VQn (ORCPT ); Thu, 30 Mar 2023 17:16:43 -0400 Received: from ams.source.kernel.org (ams.source.kernel.org [145.40.68.75]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5AB6711676; Thu, 30 Mar 2023 14:16:40 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ams.source.kernel.org (Postfix) with ESMTPS id AB091B82A2E; Thu, 30 Mar 2023 21:16:38 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 5F327C433EF; Thu, 30 Mar 2023 21:16:37 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1680210997; bh=Kc2FLPxtXPPRjj0MYHxT1RNjQ8sGR5Y1tcwVLuBfggM=; h=Date:From:To:Cc:Subject:Reply-To:References:In-Reply-To:From; b=OeYyum+GDy/CPQrf4SrMA8WOUhZ64TC9/AdqVQ8NvshK8py2p8SMhCTAMhA4uEGGH /PVnAOTpZuZqwD22CdI8JRdofOBTjFrF6ZklHqnYebOu8r2Aao8jOfAPcrx3VX56fJ Zrvl5bAn+e09DJWqfX75iQyohIKtFGr82CmR9OrVKSHKXKIZnrHLtwLohzhX9VPzj5 IXiNQ4I2yfXRIuYbLZANWDrv6cb3wKszJH6icz8E6lP51VVRKOf8uHO0GD3pODAgNI stDWH29DDZCWF5k+mxXnNjZ5elBft/ZurRKYshQsV59jljlltp7XNCuvXh/qXaM2JQ blhsk81K4oesw== Received: by paulmck-ThinkPad-P72.home (Postfix, from userid 1000) id 03F921540476; Thu, 30 Mar 2023 14:16:36 -0700 (PDT) Date: Thu, 30 Mar 2023 14:16:36 -0700 From: "Paul E. McKenney" To: Uladzislau Rezki Cc: Joel Fernandes , "Zhang, Qiang1" , "Zhuo, Qiuxu" , RCU , quic_neeraju@quicinc.com, Boqun Feng , LKML , Oleksiy Avramchenko , Steven Rostedt , Frederic Weisbecker Subject: Re: [PATCH 1/1] Reduce synchronize_rcu() waiting time Message-ID: Reply-To: paulmck@kernel.org References: <2cd8f407-2b77-48b1-9f17-9aa8e4ce9c64@paulmck-laptop> <20230330150933.GB2114899@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spam-Status: No, score=-5.2 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI,SPF_HELO_NONE, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Mar 30, 2023 at 09:18:44PM +0200, Uladzislau Rezki wrote: > On Thu, Mar 30, 2023 at 11:58:41AM -0700, Paul E. McKenney wrote: > > On Thu, Mar 30, 2023 at 05:43:15PM +0200, Uladzislau Rezki wrote: > > > On Thu, Mar 30, 2023 at 03:09:33PM +0000, Joel Fernandes wrote: > > > > On Tue, Mar 28, 2023 at 08:26:13AM -0700, Paul E. McKenney wrote: > > > > > On Mon, Mar 27, 2023 at 10:29:31PM -0400, Joel Fernandes wrote: > > > > > > Hello, > > > > > > > > > > > > > On Mar 27, 2023, at 9:06 PM, Paul E. McKenney wrote: > > > > > > > > > > > > > > On Mon, Mar 27, 2023 at 11:21:23AM +0000, Zhang, Qiang1 wrote: > > > > > > >>>> From: Uladzislau Rezki (Sony) > > > > > > >>>> Sent: Tuesday, March 21, 2023 6:28 PM > > > > > > >>>> [...] > > > > > > >>>> Subject: [PATCH 1/1] Reduce synchronize_rcu() waiting time > > > > > > >>>> > > > > > > >>>> A call to a synchronize_rcu() can be expensive from time point of view. > > > > > > >>>> Different workloads can be affected by this especially the ones which use this > > > > > > >>>> API in its time critical sections. > > > > > > >>>> > > > > > > >>> > > > > > > >>> This is interesting and meaningful research. ;-) > > > > > > >>> > > > > > > >>>> For example in case of NOCB scenario the wakeme_after_rcu() callback > > > > > > >>>> invocation depends on where in a nocb-list it is located. Below is an example > > > > > > >>>> when it was the last out of ~3600 callbacks: > > > > > > >>> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> Can it be implemented separately as follows? it seems that the code is simpler > > > > > > >> (only personal opinion) ????. > > > > > > >> > > > > > > >> But I didn't test whether this reduce synchronize_rcu() waiting time > > > > > > >> > > > > > > >> +static void rcu_poll_wait_gp(struct rcu_tasks *rtp) > > > > > > >> +{ > > > > > > >> + unsigned long gp_snap; > > > > > > >> + > > > > > > >> + gp_snap = start_poll_synchronize_rcu(); > > > > > > >> + while (!poll_state_synchronize_rcu(gp_snap)) > > > > > > >> + schedule_timeout_idle(1); > > > > > > > > > > > > > > I could be wrong, but my guess is that the guys working with > > > > > > > battery-powered devices are not going to be very happy with this loop. > > > > > > > > > > > > > > All those wakeups by all tasks waiting for a grace period end up > > > > > > > consuming a surprisingly large amount of energy. > > > > > > > > > > > > Is that really the common case? On the general topic of wake-ups: > > > > > > Most of the time there should be only one > > > > > > task waiting synchronously on a GP to end. If that is > > > > > > true, then it feels like waking > > > > > > up nocb Kthreads which indirectly wake other threads is doing more work than usual? > > > > > > > > > > A good question, and the number of outstanding synchronize_rcu() > > > > > calls will of course be limited by the number of tasks in the system. > > > > > But I myself have raised the ire of battery-powered embedded folks with > > > > > a rather small number of wakeups, so... > > > > > > > > But unless I am missing something, even if there is single synchronize_rcu(), > > > > you have a flurry of potential wakeups right now, instead of the bare minimum > > > > I think. I have not measured how many wake ups, but I'd love to when I get > > > > time. Maybe Vlad has some numbers. > > > > > > > I will measure and have a look at wake-ups. But, what we have for now is > > > if there are two callers of synchronize_rcu() on different CPUs, i guess > > > two nocb-kthreads have to handle it, thus two nocb-kthreads have to be > > > awaken to do the work. This patch needs only one wake-up to serve all > > > users. > > > > One wakeup per synchronize_rcu(), right? > > > The gp-kthread wake-ups only one work, in its turn a worker wake-ups all > registered users of synchronize_rcu() for which a gp was passed. How many > users of synchonize_rcu() awaken by one worker depends on how many were > registered before initiating a new GP by the gp-kthread. > > > > Anyway, i will provide some data and analysis of it. > > > > Looking forward to seeing it! > > > Good. I will switch fully on it soon. I need to sort out some perf. > issues at work. And if you are looking for reduced wakeups instead of lower latency for synchronize_rcu(), I could see where the extra workqueue wakeup might be a problem for you. Assuming that this is all default-off, you could keep a count of the number of required wakeups for each grace period (indexed as usual by the bottom few bits of the grace-period counter without the low-order state bits), and do the wakeups directly from the grace-period kthread if there are not all that many of them. Except that, given that workqueues try hard to make the handler be on the same CPU as the one that did the corresponding schedule_work() invocation, it is not clear that this particular wakeup is really costing you enough to notice. (That CPU is not idle, after all.) But there is nothing quite like measuring the actual energy consumption on real hardware! Thanx, Paul