Received: by 2002:a05:6358:4e97:b0:b3:742d:4702 with SMTP id ce23csp2066884rwb; Fri, 19 Aug 2022 14:43:52 -0700 (PDT) X-Google-Smtp-Source: AA6agR5c4y+32XbXp4L0L9CKd23MQ3w0Mfeqy95AE7O3aM7zTwi7XnRfjIDiSD8CNq1jklfZ5apS X-Received: by 2002:a17:907:75cf:b0:73b:dadf:5535 with SMTP id jl15-20020a17090775cf00b0073bdadf5535mr5467760ejc.393.1660945432080; Fri, 19 Aug 2022 14:43:52 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1660945432; cv=none; d=google.com; s=arc-20160816; b=xL+i1Dzp0E5TH52wJG+zYnPQZZoCj1IIgMrhHkcXnLdD/Kdv4fE1JYZljaqapLeISj 0R00xYTrwyTtdsMcgTQY951cow99NeYfXoKsvfDfEP4KbapCffczpoY6JklY3Ger0kNX z/JWyzAxWW4xtb6KP0dRLjTfI+IwhAV8jOsVOU0ixAGRzYd/tPxQU4p3qPyeprMkTP4h CwcG11JXSw+9TIQ+10Lb6GcRx+c/AGpuQbUJ0CtZzs4CVnutvgouGsKLsCLthFQnrRNW Bq3dK2D9yCXi2KO5173aPBPvWfgPWzg7BlE98vBF6XSwqoYRrpr8isoq161n3SK3Lo2G WscA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=E7Xq/XCIcO6OqJQYLMUxDOI6zGFTDKoXgxMJiXC3P5I=; b=uDE7xu49XKWGXpwMl5nb7dvlb7ex1NvQQMPUMdxFYwLc9tFOGsIVGx+cezmzIKtdUi Ecs/S+2UdFcTETEBpEBcFBbtKoKuWqlkZ8WNcRfspKF+sieqo04mthULeIL40aTYxxqW WGhunRowRP3hO98j28zvFaOYIfEyraSRig03UVjAiehkt9NNy+cqRhQCLC6qVAD2vzI8 Z4rzENvj3i4Qb528uqoI98fqewSM67FLz0UC73THrNhpO7aeKsnwhozqBoMQtPG3Tcsd P9tNqgb3KGCYBXKMNudgH/bhtxqlsf7hgq3A7k3d/sD90NGFavHk8N5zyXohKMBK9fwk ZZSA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=PnhSY8rM; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id hr39-20020a1709073fa700b0073d635877ffsi384032ejc.478.2022.08.19.14.43.08; Fri, 19 Aug 2022 14:43:52 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=PnhSY8rM; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1351935AbiHSUtz (ORCPT + 99 others); Fri, 19 Aug 2022 16:49:55 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48722 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1351625AbiHSUtS (ORCPT ); Fri, 19 Aug 2022 16:49:18 -0400 Received: from mail-qv1-xf29.google.com (mail-qv1-xf29.google.com [IPv6:2607:f8b0:4864:20::f29]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5E8AFBE4CA for ; Fri, 19 Aug 2022 13:49:13 -0700 (PDT) Received: by mail-qv1-xf29.google.com with SMTP id y4so4203200qvp.3 for ; Fri, 19 Aug 2022 13:49:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=joelfernandes.org; s=google; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc; bh=E7Xq/XCIcO6OqJQYLMUxDOI6zGFTDKoXgxMJiXC3P5I=; b=PnhSY8rM7rduW9739YQGmVnMq/JGCCmIPkz6MaFXLYg5jNAb1UrdPTDggg3S+dNGgJ 2Y7P7W5dgjp2YYRCd8rcBCIO8TU/aSkgyDY1qZlMu1yk3Y+QY+oYAUm9E8JWOIN6jBd7 9cLfbbI/yGRKAc3Y15XmddVSxaTj8LHTLbh0Q= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc; bh=E7Xq/XCIcO6OqJQYLMUxDOI6zGFTDKoXgxMJiXC3P5I=; b=rdalrlzheEVF66ukQfTC8a0gO4KbIzIdpDwwif00XW6c2ESZCPYhoE38WWqchwkZHk hOSXdSrEZY2k43Z9uLV2KuxsmuG1c2bGY3Yp0JMwdxaw+EFoGHoID1GNNGXr0nKk8W2P j414UtpiVuGiqF1TFDnirMl0t4Jf6GB8Me2dVos43RbJ1L+cHGrbB46rPVOsil7cWS7z 9CetYGw7xNfywod57VM8XwkwuyOaiXUJ61aUZpHyz1NfDqv+Yh4DAzT9G3Rv8RrSfqQr 7UHGkt1pQr+E9KkWPEpF3vuehnno6F197vfsP2Dswo0A7JR483pcb6D7DOL1eTf7e4Bs 5hfg== X-Gm-Message-State: ACgBeo2Ha2D6G7BQ0cI+UO6gcGxdmOn05FOSLWCrhbP6HqCR+U0Xrjy6 tYGvMdjyuNHf3mXfea9hh1Sb5l8Zw3W+CQ== X-Received: by 2002:a05:6214:2aa2:b0:477:47ad:c2bf with SMTP id js2-20020a0562142aa200b0047747adc2bfmr8105366qvb.125.1660942152066; Fri, 19 Aug 2022 13:49:12 -0700 (PDT) Received: from joelboxx.c.googlers.com.com (228.221.150.34.bc.googleusercontent.com. [34.150.221.228]) by smtp.gmail.com with ESMTPSA id x8-20020a05620a258800b006b9a89d408csm4377123qko.100.2022.08.19.13.49.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Aug 2022 13:49:11 -0700 (PDT) From: "Joel Fernandes (Google)" To: linux-kernel@vger.kernel.org Cc: "Joel Fernandes (Google)" , paulmck@kernel.org, Rushikesh S Kadam , "Uladzislau Rezki (Sony)" , Neeraj upadhyay , Frederic Weisbecker , Steven Rostedt , rcu , vineeth@bitbyteword.org Subject: [PATCH v4 11/14] lib: Move call_rcu() to call_rcu_lazy() Date: Fri, 19 Aug 2022 20:48:54 +0000 Message-Id: <20220819204857.3066329-12-joel@joelfernandes.org> X-Mailer: git-send-email 2.37.2.609.g9ff673ca1a-goog In-Reply-To: <20220819204857.3066329-1-joel@joelfernandes.org> References: <20220819204857.3066329-1-joel@joelfernandes.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Move radix-tree and xarray to call_rcu_lazy(). This is required to prevent callbacks triggering RCU machinery too quickly and too often, which adds more power to the system. Signed-off-by: Joel Fernandes (Google) --- lib/radix-tree.c | 2 +- lib/xarray.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/lib/radix-tree.c b/lib/radix-tree.c index b3afafe46fff..1526dc9e1d93 100644 --- a/lib/radix-tree.c +++ b/lib/radix-tree.c @@ -305,7 +305,7 @@ void radix_tree_node_rcu_free(struct rcu_head *head) static inline void radix_tree_node_free(struct radix_tree_node *node) { - call_rcu(&node->rcu_head, radix_tree_node_rcu_free); + call_rcu_lazy(&node->rcu_head, radix_tree_node_rcu_free); } /* diff --git a/lib/xarray.c b/lib/xarray.c index ea9ce1f0b386..230abc8045fe 100644 --- a/lib/xarray.c +++ b/lib/xarray.c @@ -257,7 +257,7 @@ static void xa_node_free(struct xa_node *node) { XA_NODE_BUG_ON(node, !list_empty(&node->private_list)); node->array = XA_RCU_FREE; - call_rcu(&node->rcu_head, radix_tree_node_rcu_free); + call_rcu_lazy(&node->rcu_head, radix_tree_node_rcu_free); } /* -- 2.37.2.609.g9ff673ca1a-goog