Received: by 2002:a05:6358:4e97:b0:b3:742d:4702 with SMTP id ce23csp2038787rwb; Fri, 19 Aug 2022 14:05:47 -0700 (PDT) X-Google-Smtp-Source: AA6agR40t+P2HoCbH2bU+C3REjeIhgoRqzqa4VJYJhJ8tejk167op1hwGOjjce1nMGQ8osFlGzuv X-Received: by 2002:a17:903:1205:b0:171:4f8d:22a8 with SMTP id l5-20020a170903120500b001714f8d22a8mr8925858plh.11.1660943147305; Fri, 19 Aug 2022 14:05:47 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1660943147; cv=none; d=google.com; s=arc-20160816; b=Uf8+7L9fN3gsPFaryHONIP9k+rJ09gzKpDrn/Y5WImCFG1EeY6L3wiz1LmHGixg5JQ kTzpF9UT2DC1OHnrnHX+kDHAvXVIWKMABiz0ktPTiFfv3vLdhG352RFVplxkLTdEgQe8 rwb+lui7fJdyDPrhNM17T54Mdw5NpecQBIiQMV0hMuxDQ6hdl19eqdRCfA8bkfK+oz54 PxZCtzbiJBka6szvlFsae9K0spw9gImHmeMwIZz0Zo8lVnOsQbk18efdMxpg8U7bjgeL SgmrJpK/bc3GszwiN81tLhIMjRJgrH/GoIsv1wUw//qOp0diJBUUvlhDTOffQs3ZZfyt Y8ig== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=eOVP7uxcuakWCkD5+BqZt5+xcwwCNJthr/gxNxOlHcg=; b=1KDf4RgkDEyZsa+VH7wTuriEpnI5Z3nTOOmxnHY4qZFb0f21B85MgXHz/t1CIN3HoC /lL3mB/4VdlOBLK+9npStMyL9bI6/LDytCA5tfU5zJHR+2jilBgDvOnUsGiHu98Y+Qnv kN4GmDp5Mb2ad0MqPyPnj4bkDcVm0ocMVsfOm1Ao6bO2rIoNN9+LHTVAbW1B8c9w6lkn Fb5nws93FnrUrR5LLHy52WPO3ecTo/g5BDONx/1PghEbunxxs7WfafUi+KLsQAyqiSDR DAcBvW2olOP5tkzAt2O16jooz6o4xmSp2hVVaK8CGAJvGwA5xcCxpjH1ttMhGrpo0uBS 7OSg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=TbqfUYYO; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id n3-20020a170902d2c300b00172883f5a2asi4572390plc.624.2022.08.19.14.04.25; Fri, 19 Aug 2022 14:05:47 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@joelfernandes.org header.s=google header.b=TbqfUYYO; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1351878AbiHSUuB (ORCPT + 99 others); Fri, 19 Aug 2022 16:50:01 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48730 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1351684AbiHSUtS (ORCPT ); Fri, 19 Aug 2022 16:49:18 -0400 Received: from mail-qt1-x82d.google.com (mail-qt1-x82d.google.com [IPv6:2607:f8b0:4864:20::82d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 93712BFABF for ; Fri, 19 Aug 2022 13:49:14 -0700 (PDT) Received: by mail-qt1-x82d.google.com with SMTP id y18so4222854qtv.5 for ; Fri, 19 Aug 2022 13:49:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=joelfernandes.org; s=google; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc; bh=eOVP7uxcuakWCkD5+BqZt5+xcwwCNJthr/gxNxOlHcg=; b=TbqfUYYOBRlQM1AsIY4GgE+2GpQ/GkZpdyKoO5F732/uJp6Il9dKitV7sHVM1cA9rC RRFRRBgNtpaHAmgnmmdaHwkZAVJ47CrSC6J+Z5mx1DKVwYKo7bCgePitrBl0iQ1ONj5z kVNnqB403PU8vOH/tLiG3e5URPaaC2NwHeDgo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc; bh=eOVP7uxcuakWCkD5+BqZt5+xcwwCNJthr/gxNxOlHcg=; b=Gsq0Nxqc/CFbNCnJiORrmoUl6w1bj9kjgF1a5fDNsE1jC2Qzfhn1qCNaXbcIUxyMY8 2d9E4DX+9YaKjAIRRKUbTpfaVW+dveK38wiW1AUv7CpIYSdaAQsN/013eElXYS0ha1+S M5cBxClWtclR69JQr/4yc5KgpGoVIpZIObJF5gVyIcn86dsz8Df4D2wSWvTOymVvDdFx bHIt3cgCaC8Y6U43hIeg9I0ylyFaJ2xLXGCaAkFb5X4zAzdDCiU81tac5T3v1Eb6Y4rF dkKew2pAr4JzXC7870sDwP387DTxNI6JxT4Hex4shaVhUmg27JVn+f31n9FIbDS9qnWf UMZQ== X-Gm-Message-State: ACgBeo1c5Gp6lU07/8lWxNvK1jj+vrk6BzyKyaCIAlCFpCq8Wop/+aVo R9pXNhX77My1KlzWr1d2JTdv+XKwct4OWw== X-Received: by 2002:ac8:5889:0:b0:344:57e5:dc54 with SMTP id t9-20020ac85889000000b0034457e5dc54mr8038436qta.465.1660942153560; Fri, 19 Aug 2022 13:49:13 -0700 (PDT) Received: from joelboxx.c.googlers.com.com (228.221.150.34.bc.googleusercontent.com. [34.150.221.228]) by smtp.gmail.com with ESMTPSA id x8-20020a05620a258800b006b9a89d408csm4377123qko.100.2022.08.19.13.49.12 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Aug 2022 13:49:13 -0700 (PDT) From: "Joel Fernandes (Google)" To: linux-kernel@vger.kernel.org Cc: "Joel Fernandes (Google)" , paulmck@kernel.org, Rushikesh S Kadam , "Uladzislau Rezki (Sony)" , Neeraj upadhyay , Frederic Weisbecker , Steven Rostedt , rcu , vineeth@bitbyteword.org Subject: [PATCH v4 13/14] fork: Move thread_stack_free_rcu to call_rcu_lazy Date: Fri, 19 Aug 2022 20:48:56 +0000 Message-Id: <20220819204857.3066329-14-joel@joelfernandes.org> X-Mailer: git-send-email 2.37.2.609.g9ff673ca1a-goog In-Reply-To: <20220819204857.3066329-1-joel@joelfernandes.org> References: <20220819204857.3066329-1-joel@joelfernandes.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This is required to prevent callbacks triggering RCU machinery too quickly and too often, which adds more power to the system. Signed-off-by: Joel Fernandes (Google) --- kernel/fork.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/kernel/fork.c b/kernel/fork.c index c9a2e19d67e5..a4535cf5446f 100644 --- a/kernel/fork.c +++ b/kernel/fork.c @@ -227,7 +227,7 @@ static void thread_stack_delayed_free(struct task_struct *tsk) struct vm_stack *vm_stack = tsk->stack; vm_stack->stack_vm_area = tsk->stack_vm_area; - call_rcu(&vm_stack->rcu, thread_stack_free_rcu); + call_rcu_lazy(&vm_stack->rcu, thread_stack_free_rcu); } static int free_vm_stack_cache(unsigned int cpu) @@ -354,7 +354,7 @@ static void thread_stack_delayed_free(struct task_struct *tsk) { struct rcu_head *rh = tsk->stack; - call_rcu(rh, thread_stack_free_rcu); + call_rcu_lazy(rh, thread_stack_free_rcu); } static int alloc_thread_stack_node(struct task_struct *tsk, int node) @@ -389,7 +389,7 @@ static void thread_stack_delayed_free(struct task_struct *tsk) { struct rcu_head *rh = tsk->stack; - call_rcu(rh, thread_stack_free_rcu); + call_rcu_lazy(rh, thread_stack_free_rcu); } static int alloc_thread_stack_node(struct task_struct *tsk, int node) -- 2.37.2.609.g9ff673ca1a-goog