Received: by 2002:a6b:fb09:0:0:0:0:0 with SMTP id h9csp549973iog; Fri, 17 Jun 2022 08:29:30 -0700 (PDT) X-Google-Smtp-Source: AGRyM1sOWVeoDraYHkPr8B4+JMGmU+6YqW/vkm6RpipYVk7sJEcUp6u5dpT7FPGM+i17tcoPnA2p X-Received: by 2002:a17:906:209:b0:712:12d8:b52b with SMTP id 9-20020a170906020900b0071212d8b52bmr9771174ejd.394.1655479770036; Fri, 17 Jun 2022 08:29:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1655479770; cv=none; d=google.com; s=arc-20160816; b=YjNMuDxsFQhkYkRKitblH6sM1hdNGRUgPfvf9NMkpzYco4mMcpGKrfPRMlt0GMLFqV NC6iLU1djMh4RJeP5P5QIatTmtJF2DofL8tRHfBBnTXyvmbF3gk7zS4n2vI4PVFAqfnq egr/457OeiXeXFNZ8u7gEWRM8O0FQjDkgvgUJqgtxoYEgQh5UYuEovZFiDY9UDL2CmAY YMQqhmb9Uulo1S4gBoygRBp5GxfCdBNjy4ibSrjg1JZom/96Lmz8gLRr3bpgDsoFWcWc cW7Kx+gPEbtURALBmFn1jVVLUiiXSpUt+ItJxIfeqbUdz+FlzIZl5maH/2xqoc6ulmci Z8Ew== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:subject:message-id:date:from:in-reply-to :references:mime-version:dkim-signature; bh=WPVSEvTCvflFVWW5j2J0ixJtMAaP9wSf1jUduymLlc0=; b=FrLqvUzCt+3E1u8sb0RafS9g0sq3Bj3YnUDfRSuJiU8JrGDZX3AkssdpN6X2Uzr85D BJ6S2/Of9fDq2VhW06v7cAv3k9bnaOypJCoZuRj3OZI+s8YZl3RlnEC3mn3++DZRUYAQ w4ZJiQSU9b7Nf7rNmqF6NVeDV2wW1HalOQW7bKo49z7WrlLaxLi8z3KGiDd3rKrvSiI7 B2xfVm2usp/gYSAF+lEGmffyk55AfI6qYlqCMUVvHW5zYbN76IxptWWnPMRFRG8/KK17 6lBqUMeJsSnklWBZEdrQqfOSI7+hOqn6OvupVQBzqyhU01I3rg769IoQsL7OSL+XOZw4 FM8Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@dneg.com header.s=google header.b=v7RXMWZy; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=dneg.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id i12-20020a1709064fcc00b007152a3ee4easi4274382ejw.664.2022.06.17.08.28.39; Fri, 17 Jun 2022 08:29:30 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@dneg.com header.s=google header.b=v7RXMWZy; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=dneg.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1382829AbiFQP2h (ORCPT + 99 others); Fri, 17 Jun 2022 11:28:37 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56270 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1382873AbiFQP2b (ORCPT ); Fri, 17 Jun 2022 11:28:31 -0400 Received: from mail-ed1-x52c.google.com (mail-ed1-x52c.google.com [IPv6:2a00:1450:4864:20::52c]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id DC51437ABE for ; Fri, 17 Jun 2022 08:28:29 -0700 (PDT) Received: by mail-ed1-x52c.google.com with SMTP id es26so4946504edb.4 for ; Fri, 17 Jun 2022 08:28:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dneg.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=WPVSEvTCvflFVWW5j2J0ixJtMAaP9wSf1jUduymLlc0=; b=v7RXMWZyuWDlLd2v5s/ooA/1Btk4V0x78HXw7Xm7i33Wi4KPyENUDcJieRtSDHdqXF y0CguHXlfnWbXj9NHraQ6rewV/+kAKdVxVFcsWohBz4cMSu/XJIxbWcQgFbjOEonH3m9 x0hV49Il2On30MIL5DdT4BGZWralIS3PVPDN2i9lIVxw1wD8EcFvpyfh6Cl/cm6vZzJ6 PL9+Opn3M4m129911zb6XlvplLpltIWORVUm8OXUH2JZIdv6k51S4jV3FKqR0udjmP8z EUCtnQ5UquCW9dfEm1dEWgXhrSK9gx16akUcJ0URmOTwbS6E87UTFqfUUq9H3KW4bcKl wXPQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=WPVSEvTCvflFVWW5j2J0ixJtMAaP9wSf1jUduymLlc0=; b=cPpvoqP8YQaUbu04a8BI05F+sdq7K2h3Le59qlMsQ0M1yZKrimLV11euQFScvVCptB Ka2NTansFgfOy5k5fp7PxXPKmkPGjeXSS2NQcR2PBtGya7x9qg4o8NO1UC8emJMSp9Zp zArGJ7Ag+HRbclmJfOQRmGmdNcUrzuigYwi6jfNIEcNUaPnsjW17vJtmsvtoPRfLTxse +21EeZcVaO3q1ZfLZdKmOuMIHpmeUfB0++v3CMoLpfFtePH9Kdan2vVtrJDgBz+8ifA1 3rEXdcyCmlBFetPdQ7wRrjagRTRE5WhgbT42fC77myk2BvJGMWKQGKk3l0j1+aVRKjzE IskA== X-Gm-Message-State: AJIora/kwWhpXcnvUdknz4o4GH4jlJ4uhmrnhFBHxYuci44e3/xx8mf8 PDEJzyYtwEiqboRjSFTkqQvg9WVfHE61Gyqzl18Bm2iFA3uOFQ== X-Received: by 2002:aa7:cf01:0:b0:435:5ace:69cc with SMTP id a1-20020aa7cf01000000b004355ace69ccmr6151037edy.251.1655479708477; Fri, 17 Jun 2022 08:28:28 -0700 (PDT) MIME-Version: 1.0 References: <165516173293.21248.14587048046993234326.stgit@noble.brown> <165534094600.26404.4349155093299535793@noble.neil.brown.name> <165544498126.26404.7712330810213588882@noble.neil.brown.name> In-Reply-To: <165544498126.26404.7712330810213588882@noble.neil.brown.name> From: Daire Byrne Date: Fri, 17 Jun 2022 16:27:52 +0100 Message-ID: Subject: Re: [PATCH RFC 00/12] Allow concurrent directory updates. To: NeilBrown Cc: Anna Schumaker , Al Viro , Trond Myklebust , Chuck Lever , Linux NFS Mailing List , linux-fsdevel@vger.kernel.org, LKML Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Fri, 17 Jun 2022 at 06:49, NeilBrown wrote: > > On Thu, 16 Jun 2022, Daire Byrne wrote: > > > > I double checked that the patch had been applied and I hadn't made a > > mistake with installation. > > :-) always worth double checking... > > > > > I could perhaps try running with just the VFS patches to see if I can > > still reproduce the "local" VFS hang without the nfsd patches? Your > > previous VFS only patchset was stable for me. > > I've made quite a few changes since that VFS-only patches. Almost > certainly the problem is not in the nfsd code. > > I think that following has a reasonable chance of making things better, > both for the problem you hit and the problem Anna hit. I haven't tested > it at all yet so no promises - up to you if you try it. > > Thanks to both of you for the help with testing. > > NeilBrown This patch does the job for me - no more stack traces and things have been stable all day. I'm going to run some production loads over the weekend and then I'll do some more artificial scale testing next week. Thanks again for this work! Improving the parallelism anywhere we can for single clients and then nfsd is great for reexport servers (especially once you add some "cloud" latency). Cheers, Daire