Received: by 2002:a05:6a10:f347:0:0:0:0 with SMTP id d7csp720408pxu; Thu, 3 Dec 2020 10:53:26 -0800 (PST) X-Google-Smtp-Source: ABdhPJx1A8t6sfl8rhP+t4w/M6aN7Oun4jv1ZGtart/efpGGmSskAHyukSueR761zS9ZXShxleTQ X-Received: by 2002:a17:906:31d2:: with SMTP id f18mr3748695ejf.407.1607021606281; Thu, 03 Dec 2020 10:53:26 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1607021606; cv=none; d=google.com; s=arc-20160816; b=Q4tkCRqlhRk+z66/JBxYg0qJfzL25glpQtFwRhZf2H7se5jEigqDFajWeJE/gTncXf fv2daihePlkg5je21zvEN7oLO2oi2CLU8pIBrD+pJZxJrh5qoIgm0Y6e8hZVMBCHYv1Z txVbt36cpClohMR+lFisOnZ9LYTIvmMlqT9I6f4kjkGrV3hg6Ho5XLsfQnIglbWhOahA PXQdu0/WZ4mHKyW5j5uEiu6JF596z7Vwl54xPN5bmLjZwFKfKUHNx5s2zjzJE2933Ndd xPID4VZKUQSyhQtMjhRk5+Zrm+NRC/uSwgAWEUt+KWfofHNBQuVExif55DAQCS5jhMPB Cyzg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:user-agent:in-reply-to:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :dkim-signature:dkim-filter; bh=On0cocyPm5XBAlbAfaHwqvtq06p6jvVhxIbij+bxQu4=; b=RxTMdkSxEn8lm2cVBq0ZyqHD29JCTncFKat2mJhaEiI/GrvJ0uz3Nn45eRLZrME+Br NGRD0b0eQVYfTM4ZlfvG/jOl0+moGGDDJm7sfJQkstJBHU+FZrsPSpW4F6y35k2UOJK9 yBo8ZdO96O18y8NWxvbmipnkLbnRn6YS0Dh31786mjiPkUg6baLi4oAtm/9YDOfKtl6a ZFqCtTNMsA2vPNphnI5NCBf2rJieTNkcRhn4aaJ/EVHq6Vu/HdPUleBKqdniMM/MVt3D 9dK0Z5FScMIkU99XaUIsoRFqMUvgtUNTBzzkUQDe75N6z/PTpOLY+VKuLL/TPHzQEcsV f7lA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@fieldses.org header.s=default header.b="Zror/5wo"; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id v5si1902819edi.183.2020.12.03.10.52.53; Thu, 03 Dec 2020 10:53:26 -0800 (PST) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@fieldses.org header.s=default header.b="Zror/5wo"; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726885AbgLCSvv (ORCPT + 99 others); Thu, 3 Dec 2020 13:51:51 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52680 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725973AbgLCSvu (ORCPT ); Thu, 3 Dec 2020 13:51:50 -0500 Received: from fieldses.org (fieldses.org [IPv6:2600:3c00:e000:2f7::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B590FC061A4E for ; Thu, 3 Dec 2020 10:51:10 -0800 (PST) Received: by fieldses.org (Postfix, from userid 2815) id 0289C6F5E; Thu, 3 Dec 2020 13:51:10 -0500 (EST) DKIM-Filter: OpenDKIM Filter v2.11.0 fieldses.org 0289C6F5E DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fieldses.org; s=default; t=1607021470; bh=On0cocyPm5XBAlbAfaHwqvtq06p6jvVhxIbij+bxQu4=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=Zror/5wohwl8C4kaHqmUv1AI/WDS32NK0BTlVzvWBJbOXMV42KL45SqeSNZtVkY/I cs5YNu5Ryj79qv8MSMLYZxSBxdVquFUKRt+UDUJLespgfsc0YMPGD+2yamagUA1coS Chxvvv9cEmnKmhF5xkmYeXQ71CkKphVhJneicg54= Date: Thu, 3 Dec 2020 13:51:09 -0500 From: bfields To: Daire Byrne Cc: Trond Myklebust , linux-cachefs , linux-nfs Subject: Re: Adventures in NFS re-exporting Message-ID: <20201203185109.GB27931@fieldses.org> References: <943482310.31162206.1599499860595.JavaMail.zimbra@dneg.com> <279389889.68934777.1603124383614.JavaMail.zimbra@dneg.com> <635679406.70384074.1603272832846.JavaMail.zimbra@dneg.com> <20201109160256.GB11144@fieldses.org> <1744768451.86186596.1605186084252.JavaMail.zimbra@dneg.com> <1055884313.92996091.1606250106656.JavaMail.zimbra@dneg.com> <20201124211522.GC7173@fieldses.org> <932244432.93596532.1606324491501.JavaMail.zimbra@dneg.com> <1403656117.98163597.1606998035261.JavaMail.zimbra@dneg.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1403656117.98163597.1606998035261.JavaMail.zimbra@dneg.com> User-Agent: Mutt/1.5.21 (2010-09-15) Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org On Thu, Dec 03, 2020 at 12:20:35PM +0000, Daire Byrne wrote: > Just a small update based on the most recent patchsets from Trond & > Bruce: > > https://patchwork.kernel.org/project/linux-nfs/list/?series=393567 > https://patchwork.kernel.org/project/linux-nfs/list/?series=393561 > > For the write-through tests, the NFSv3 re-export of a NFSv4.2 server > has trimmed an extra GETATTR: > > Before: originating server <- (vers=4.2) <- reexport server - (vers=3) > <- client writing = WRITE,COMMIT,GETATTR .... repeating > > After: originating server <- (vers=4.2) <- reexport server - (vers=3) > <- client writing = WRITE,COMMIT .... repeating > > I'm assuming this is specifically due to the "EXPORT_OP_NOWCC" patch? Probably so, thanks for the update. > All other combinations look the same as before (for write-through). An > NFSv4.2 re-export of a NFSv3 server is still the best/ideal in terms > of not incurring extra metadata roundtrips when writing. > > It's great to see this re-export scenario becoming a better supported > (and performing) topology; many thanks all. I've been scratching my head over how to handle reboot of a re-exporting server. I think one way to fix it might be just to allow the re-export server to pass along reclaims to the original server as it receives them from its own clients. It might require some protocol tweaks, I'm not sure. I'll try to get my thoughts in order and propose something. --b.