Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp2246651pxb; Mon, 8 Mar 2021 19:34:35 -0800 (PST) X-Google-Smtp-Source: ABdhPJzT2e08qy0bNJ9OVp6Sh+6JTOLGxt8VIJ7vVSkltK4XnLKEgEONNBk/PaMT1MbmMPe+YFmq X-Received: by 2002:a17:906:40c7:: with SMTP id a7mr18114763ejk.109.1615260874793; Mon, 08 Mar 2021 19:34:34 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1615260874; cv=none; d=google.com; s=arc-20160816; b=uYQB034WvpMwAw+k/r4hSIQyiES2MQpxD3GTB0Lk5EmJFIh6jXaAq8avbo/xunKoc4 ZaKuKnUVXKxUqPiJYD9L2cRupIKwCKl7F2hLBcMxpFWnJ1Z1cRvkvkKnPtITH0I/Mda3 pHXcc75W0MIAMPwAjU7eSpcjNj81KPm9wrEp/TFhmRz4Q4q5T5rt+UanikyNneJ7N3m/ oatdMAA+sgyMKCBh4zjX1L7692hAx/i3XPb1XmK3U4arJs50qFO7xBB3QS/9e+i9OzOa 65kpP3xQ/BKKbBibUcIpAVjDQtG/frSFrH21rge+xpohGeQ01HbQfkPTkU9m+dYNXrqd +wnw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:to:references :message-id:cc:date:in-reply-to:from:subject:mime-version; bh=J7Sza41vDSoalA9gDROjpXaP7AT8QUyQNq12d78CF98=; b=04pSPoJgqzBn4kppzsFFzt7CkzdkHsxxKp850NwtN0xl9uOyXm5Dj2TSXYY6k0SDdL 5tmvfa7oef/ssyGT5L40HWYDBacEwV0YjRdCHvessXkV/vpRKKZ7+dBT5JQ107GDNQwR iG9jPPO3Kw1xtNSIsPBVR6d2JdT6uDgrB62HfzthVK89CHdhIOENLmOwolPA7iYi3Dr3 qjHxSbWUOy87XABXgx+/rloQf5N0JiEpbuamofcKD+l+TTWS7cxUYleHXoputvv8wmIc rQwR4KmpJYKdl2H8I7I2U90PCWAKWEq8OHwMx/TUTdQaWjgdXC/K21nB1oAvK2eJ/VAp XTyA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id df23si8156041edb.38.2021.03.08.19.34.02; Mon, 08 Mar 2021 19:34:34 -0800 (PST) Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-nfs-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229650AbhCIDdT convert rfc822-to-8bit (ORCPT + 99 others); Mon, 8 Mar 2021 22:33:19 -0500 Received: from us-smtp-delivery-145.mimecast.com ([216.205.24.145]:21718 "EHLO us-smtp-delivery-145.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229379AbhCIDcx (ORCPT ); Mon, 8 Mar 2021 22:32:53 -0500 Received: from zmcc-3-mta-2.zmailcloud.com (zmcc-3-mta-2.zmailcloud.com [35.238.170.66]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-165-R9WV8VA3MB-XVk-U5d5t-Q-1; Mon, 08 Mar 2021 22:32:50 -0500 X-MC-Unique: R9WV8VA3MB-XVk-U5d5t-Q-1 Received: from zmcc-3-mta-2.zmailcloud.com (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPS id 4D610E2A79; Mon, 8 Mar 2021 21:32:50 -0600 (CST) Received: from localhost (localhost [127.0.0.1]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTP id 3E7DEE2A78; Mon, 8 Mar 2021 21:32:50 -0600 (CST) X-Virus-Scanned: amavisd-new at zmcc-3-mta-2.zmailcloud.com Received: from zmcc-3-mta-2.zmailcloud.com ([127.0.0.1]) by localhost (zmcc-3-mta-2.zmailcloud.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id Xj9sBY9F8kO5; Mon, 8 Mar 2021 21:32:50 -0600 (CST) Received: from jbreitman-mac.zxcvm.com (unknown [72.22.182.150]) by zmcc-3-mta-2.zmailcloud.com (Postfix) with ESMTPSA id 0926CE2A62; Mon, 8 Mar 2021 21:32:50 -0600 (CST) Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: NFS Mount Hangs From: Jason Breitman In-Reply-To: <4ec6d34eb753bd2ba11886cdffbad1f25f4b6e78.camel@hammerspace.com> Date: Mon, 8 Mar 2021 22:32:49 -0500 Cc: "linux-nfs@vger.kernel.org" Message-Id: <94F7249D-20B1-437F-B383-D142B638DFAE@tildenparkcapital.com> References: <5E3B228F-5CFC-4EDF-B52E-1CDB947ADC00@tildenparkcapital.com> <2b13577bb30faf3b475d2d602be57aa135023a53.camel@hammerspace.com> <15CD7763-6DE5-4DBA-8FAE-859964AA90AC@tildenparkcapital.com> <4ec6d34eb753bd2ba11886cdffbad1f25f4b6e78.camel@hammerspace.com> To: Trond Myklebust X-Mailer: Apple Mail (2.3608.120.23.2.4) Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA45A274 smtp.mailfrom=jbreitman@tildenparkcapital.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: tildenparkcapital.com Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT Precedence: bulk List-ID: X-Mailing-List: linux-nfs@vger.kernel.org The server is running FreeBSD 12.1-RELEASE-p5. Jason Breitman On Mar 8, 2021, at 8:52 PM, Trond Myklebust wrote: On Mon, 2021-03-08 at 17:22 -0500, Jason Breitman wrote: > Thank you. > Do you know which kernel version is fixed? > If not, is there something I can look for in the source code that > will indicate that the kernel is fixed. > As I said, the problem here is that the server doesn't seem to be closing the socket when the client does. You didn't actually tell us which server you are using, so I don't know how to answer that question. > Jason Breitman > > > On Mar 8, 2021, at 5:15 PM, Trond Myklebust > wrote: > > On Mon, 2021-03-08 at 13:16 -0500, Jason Breitman wrote: > > Issue > > NFSv4 mounts periodically hang on the NFS Client. > > > > During this time, it is possible to manually mount from another NFS > > Server on the NFS Client having issues. > > Also, other NFS Clients are successfully mounting from the NFS > > Server > > in question. > > Rebooting the NFS Client appears to be the only solution. > > > > I believe this issue has been discussed in the past so I included > > an > > article that matched my symptoms. > > I do not see a case statement for FIN_WAIT2 at > > https://elixir.bootlin.com/linux/v4.19.171/source/net/sunrpc/xprtsock.c > > . > > > > NFS Client > > OS: Debian Buster 10.8 > > Kernel: 4.19.171-2 > > Protocol: NFSv4 with Kerberos Security > > Mount Options: nfs- > > server.domain.com:/data /mnt/data nfs4 > > lookupcache=pos,n > > oresvport,sec=krb5,hard,rsize=1048576,wsize=1048576 00 > > > > Output from the NFS Client when the issue occurs > > # netstat -an | grep NFS.Server.IP.X > > tcp 0 0 NFS.Client.IP.X:46896 > > NFS.Server.IP.X:2049 FIN_WAIT2 > > > > Your client has closed the connection, and is waiting for the server > to > close the connection on its side. > > I'd suggest using a newer kernel, or else getting someone in the > Debian > project to fix theirs. > -- Trond Myklebust CTO, Hammerspace Inc 4984 El Camino Real, Suite 208 Los Altos, CA 94022 ​ www.hammer.space