Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:18 as permitted sender) client-ip=2620:137:e000::1:18;
From:   Chuck Lever III <chuck.lever@oracle.com>
To:     Rick Macklem <rmacklem@uoguelph.ca>
CC:     Bruce Fields <bfields@fieldses.org>,
        "crispyduck@outlook.at" <crispyduck@outlook.at>,
        Linux NFS Mailing List <linux-nfs@vger.kernel.org>
Subject: Re: Problems with NFS4.1 on ESXi 
Thread-Topic: Problems with NFS4.1 on ESXi 
Thread-Index: AQHYVOLTJWvLLebuJE+8fGO0gJ9faaz5zdx5gACo0QCAAAJi6IAAGkiAgAAlUYCAAE6KrIAA+egA
Date:   Fri, 22 Apr 2022 14:29:56 +0000
Message-ID: <A22B7B39-1FEA-4FFF-84D4-0FCBE42B590B@oracle.com>
References: <AM9P191MB1665484E1EFD2088D22C2E2F8EF59@AM9P191MB1665.EURP191.PROD.OUTLOOK.COM>
 <AM9P191MB16655E3D5F3611D1B40457F08EF49@AM9P191MB1665.EURP191.PROD.OUTLOOK.COM>
 <4D814D23-58D6-4EF0-A689-D6DD44CB2D56@oracle.com>
 <AM9P191MB16651F3A158CAED8F358602A8EF49@AM9P191MB1665.EURP191.PROD.OUTLOOK.COM>
 <20220421164049.GB18620@fieldses.org> <20220421185423.GD18620@fieldses.org>
 <YT2PR01MB973028EFA90F153C446798C1DDF49@YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM>
In-Reply-To: <YT2PR01MB973028EFA90F153C446798C1DDF49@YT2PR01MB9730.CANPRD01.PROD.OUTLOOK.COM>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?xoOkWe9FZ0Y8YgXef2tqukSlw7zJ5pkVGoS5jAYL/fAFhLNM2x8dTQxj2fhb?=
 =?us-ascii?Q?Y0qDSvrC+KI7PZwnWZ5hItUI1PC8m0e1pXxmMYWXy2EqDe78zg1unTYRHvuO?=
 =?us-ascii?Q?7lgrmDlEWRB4xUZEDXdTr2UegNdfFnPmJo2/XeEm/shjVTYcLPda9ncfgOuj?=
 =?us-ascii?Q?HEc9/igphgfSFD3OvPudVRBmKaNr/UfNiKlOTW1aUleNgpdwUmiefHeYDlG6?=
 =?us-ascii?Q?KPvvn3mNFznAKj5QfyJraVLtwBE9GoX2ztO8xgWOEY9L61mV0D62pN007pR4?=
 =?us-ascii?Q?fM5NgEAt139vcSHix30+LDQPBGOhg04eHhX6nwfg5B/LAPhysiwOcU8VG5gn?=
 =?us-ascii?Q?ywm2I/eJvPRt8cqkAvRwKoj8fljd1kWurifz9d84g7kbtlEpJI7Tze7Q12d7?=
 =?us-ascii?Q?KdbW1Rs8eDHTU8ZtvzmHcg/u1Z+0MjBOFenX+cO7QB6AogWt1DLuaqEYnvk3?=
 =?us-ascii?Q?qxcaHF7KqitZmyj2HaNKPigyudoS95ZFphasaRlF9w98dvQk09//gVu/jZ/w?=
 =?us-ascii?Q?i64FDF8xbhI+s4Yy8RwaPNoGTLTEEZyZid3I6EoD95fDHfSSEPVvBPBO/SIU?=
 =?us-ascii?Q?/y1xrwO3B0PxiHZPuaRgH3y7mxwly2hBNCc9UfxsspmMLmHeJCa1/86kNoIe?=
 =?us-ascii?Q?qSwDeAwiZqkEFrfsmwavYxXg0pfdUSgHMV6dSDtGhjlUZs9smAiLweZAcUC9?=
 =?us-ascii?Q?i+PzsCZIWuDjzSW/QtT8cHXDtLln8kv4glyX0Z98Ab4frPC1vx9uJRraaVtD?=
 =?us-ascii?Q?mE36o2oeARiSjJYCgiLUlA9cxjKnL0xD2+teEWNqwqz/NwtMIScB4bLX/Z8d?=
 =?us-ascii?Q?xxvia9c5hnmhxRfKdFcXzYfYik5UUDPceDgz2wMgZLZkRfrnOvbdze1S0Z/u?=
 =?us-ascii?Q?eRRQs09L8kUdvdmZYJ3mZySoN1JKbguwwkMz9Erspa22Rgtf0mczUlpElK6L?=
 =?us-ascii?Q?gaGybZl6+m1IdNIRcHAa3a+lKzQXzZye0ka6x1/sAIc5HcgpDJRPP1NUPV82?=
 =?us-ascii?Q?1LjWP8rdIdhvrothdgZFCnTgmSYFuz6FQjkxexLTpGskFYzwuT69UBzs3iFO?=
 =?us-ascii?Q?wq/3kCnnVXXe5MRA2PY4HAaJmG8R7nM6uHcEAT0LYRp7RhHoBky97V9fEbUo?=
 =?us-ascii?Q?9ldoRf7vvGX3sT06ba9s0L5o8hYOMB+zBy/76pRW7ZAwDkAIyALsD6Zm+ZOW?=
 =?us-ascii?Q?xxm+otqq5AYulmsvkRpxDhdURILCJkmUyA4UnyBTLnwTOSEqtD3IWEkS9KJn?=
 =?us-ascii?Q?erq9CJQVugK930sLfp8TMgwFgGDTJo5rriPGQf87skBf5Tsg5sW0kdZPN3Xp?=
 =?us-ascii?Q?tKE3+R6z1HheDTU+IRdHWyWlI8gL5viuWLwaDnpWYNN4eLdh/a0ZR4i9KYoT?=
 =?us-ascii?Q?s2ZHpB/gjJ0bF92xv3vB8SMgpHyp/sSZW8WItMXttyMeUnSUk4BZ0QTqMh6Q?=
 =?us-ascii?Q?582+/bAzKXZe0ZpxbLY5YSgXVp1100Yazme+L8GkxpmAPqlt0lnncv9Guj5W?=
 =?us-ascii?Q?sgElM2m4xejDgcnIF1UvYimVVBWd31KbRzgiRUTRmrIWTKBhZO1Hr3G8dLye?=
 =?us-ascii?Q?0sgC1QypIE5RqgCEHzyr00KDdYdCbBKBi3X6NmLl4ZqXtNNkLhtBflC1vMLV?=
 =?us-ascii?Q?P68cvUO9Fxb6+CDBXgCAEm4rDdQgroqa8Q8joSYzuDNWyozZDsYNlj1RzD75?=
 =?us-ascii?Q?Y1iq1rS065OHSV7iBkpG1n8mIYcAoO4kTdxBoOqDuq1FUiK+W/4Aqfkmmq5o?=
 =?us-ascii?Q?Q+guWLK+rxTgORkui2PjHJ4Q4uZy/uA=3D?=
Content-Type: text/plain; charset="us-ascii"
Content-ID: <DD3B202657266945812CCD534EA57617@namprd10.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN0PR10MB5128.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 6125f1f6-584c-479d-0fac-08da246c930d
X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Apr 2022 14:29:56.8208
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: xs/vV21g6tFQU8gJDkjSMju5vqidKGE4OFgVR40cR44Aldhf5zmL6ppy0pUnTI3V8hL/TXbCbWsQKfUkeKizGQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR10MB1617
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.486,18.0.858
 definitions=2022-04-22_04:2022-04-22,2022-04-22 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 adultscore=0
 malwarescore=0 mlxlogscore=766 suspectscore=0 spamscore=0 bulkscore=0
 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2202240000 definitions=main-2204220063
X-Proofpoint-GUID: RcowX8m2gElt4EsIGy87RUmy0Sj7MbyU
X-Proofpoint-ORIG-GUID: RcowX8m2gElt4EsIGy87RUmy0Sj7MbyU
X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,RDNS_NONE,SPF_HELO_NONE autolearn=no
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
	lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-nfs.vger.kernel.org>
X-Mailing-List: linux-nfs@vger.kernel.org


> On Apr 21, 2022, at 7:52 PM, Rick Macklem <rmacklem@uoguelph.ca> wrote:
>=20
> J. Bruce Fields <bfields@fieldses.org> wrote:
> [stuff snipped]
>> On Thu, Apr 21, 2022 at 12:40:49PM -0400, bfields wrote:
>>>=20
>>>=20
>>> Stale filehandles aren't normal, and suggest some bug or
>>> misconfiguration on the server side, either in NFS or the exported
>>> filesystem.
>>=20
>> Actually, I should take that back: if one client removes files while a
>> second client is using them, it'd be normal for applications on that
>> second client to see ESTALE.
> I took a look at crispyduck's packet trace and here's what I saw:
> Packet#
> 48 Lookup of test-ovf.vmx
> 49 NFS_OK FH is 0x7c9ce14b (the hash)
> ...
> 51 Open Claim_FH fo 0x7c9ce14b
> 52 NFS_OK Open Stateid 0x35be
> ...
> 138 Rename test-ovf.vmx~ to test-ovf.vmx
> 139 NFS_OK
> ...
> 141 Close with PutFH 0x7c9ce14b
> 142 NFS4ERR_STALE for the PutFH
>=20
> So, it seems that the Rename will delete the file (names another file to =
the
> same name "test-ovf.vmx".  Then the subsequent Close's PutFH fails,
> because the file for the FH has been deleted.

So, Rick, Andreas: does this sequence of operations work without
error against a FreeBSD NFS server?


--
Chuck Lever