Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <29bcbdbb1b8b0c65fed6e64883a43b38e74f7948.camel@kernel.org>
Subject: Re: [PATCH] nfsd: remove unsafe BUG_ON from set_change_info
From:   Jeff Layton <jlayton@kernel.org>
To:     Chuck Lever III <chuck.lever@oracle.com>
Cc:     Neil Brown <neilb@suse.de>, Olga Kornievskaia <kolga@netapp.com>,
        Dai Ngo <dai.ngo@oracle.com>, Tom Talpey <tom@talpey.com>,
        Linux NFS Mailing List <linux-nfs@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        Boyang Xue <bxue@redhat.com>
Date:   Thu, 20 Jul 2023 11:39:31 -0400
In-Reply-To: <C4A9048C-C3C8-4C62-B68F-7170C6CDC5BE@oracle.com>
References: <20230720-bz2223560-v1-1-edb4900043b8@kernel.org>
         <4B067A0F-93E3-435A-A32B-B17BC07D4606@oracle.com>
         <061f2b988de3da1dac32ecb3d8ac76319065b51d.camel@kernel.org>
         <C4A9048C-C3C8-4C62-B68F-7170C6CDC5BE@oracle.com>
Content-Type: text/plain; charset="ISO-8859-15"
Content-Transfer-Encoding: quoted-printable
User-Agent: Evolution 3.48.4 (3.48.4-1.fc38) 
MIME-Version: 1.0
Precedence: bulk

On Thu, 2023-07-20 at 15:37 +0000, Chuck Lever III wrote:
>=20
> > On Jul 20, 2023, at 11:33 AM, Jeff Layton <jlayton@kernel.org> wrote:
> >=20
> > On Thu, 2023-07-20 at 15:15 +0000, Chuck Lever III wrote:
> > >=20
> > > > On Jul 20, 2023, at 10:59 AM, Jeff Layton <jlayton@kernel.org> wrot=
e:
> > > >=20
> > > > At one time, nfsd would scrape inode information directly out of st=
ruct
> > > > inode in order to populate the change_info4. At that time, the BUG_=
ON in
> > > > set_change_info made some sense, since having it unset meant a codi=
ng
> > > > error.
> > > >=20
> > > > More recently, it calls vfs_getattr to get this information, which =
can
> > > > fail. If that fails, fh_pre_saved can end up not being set. While t=
his
> > > > situation is unfortunate, we don't need to crash the box.
> > >=20
> > > I'm always happy to get rid of a BUG_ON(). But I'm not sure even
> > > a warning is necessary in this case. It's not likely that it's
> > > a software bug or something that the server administrator can
> > > do something about.
> > >=20
> > > Can you elaborate on why the vfs_getattr() might fail? Eg, how
> > > was it failing in 2223560 ?
> > >=20
> >=20
> > I'm fine with dropping the WARN_ON. You are correct that there is
> > probably little the admin can do about it.
> >=20
> > vfs_getattr can fail for all sorts of reasons. It really depends on the
> > underlying filesystem. In 2223560, I don't know for sure, but just prio=
r
> > to the oops, there were these messages in the log:
> >=20
> > [51935.482019] XFS (vda3): Filesystem has been shut down due to log err=
or (0x2).=20
> > [51935.482020] XFS (vda3): Please unmount the filesystem and rectify th=
e problem(s).=20
> > [51935.482550] vda3: writeback error on inode 25320400, offset 2097152,=
 sector 58684120=20
> >=20
> > My assumption was that the fs being shut down caused some VFS operation=
s
> > to start returning errors (including getattr) and that is why
> > fh_pre_saved ultimately didn't get set.
>=20
> I'm wondering if the operation should just fail in this case
> rather than return a cobbled-up changeinfo4. Maybe for another
> day.
>=20
>=20
> > > > Move set_change_info to nfs4proc.c since all of the callers are the=
re.
> > > > Revise the condition for setting "atomic" to also check for
> > > > fh_pre_saved. Drop the BUG_ON and make it a WARN_ON, and just have =
it
> > > > zero out both change_attr4s when this occurs.
> > > >=20
> > > > Link: https://bugzilla.redhat.com/show_bug.cgi?id=3D2223560
> > > > Reported-by: Boyang Xue <bxue@redhat.com>
> > >=20
> > > checkpatch now wants
> > >=20
> > > Reported-by:
> > > Closes:
> > >=20
> > > in that order.
> > >=20
> >=20
> >=20
> > Mmmmkay. So I assume the URL should go in the Closes: field then?
>=20
> Yes, a bug link goes in the Closes: field.
>=20
>=20
> > I'll take out the WARN_ON_ONCE and resend, once others have had a chanc=
e
> > to comment.
>=20
> Don't miss the other comments below.
>=20
>=20
> > Thanks!
> >=20
> > >=20
> > > > Signed-off-by: Jeff Layton <jlayton@kernel.org>
> > > > ---
> > > > fs/nfsd/nfs4proc.c | 30 ++++++++++++++++++++++++++++++
> > > > fs/nfsd/xdr4.h     | 11 -----------
> > > > 2 files changed, 30 insertions(+), 11 deletions(-)
> > > >=20
> > > > diff --git a/fs/nfsd/nfs4proc.c b/fs/nfsd/nfs4proc.c
> > > > index d8e7a533f9d2..e6f406f27821 100644
> > > > --- a/fs/nfsd/nfs4proc.c
> > > > +++ b/fs/nfsd/nfs4proc.c
> > > > @@ -380,6 +380,36 @@ nfsd4_create_file(struct svc_rqst *rqstp, stru=
ct svc_fh *fhp,
> > > > return status;
> > > > }
> > > >=20
> > > > +/**
> > > > + * set_change_info - set up the change_info4 for a reply
> > > > + * @cinfo: pointer to nfsd4_change_info to be populated
> > > > + * @fhp: pointer to svc_fh to use as source
> > > > + *
> > > > + * Many operations in NFSv4 require change_info4 in the reply. Thi=
s function
> > > > + * populates that from the info that we (should!) have already col=
lected. In
> > > > + * the event that we didn't get any pre-attrs, throw a warning and=
 just
> > > > + * zero out both change_attr4 fields.
> > > > + */
> > > > +static void
> > > > +set_change_info(struct nfsd4_change_info *cinfo, struct svc_fh *fh=
p)
> > > > +{
> > > > + cinfo->atomic =3D (u32)(fhp->fh_pre_saved && fhp->fh_post_saved &=
& !fhp->fh_no_atomic_attr);
> > > > +
> > > > + /*
> > > > + * In the event that we couldn't fetch attributes from the
> > > > + * server for some reason, just zero out the before and after
> > >=20
> > > "From the server"? Is it only likely to fail if the exported
> > > filesystem is an NFS mount? Or did you mean "from the filesystem" ?
> > >=20

Yep, will fix.

> > >=20
> > > > + * change values, after throwing a warning.
> > > > + */
> > > > + if (WARN_ON_ONCE(!fhp->fh_pre_saved)) {
> > >=20
> > > Maybe you should clear ->atomic as well in this case.
> > >=20
> > >=20

It should already be clear since fh_pre_saved isn't set.

> > > > + cinfo->before_change =3D 0;
> > > > + cinfo->after_change =3D 0;
> > > > + return;
> > > > + }
> > > > +
> > > > + cinfo->before_change =3D fhp->fh_pre_change;
> > > > + cinfo->after_change =3D fhp->fh_post_change;
> > > > +}
> > > > +
> > > > static __be32
> > > > do_open_lookup(struct svc_rqst *rqstp, struct nfsd4_compound_state =
*cstate, struct nfsd4_open *open, struct svc_fh **resfh)
> > > > {
> > > > diff --git a/fs/nfsd/xdr4.h b/fs/nfsd/xdr4.h
> > > > index b2931fdf53be..9e67f63c5f4d 100644
> > > > --- a/fs/nfsd/xdr4.h
> > > > +++ b/fs/nfsd/xdr4.h
> > > > @@ -775,17 +775,6 @@ void warn_on_nonidempotent_op(struct nfsd4_op =
*op);
> > > >=20
> > > > #define NFS4_SVC_XDRSIZE sizeof(struct nfsd4_compoundargs)
> > > >=20
> > > > -static inline void
> > > > -set_change_info(struct nfsd4_change_info *cinfo, struct svc_fh *fh=
p)
> > > > -{
> > > > - BUG_ON(!fhp->fh_pre_saved);
> > > > - cinfo->atomic =3D (u32)(fhp->fh_post_saved && !fhp->fh_no_atomic_=
attr);
> > > > -
> > > > - cinfo->before_change =3D fhp->fh_pre_change;
> > > > - cinfo->after_change =3D fhp->fh_post_change;
> > > > -}
> > > > -
> > > > -
> > > > bool nfsd4_mach_creds_match(struct nfs4_client *cl, struct svc_rqst=
 *rqstp);
> > > > bool nfs4svc_decode_compoundargs(struct svc_rqst *rqstp, struct xdr=
_stream *xdr);
> > > > bool nfs4svc_encode_compoundres(struct svc_rqst *rqstp, struct xdr_=
stream *xdr);
> > > >=20
> > > > ---
> > > > base-commit: 070f391ca4d48e1750ee6108eb44f751a9e9448e
> > > > change-id: 20230720-bz2223560-9c4690a8217b
> > > >=20
> > > > Best regards,
> > > > --=20
> > > > Jeff Layton <jlayton@kernel.org>
> > > >=20
> > >=20
> > > --
> > > Chuck Lever
> > >=20
> > >=20
> >=20
> > --=20
> > Jeff Layton <jlayton@kernel.org>
>=20
>=20
> --
> Chuck Lever
>=20
>=20

--=20
Jeff Layton <jlayton@kernel.org>