2014-07-25 16:24:36

by Rishi Agrawal

[permalink] [raw]
Subject: Patch For Making Readdir_plus configurable

Hi,
?? One of our customer's application only needs file names not
file attributes. With directories having 10K+ inodes (assuming buffer
cache has directory blocks cached having file names, but inode
cache is limited and hence need eviction of older cached inodes),
older inodes are evicted periodically. So if they keep on doing
readdir(2) from NSF client on multiple directories, some directory's
files are periodically removed from inode cache and hence new
readdir(2) on same directory requires disk access to bring back
inodes again to inode cache.

As READDIRPLUS request fetches attributes also, doing getattr on
each file on server, it causes unnecessary disk accesses. If
READDIRPLUS on NFS client is returned with -ENOTSUPP, NFS
client uses READDIR request which just gets the names of the files
in a directory, not attributes, hence avoiding disk accesses on server.

Can this be per-export tunable so that different application can
use it in different ways, some supporting readdirplus and others
not supporting readdirplus?

I have worked on a patch against 3.15.6 for this. Also I am
adding a patch against latest nfs-utils to have an export option
for this. Can someone let me know if these patches are adequate
or if any other changes are required. Patches attached, although
with minimal testing. I would like to know if something like this
can be added and if the patch can be reworked if I am missing
something for NFSv4.


Regards,
Rishi Agrawal



Attachments:
patch_linux-kernel-3-15-6 (2.91 kB)
patch_linux-kernel-3-15-6
patch_nfs-utils-1.3 (1.41 kB)
patch_nfs-utils-1.3
Download all attachments

2014-07-29 20:34:50

by J. Bruce Fields

[permalink] [raw]
Subject: Re: Patch For Making Readdir_plus configurable

On Sun, Jul 27, 2014 at 08:17:26PM -0700, Rishi Agrawal wrote:
> Hi Christopher,
>
> Customer is having mixed of NFS client OS setups and having this at server side would help to avoid having each client mount with this option.

I'm happy to take the client nordirplus option as evidence this is
useful in some cases, and wanting to have a way to turn it on across all
clients seem reasonable.

One concern is that this is NFSv3-only for now and it may be difficult
to implement comparable behavior on NFSv4.

But absent any objections I'm inclined to apply for 3.17 regardless and
deal with NFSv4.0 if and when it becomes a problem.

--b.

>
>
> From: Christopher T Vogan [mailto:[email protected]]
> Sent: Friday, July 25, 2014 10:23 PM
> To: Rishi Agrawal
> Cc: [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]; [email protected]
> Subject: Re: Patch For Making Readdir_plus configurable
>
> There is a client side option "nordirplus" which can be used to force the client to use READDIR
>
>
> Christopher Vogan
> NFS Development & Test
>
>
>
> From:        Rishi Agrawal <[email protected]>
> To:        "[email protected]" <[email protected]>
> Cc:        Rajesh Ghanekar <[email protected]>, Ram Pandiri <[email protected]>, Sreeharsha Sarabu <[email protected]>, Abhijit Dey <[email protected]>, Tushar Shinde <[email protected]>, "[email protected]" <[email protected]>, "[email protected]" <[email protected]>
> Date:        07/25/2014 11:24 AM
> Subject:        Patch For Making Readdir_plus configurable
> Sent by:        [email protected]
> ________________________________________
>
>
>
> Hi,
>    One of our customer's application only needs file names not
> file attributes. With directories having 10K+ inodes (assuming buffer
> cache has directory blocks cached having file names, but inode
> cache is limited and hence need eviction of older cached inodes),
> older inodes are evicted periodically. So if they keep on doing
> readdir(2) from NSF client on multiple directories, some directory's
> files are periodically removed from inode cache and hence new
> readdir(2) on same directory requires disk access to bring back
> inodes again to inode cache.
>
> As READDIRPLUS request fetches attributes also, doing getattr on
> each file on server, it causes unnecessary disk accesses. If
> READDIRPLUS on NFS client is returned with -ENOTSUPP, NFS
> client uses READDIR request which just gets the names of the files
> in a directory, not attributes, hence avoiding disk accesses on server.
>
> Can this be per-export tunable so that different application can
> use it in different ways, some supporting readdirplus and others
> not supporting readdirplus?
>
> I have worked on a patch against 3.15.6 for this. Also I am
> adding a patch against latest nfs-utils to have an export option
> for this. Can someone let me know if these patches are adequate
> or if any other changes are required. Patches attached, although
> with minimal testing. I would like to know if something like this
> can be added and if the patch can be reworked if I am missing
> something for NFSv4.
>
>
> Regards,
> Rishi Agrawal
>
>
> [attachment "patch_linux-kernel-3-15-6" deleted by Christopher T Vogan/San Jose/IBM] [attachment "patch_nfs-utils-1.3" deleted by Christopher T Vogan/San Jose/IBM]
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html

2014-07-28 03:17:30

by Rishi Agrawal

[permalink] [raw]
Subject: RE: Patch For Making Readdir_plus configurable

Hi Christopher,

Customer is having mixed of NFS client OS setups and having this at server side would help to avoid having each client mount with this option.


From: Christopher T Vogan [mailto:[email protected]]
Sent: Friday, July 25, 2014 10:23 PM
To: Rishi Agrawal
Cc: [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]; [email protected]
Subject: Re: Patch For Making Readdir_plus configurable

There is a client side option "nordirplus" which can be used to force the client to use READDIR


Christopher Vogan
NFS Development & Test



From: ? ? ? ?Rishi Agrawal <[email protected]>
To: ? ? ? ?"[email protected]" <[email protected]>
Cc: ? ? ? ?Rajesh Ghanekar <[email protected]>, Ram Pandiri <[email protected]>, Sreeharsha Sarabu <[email protected]>, Abhijit Dey <[email protected]>, Tushar Shinde <[email protected]>, "[email protected]" <[email protected]>, "[email protected]" <[email protected]>
Date: ? ? ? ?07/25/2014 11:24 AM
Subject: ? ? ? ?Patch For Making Readdir_plus configurable
Sent by: ? ? ? [email protected]
________________________________________



Hi,
?? One of our customer's application only needs file names not
file attributes. With directories having 10K+ inodes (assuming buffer
cache has directory blocks cached having file names, but inode
cache is limited and hence need eviction of older cached inodes),
older inodes are evicted periodically. So if they keep on doing
readdir(2) from NSF client on multiple directories, some directory's
files are periodically removed from inode cache and hence new
readdir(2) on same directory requires disk access to bring back
inodes again to inode cache.

As READDIRPLUS request fetches attributes also, doing getattr on
each file on server, it causes unnecessary disk accesses. If
READDIRPLUS on NFS client is returned with -ENOTSUPP, NFS
client uses READDIR request which just gets the names of the files
in a directory, not attributes, hence avoiding disk accesses on server.

Can this be per-export tunable so that different application can
use it in different ways, some supporting readdirplus and others
not supporting readdirplus?

I have worked on a patch against 3.15.6 for this. Also I am
adding a patch against latest nfs-utils to have an export option
for this. Can someone let me know if these patches are adequate
or if any other changes are required. Patches attached, although
with minimal testing. I would like to know if something like this
can be added and if the patch can be reworked if I am missing
something for NFSv4.


Regards,
Rishi Agrawal


[attachment "patch_linux-kernel-3-15-6" deleted by Christopher T Vogan/San Jose/IBM] [attachment "patch_nfs-utils-1.3" deleted by Christopher T Vogan/San Jose/IBM]

2014-07-25 16:55:02

by Christopher T Vogan

[permalink] [raw]
Subject: Re: Patch For Making Readdir_plus configurable

There is a client side option "nordirplus" which can be used to force the
client to use READDIR


Christopher Vogan
NFS Development & Test


2014-08-19 07:53:49

by Rajesh Ghanekar

[permalink] [raw]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Tuesday 19 August 2014 03:12 AM, Abhijit Dey wrote:
> Bruce
>
> Your change looks appropriate. Please go ahead.
>
> I'd make that:
>
> "This option will disable READDIRPLUS request handling. When
> set, READDIRPLUS requests from NFS clients return
> NFS3ERR_NOTSUPP, and clients fall back on READDIR. This option
> affects only NFSv3 clients."
>
> Regards
> Abhijit
>
>
> -----Original Message-----
> From: J. Bruce Fields [mailto:[email protected]]
> Sent: Monday, August 18, 2014 2:19 PM
> To: Rajesh Ghanekar
> Cc: Steve Dickson; Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> On Mon, Aug 18, 2014 at 11:06:03AM -0700, Rajesh Ghanekar wrote:
>> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
>> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
>> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
>> @@ -360,6 +360,13 @@ supported so the same configuration can
>> kernels alike.
>>
>> .TP
>> +.IR nordirplus
>> +This option will allow disabling READDIRPLUS request handling.
>> +When enabled, READDIRPLUS requests from NFS client will be returned
>> +with "not supported" reply. Most of the NFS client implementations
>> +starts to use READDIR request if READDIRPLUS is returned with
>> +"not supported" reply. This option is only applicable for NFSv3.
> I'd make that:
>
> "This option will disable READDIRPLUS request handling. When
> set, READDIRPLUS requests from NFS clients return
> NFS3ERR_NOTSUPP, and clients fall back on READDIR. This option
> affects only NFSv3 clients."
>
> --b.

Okay.

From: Rajesh Ghanekar <[email protected]>

One of our customer's application only needs file names, not file
attributes. With directories having 10K+ inodes (assuming buffer cache
has directory blocks cached having file names, but inode cache is
limited and hence need eviction of older cached inodes), older inodes
are evicted periodically. So if they keep on doing readdir(2) from NSF
client on multiple directories, some directory's files are periodically
removed from inode cache and hence new readdir(2) on same directory
requires disk access to bring back inodes again to inode cache.

As READDIRPLUS request fetches attributes also, doing getattr on each
file on server, it causes unnecessary disk accesses. If READDIRPLUS on
NFS client is returned with -ENOTSUPP, NFS client uses READDIR request
which just gets the names of the files in a directory, not attributes,
hence avoiding disk accesses on server.

There's already a corresponding client-side mount option, but an export
option reduces the need for configuration across multiple clients.

This flag affects NFSv3 only. If it turns out it's needed for NFSv4 as
well then we may have to figure out how to extend the behavior to NFSv4,
but it's not currently obvious how to do that.

-----

Signed-off-by: Rajesh Ghanekar <[email protected]>

diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
--- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
@@ -17,7 +17,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40, 80, 100 unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80, 100 unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800
diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
--- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
@@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
"in" : "");
fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
"no_" : "");
+ if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
+ fprintf(fp, "nordirplus,");
if (ep->e_flags & NFSEXP_FSID) {
fprintf(fp, "fsid=%d,", ep->e_fsid);
}
@@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
clearflags(NFSEXP_ASYNC, active, ep);
else if (!strcmp(opt, "async"))
setflags(NFSEXP_ASYNC, active, ep);
+ else if (!strcmp(opt, "nordirplus"))
+ setflags(NFSEXP_NOREADDIRPLUS, active, ep);
else if (!strcmp(opt, "nohide"))
setflags(NFSEXP_NOHIDE, active, ep);
else if (!strcmp(opt, "hide"))
diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
--- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-19 12:32:30.498780854 +0530
@@ -360,6 +360,11 @@ supported so the same configuration can
kernels alike.

.TP
+.IR nordirplus
+This option will disable READDIRPLUS request handling. When set,
+READDIRPLUS requests from NFS clients return NFS3ERR_NOTSUPP, and
+clients fall back on READDIR. This option affects only NFSv3 clients.
+.TP
.IR refer= path@host[+host][:path@host[+host]]
A client referencing the export point will be directed to choose from
the given list an alternative location for the filesystem.

-----

Thanks,
Rajesh


>
>> +.TP
>> .IR refer= path@host[+host][:path@host[+host]]
>> A client referencing the export point will be directed to choose from
>> the given list an alternative location for the filesystem.
>>
>> -----
>>
>> Thanks,
>> Rajesh
>>
>>
>> -----Original Message-----
>> From: [email protected] [mailto:[email protected]] On Behalf Of Rajesh Ghanekar
>> Sent: Monday, August 18, 2014 11:17 PM
>> To: J. Bruce Fields; Steve Dickson
>> Cc: Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
>> Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>>
>> Hi Bruce, Steve,
>> Here is the nfs-utils patch reworked. Sorry for top posting, though.
>> We had to wait for internal legal approval to complete, and hence got delayed. Same "signed-off" by signature can go to nfsd kernel patch which you have reworked. Please let me know if I need to resend (copy from your mail with signed-off added) nfsd kernel patch.
>>
>> Signed-off-by: Rajesh Ghanekar <[email protected]>
>>
>>
>> diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
>> --- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
>> +++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
>> @@ -17,7 +17,8 @@
>> #define NFSEXP_ALLSQUASH 0x0008
>> #define NFSEXP_ASYNC 0x0010
>> #define NFSEXP_GATHERED_WRITES 0x0020
>> -/* 40, 80, 100 unused */
>> +#define NFSEXP_NOREADDIRPLUS 0x0040
>> +/* 80, 100 unused */
>> #define NFSEXP_NOHIDE 0x0200
>> #define NFSEXP_NOSUBTREECHECK 0x0400
>> #define NFSEXP_NOAUTHNLM 0x0800
>> diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
>> --- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
>> +++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
>> @@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
>> "in" : "");
>> fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
>> "no_" : "");
>> + if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
>> + fprintf(fp, "nordirplus,");
>> if (ep->e_flags & NFSEXP_FSID) {
>> fprintf(fp, "fsid=%d,", ep->e_fsid);
>> }
>> @@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
>> clearflags(NFSEXP_ASYNC, active, ep);
>> else if (!strcmp(opt, "async"))
>> setflags(NFSEXP_ASYNC, active, ep);
>> + else if (!strcmp(opt, "nordirplus"))
>> + setflags(NFSEXP_NOREADDIRPLUS, active, ep);
>> else if (!strcmp(opt, "nohide"))
>> setflags(NFSEXP_NOHIDE, active, ep);
>> else if (!strcmp(opt, "hide"))
>> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
>> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
>> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
>> @@ -360,6 +360,13 @@ supported so the same configuration can kernels alike.
>>
>> .TP
>> +.IR nordirplus
>> +This option will allow disabling READDIRPLUS request handling.
>> +When enabled, READDIRPLUS requests from NFS client will be returned
>> +with "not supported" reply. Most of the NFS client implementations
>> +starts to use READDIR request if READDIRPLUS is returned with "not
>> +supported" reply. This option is only applicable for NFSv3.
>> +.TP
>> .IR refer= path@host[+host][:path@host[+host]]
>> A client referencing the export point will be directed to choose from the given list an alternative location for the filesystem.
>>
>>
>> Thanks,
>> Rajesh
>>
>> -----Original Message-----
>> From: J. Bruce Fields [mailto:[email protected]]
>> Sent: Tuesday, August 05, 2014 11:52 PM
>> To: Steve Dickson
>> Cc: Rishi Agrawal; [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
>> Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>>
>> On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
>>> On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
>>>> +static int
>>>> +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct
>>>> +svc_fh *fhp) {
>>>> + struct svc_export *exp;
>>>> + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
>>>> + int err;
>>>> +
>>>> + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
>>>> + if (err) {
>>>> + goto out;
>>>> + }
>>> Actually, this isn't right: errors from fh_verify should be returned
>>> to the client or weird things could happen (e.g. what should have been
>>> a transient DELAY error could result in the client turning off
>>> readdirplus).
>> Apologies, I misread: as the comment above notes, it falls back on allowing readdirplus when this fails, so I don't think there's a real bug here.
>>
>>> And MAY_READ is more than nfsd_readdir actually asks for, I think,
>>> probably should just be MAY_NOP here.
>>>
>>> I'll fix that up.--b.
>> But it's probably still better to return the fh_verify error on failure, as follows.
>>
>> --b.
>>
>> diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c index 72ffd7cce3c3..30a739d896ff 100644
>> --- a/fs/nfsd/export.c
>> +++ b/fs/nfsd/export.c
>> @@ -1145,6 +1145,7 @@ static struct flags {
>> { NFSEXP_ALLSQUASH, {"all_squash", ""}},
>> { NFSEXP_ASYNC, {"async", "sync"}},
>> { NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
>> + { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
>> { NFSEXP_NOHIDE, {"nohide", ""}},
>> { NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
>> { NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}}, diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c index fa2525b2e9d7..247b06fb400d 100644
>> --- a/fs/nfsd/nfs3proc.c
>> +++ b/fs/nfsd/nfs3proc.c
>> @@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
>> resp->buflen = resp->count;
>> resp->rqstp = rqstp;
>> offset = argp->cookie;
>> +
>> + nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
>> + if (nfserr)
>> + RETURN_STATUS(nfserr);
>> +
>> + if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
>> + RETURN_STATUS(nfserr_notsupp);
>> +
>> nfserr = nfsd_readdir(rqstp, &resp->fh,
>> &offset,
>> &resp->common,
>> diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
>> index cf47c313794e..584b6ef3a5e8 100644
>> --- a/include/uapi/linux/nfsd/export.h
>> +++ b/include/uapi/linux/nfsd/export.h
>> @@ -28,7 +28,8 @@
>> #define NFSEXP_ALLSQUASH 0x0008
>> #define NFSEXP_ASYNC 0x0010
>> #define NFSEXP_GATHERED_WRITES 0x0020
>> -/* 40 80 100 currently unused */
>> +#define NFSEXP_NOREADDIRPLUS 0x0040
>> +/* 80 100 currently unused */
>> #define NFSEXP_NOHIDE 0x0200
>> #define NFSEXP_NOSUBTREECHECK 0x0400
>> #define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
>> @@ -47,7 +48,7 @@
>> */
>> #define NFSEXP_V4ROOT 0x10000
>> /* All flags that we claim to support. (Note we don't support NOACL.) */
>> -#define NFSEXP_ALLFLAGS 0x17E3F
>> +#define NFSEXP_ALLFLAGS 0x1FE7F
>>
>> /* The flags that may vary depending on security flavor: */
>> #define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html


2014-08-05 18:21:35

by J. Bruce Fields

[permalink] [raw]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
> On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> > +static int
> > +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct svc_fh *fhp)
> > +{
> > + struct svc_export *exp;
> > + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> > + int err;
> > +
> > + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> > + if (err) {
> > + goto out;
> > + }
>
> Actually, this isn't right: errors from fh_verify should be returned to
> the client or weird things could happen (e.g. what should have been a
> transient DELAY error could result in the client turning off
> readdirplus).

Apologies, I misread: as the comment above notes, it falls back on
allowing readdirplus when this fails, so I don't think there's a real
bug here.

> And MAY_READ is more than nfsd_readdir actually asks for,
> I think, probably should just be MAY_NOP here.
>
> I'll fix that up.--b.

But it's probably still better to return the fh_verify error on failure,
as follows.

--b.

diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c
index 72ffd7cce3c3..30a739d896ff 100644
--- a/fs/nfsd/export.c
+++ b/fs/nfsd/export.c
@@ -1145,6 +1145,7 @@ static struct flags {
{ NFSEXP_ALLSQUASH, {"all_squash", ""}},
{ NFSEXP_ASYNC, {"async", "sync"}},
{ NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
+ { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
{ NFSEXP_NOHIDE, {"nohide", ""}},
{ NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
{ NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}},
diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c
index fa2525b2e9d7..247b06fb400d 100644
--- a/fs/nfsd/nfs3proc.c
+++ b/fs/nfsd/nfs3proc.c
@@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
resp->buflen = resp->count;
resp->rqstp = rqstp;
offset = argp->cookie;
+
+ nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
+ if (nfserr)
+ RETURN_STATUS(nfserr);
+
+ if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
+ RETURN_STATUS(nfserr_notsupp);
+
nfserr = nfsd_readdir(rqstp, &resp->fh,
&offset,
&resp->common,
diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
index cf47c313794e..584b6ef3a5e8 100644
--- a/include/uapi/linux/nfsd/export.h
+++ b/include/uapi/linux/nfsd/export.h
@@ -28,7 +28,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40 80 100 currently unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80 100 currently unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
@@ -47,7 +48,7 @@
*/
#define NFSEXP_V4ROOT 0x10000
/* All flags that we claim to support. (Note we don't support NOACL.) */
-#define NFSEXP_ALLFLAGS 0x17E3F
+#define NFSEXP_ALLFLAGS 0x1FE7F

/* The flags that may vary depending on security flavor: */
#define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \

2014-08-05 07:03:58

by Rishi Agrawal

[permalink] [raw]
Subject: RE: Patch For Making Readdir_plus configurable

Hi,

Regards,
Rishi Agrawal

-----Original Message-----
From: Steve Dickson [mailto:[email protected]]
Sent: Monday, August 04, 2014 8:01 PM
To: Rishi Agrawal; [email protected]
Cc: Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
Subject: Re: Patch For Making Readdir_plus configurable

Hello,

On 25/07/14 12:19, Rishi Agrawal wrote:
> Hi,
> One of our customer's application only needs file names not file
> attributes. With directories having 10K+ inodes (assuming buffer cache
> has directory blocks cached having file names, but inode cache is
> limited and hence need eviction of older cached inodes), older inodes
> are evicted periodically. So if they keep on doing
> readdir(2) from NSF client on multiple directories, some directory's
> files are periodically removed from inode cache and hence new
> readdir(2) on same directory requires disk access to bring back inodes
> again to inode cache.
>
> As READDIRPLUS request fetches attributes also, doing getattr on each
> file on server, it causes unnecessary disk accesses. If READDIRPLUS on
> NFS client is returned with -ENOTSUPP, NFS client uses READDIR request
> which just gets the names of the files in a directory, not attributes,
> hence avoiding disk accesses on server.
>
> Can this be per-export tunable so that different application can use
> it in different ways, some supporting readdirplus and others not
> supporting readdirplus?
>
> I have worked on a patch against 3.15.6 for this. Also I am adding a
> patch against latest nfs-utils to have an export option for this. Can
> someone let me know if these patches are adequate or if any other
> changes are required. Patches attached, although with minimal testing.
> I would like to know if something like this can be added and if the
> patch can be reworked if I am missing something for NFSv4.

I just notice that the nfs-utils patch does not update the exports(5) man page. In that update please note this is a v3 only thing.... Not clear what we are going to do in the v4 case.

Finally, please inline your patch posting in the your email as its is explained there
https://www.kernel.org/doc/Documentation/SubmittingPatches

It just makes it easier for everyone to do the review...

tia,

steved.
[[[Rishi]]]

I will take care of the changes and resubmit the patch.

-- Rishi

2014-08-04 14:31:15

by Steve Dickson

[permalink] [raw]
Subject: Re: Patch For Making Readdir_plus configurable

Hello,

On 25/07/14 12:19, Rishi Agrawal wrote:
> Hi,
> One of our customer's application only needs file names not
> file attributes. With directories having 10K+ inodes (assuming buffer
> cache has directory blocks cached having file names, but inode
> cache is limited and hence need eviction of older cached inodes),
> older inodes are evicted periodically. So if they keep on doing
> readdir(2) from NSF client on multiple directories, some directory's
> files are periodically removed from inode cache and hence new
> readdir(2) on same directory requires disk access to bring back
> inodes again to inode cache.
>
> As READDIRPLUS request fetches attributes also, doing getattr on
> each file on server, it causes unnecessary disk accesses. If
> READDIRPLUS on NFS client is returned with -ENOTSUPP, NFS
> client uses READDIR request which just gets the names of the files
> in a directory, not attributes, hence avoiding disk accesses on server.
>
> Can this be per-export tunable so that different application can
> use it in different ways, some supporting readdirplus and others
> not supporting readdirplus?
>
> I have worked on a patch against 3.15.6 for this. Also I am
> adding a patch against latest nfs-utils to have an export option
> for this. Can someone let me know if these patches are adequate
> or if any other changes are required. Patches attached, although
> with minimal testing. I would like to know if something like this
> can be added and if the patch can be reworked if I am missing
> something for NFSv4.

I just notice that the nfs-utils patch does not update
the exports(5) man page. In that update please note
this is a v3 only thing.... Not clear what we are going
to do in the v4 case.

Finally, please inline your patch posting in the your
email as its is explained there
https://www.kernel.org/doc/Documentation/SubmittingPatches

It just makes it easier for everyone to do the review...

tia,

steved.

2014-08-04 21:46:51

by J. Bruce Fields

[permalink] [raw]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> +static int
> +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct svc_fh *fhp)
> +{
> + struct svc_export *exp;
> + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> + int err;
> +
> + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> + if (err) {
> + goto out;
> + }

Actually, this isn't right: errors from fh_verify should be returned to
the client or weird things could happen (e.g. what should have been a
transient DELAY error could result in the client turning off
readdirplus). And MAY_READ is more than nfsd_readdir actually asks for,
I think, probably should just be MAY_NOP here.

I'll fix that up.--b.

> +
> + exp = fhp->fh_export;
> + if (exp->ex_flags & NFSEXP_NOREADDIRPLUS) {
> + supported = 0;
> + }
> +out:
> + return supported;
> +}
> +
> /*
> * Read a portion of a directory, including file handles and attrs.
> * For now, we choose to ignore the dircount parameter.
> @@ -471,10 +491,16 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
> resp->buflen = resp->count;
> resp->rqstp = rqstp;
> offset = argp->cookie;
> - nfserr = nfsd_readdir(rqstp, &resp->fh,
> - &offset,
> - &resp->common,
> - nfs3svc_encode_entry_plus);
> +
> + if (nfsd3_is_readdirplus_supported(rqstp, &resp->fh)) {
> + nfserr = nfsd_readdir(rqstp, &resp->fh,
> + &offset,
> + &resp->common,
> + nfs3svc_encode_entry_plus);
> + } else {
> + nfserr = nfserrno(-EOPNOTSUPP);
> + }
> +
> memcpy(resp->verf, argp->verf, 8);
> for (p = rqstp->rq_respages + 1; p < rqstp->rq_next_page; p++) {
> page_addr = page_address(*p);
> diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
> index cf47c313794e..584b6ef3a5e8 100644
> --- a/include/uapi/linux/nfsd/export.h
> +++ b/include/uapi/linux/nfsd/export.h
> @@ -28,7 +28,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40 80 100 currently unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80 100 currently unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
> @@ -47,7 +48,7 @@
> */
> #define NFSEXP_V4ROOT 0x10000
> /* All flags that we claim to support. (Note we don't support NOACL.) */
> -#define NFSEXP_ALLFLAGS 0x17E3F
> +#define NFSEXP_ALLFLAGS 0x1FE7F
>
> /* The flags that may vary depending on security flavor: */
> #define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \
> --
> 1.9.3
>

2014-08-04 15:24:13

by J. Bruce Fields

[permalink] [raw]
Subject: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

From: Rishi Agrawal <[email protected]>

One of our customer's application only needs file names, not file
attributes. With directories having 10K+ inodes (assuming buffer cache
has directory blocks cached having file names, but inode cache is
limited and hence need eviction of older cached inodes), older inodes
are evicted periodically. So if they keep on doing readdir(2) from NSF
client on multiple directories, some directory's files are periodically
removed from inode cache and hence new readdir(2) on same directory
requires disk access to bring back inodes again to inode cache.

As READDIRPLUS request fetches attributes also, doing getattr on each
file on server, it causes unnecessary disk accesses. If READDIRPLUS on
NFS client is returned with -ENOTSUPP, NFS client uses READDIR request
which just gets the names of the files in a directory, not attributes,
hence avoiding disk accesses on server.

There's already a corresponding client-side mount option, but an export
option reduces the need for configuration across multiple clients.

This flag affects NFSv3 only. If it turns out it's needed for NFSv4 as
well then we may have to figure out how to extend the behavior to NFSv4,
but it's not currently obvious how to do that.

Signed-off-by: J. Bruce Fields <[email protected]>
---
fs/nfsd/export.c | 1 +
fs/nfsd/nfs3proc.c | 34 ++++++++++++++++++++++++++++++----
include/uapi/linux/nfsd/export.h | 5 +++--
3 files changed, 34 insertions(+), 6 deletions(-)

On Mon, Aug 04, 2014 at 10:31:09AM -0400, Steve Dickson wrote:
> I just notice that the nfs-utils patch does not update
> the exports(5) man page. In that update please note
> this is a v3 only thing.... Not clear what we are going
> to do in the v4 case.
>
> Finally, please inline your patch posting in the your
> email as its is explained there
> https://www.kernel.org/doc/Documentation/SubmittingPatches
>
> It just makes it easier for everyone to do the review...

As an example, here's the kernel patch; could you do the same for the
nfs-utils patch? Also:

- am I correct to credit you as the author? And,
- could you let me know if you're OK with adding a signed-off-by
line for you to this patch? (See the "Developer's Certificate
of Origin" in SubmittingPatches.)

--b.

diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c
index 72ffd7cce3c3..30a739d896ff 100644
--- a/fs/nfsd/export.c
+++ b/fs/nfsd/export.c
@@ -1145,6 +1145,7 @@ static struct flags {
{ NFSEXP_ALLSQUASH, {"all_squash", ""}},
{ NFSEXP_ASYNC, {"async", "sync"}},
{ NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
+ { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
{ NFSEXP_NOHIDE, {"nohide", ""}},
{ NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
{ NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}},
diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c
index fa2525b2e9d7..a5bf378ab268 100644
--- a/fs/nfsd/nfs3proc.c
+++ b/fs/nfsd/nfs3proc.c
@@ -441,6 +441,26 @@ nfsd3_proc_readdir(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
RETURN_STATUS(nfserr);
}

+static int
+nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct svc_fh *fhp)
+{
+ struct svc_export *exp;
+ int supported = 1; /* fall back to readdirplus supported in case of errors.*/
+ int err;
+
+ err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
+ if (err) {
+ goto out;
+ }
+
+ exp = fhp->fh_export;
+ if (exp->ex_flags & NFSEXP_NOREADDIRPLUS) {
+ supported = 0;
+ }
+out:
+ return supported;
+}
+
/*
* Read a portion of a directory, including file handles and attrs.
* For now, we choose to ignore the dircount parameter.
@@ -471,10 +491,16 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
resp->buflen = resp->count;
resp->rqstp = rqstp;
offset = argp->cookie;
- nfserr = nfsd_readdir(rqstp, &resp->fh,
- &offset,
- &resp->common,
- nfs3svc_encode_entry_plus);
+
+ if (nfsd3_is_readdirplus_supported(rqstp, &resp->fh)) {
+ nfserr = nfsd_readdir(rqstp, &resp->fh,
+ &offset,
+ &resp->common,
+ nfs3svc_encode_entry_plus);
+ } else {
+ nfserr = nfserrno(-EOPNOTSUPP);
+ }
+
memcpy(resp->verf, argp->verf, 8);
for (p = rqstp->rq_respages + 1; p < rqstp->rq_next_page; p++) {
page_addr = page_address(*p);
diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
index cf47c313794e..584b6ef3a5e8 100644
--- a/include/uapi/linux/nfsd/export.h
+++ b/include/uapi/linux/nfsd/export.h
@@ -28,7 +28,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40 80 100 currently unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80 100 currently unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
@@ -47,7 +48,7 @@
*/
#define NFSEXP_V4ROOT 0x10000
/* All flags that we claim to support. (Note we don't support NOACL.) */
-#define NFSEXP_ALLFLAGS 0x17E3F
+#define NFSEXP_ALLFLAGS 0x1FE7F

/* The flags that may vary depending on security flavor: */
#define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \
--
1.9.3


2014-08-18 21:47:27

by Abhijit Dey

[permalink] [raw]
Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

Bruce

Your change looks appropriate. Please go ahead.

I'd make that:

"This option will disable READDIRPLUS request handling. When
set, READDIRPLUS requests from NFS clients return
NFS3ERR_NOTSUPP, and clients fall back on READDIR. This option
affects only NFSv3 clients."

Regards
Abhijit


-----Original Message-----
From: J. Bruce Fields [mailto:[email protected]]
Sent: Monday, August 18, 2014 2:19 PM
To: Rajesh Ghanekar
Cc: Steve Dickson; Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 18, 2014 at 11:06:03AM -0700, Rajesh Ghanekar wrote:
> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
> @@ -360,6 +360,13 @@ supported so the same configuration can
> kernels alike.
>
> .TP
> +.IR nordirplus
> +This option will allow disabling READDIRPLUS request handling.
> +When enabled, READDIRPLUS requests from NFS client will be returned
> +with "not supported" reply. Most of the NFS client implementations
> +starts to use READDIR request if READDIRPLUS is returned with
> +"not supported" reply. This option is only applicable for NFSv3.

I'd make that:

"This option will disable READDIRPLUS request handling. When
set, READDIRPLUS requests from NFS clients return
NFS3ERR_NOTSUPP, and clients fall back on READDIR. This option
affects only NFSv3 clients."

--b.

> +.TP
> .IR refer= path@host[+host][:path@host[+host]]
> A client referencing the export point will be directed to choose from
> the given list an alternative location for the filesystem.
>
> -----
>
> Thanks,
> Rajesh
>
>
> -----Original Message-----
> From: [email protected] [mailto:[email protected]] On Behalf Of Rajesh Ghanekar
> Sent: Monday, August 18, 2014 11:17 PM
> To: J. Bruce Fields; Steve Dickson
> Cc: Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> Hi Bruce, Steve,
> Here is the nfs-utils patch reworked. Sorry for top posting, though.
> We had to wait for internal legal approval to complete, and hence got delayed. Same "signed-off" by signature can go to nfsd kernel patch which you have reworked. Please let me know if I need to resend (copy from your mail with signed-off added) nfsd kernel patch.
>
> Signed-off-by: Rajesh Ghanekar <[email protected]>
>
>
> diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
> --- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
> @@ -17,7 +17,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40, 80, 100 unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80, 100 unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800
> diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
> --- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
> @@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
> "in" : "");
> fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
> "no_" : "");
> + if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
> + fprintf(fp, "nordirplus,");
> if (ep->e_flags & NFSEXP_FSID) {
> fprintf(fp, "fsid=%d,", ep->e_fsid);
> }
> @@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
> clearflags(NFSEXP_ASYNC, active, ep);
> else if (!strcmp(opt, "async"))
> setflags(NFSEXP_ASYNC, active, ep);
> + else if (!strcmp(opt, "nordirplus"))
> + setflags(NFSEXP_NOREADDIRPLUS, active, ep);
> else if (!strcmp(opt, "nohide"))
> setflags(NFSEXP_NOHIDE, active, ep);
> else if (!strcmp(opt, "hide"))
> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
> @@ -360,6 +360,13 @@ supported so the same configuration can kernels alike.
>
> .TP
> +.IR nordirplus
> +This option will allow disabling READDIRPLUS request handling.
> +When enabled, READDIRPLUS requests from NFS client will be returned
> +with "not supported" reply. Most of the NFS client implementations
> +starts to use READDIR request if READDIRPLUS is returned with "not
> +supported" reply. This option is only applicable for NFSv3.
> +.TP
> .IR refer= path@host[+host][:path@host[+host]]
> A client referencing the export point will be directed to choose from the given list an alternative location for the filesystem.
>
>
> Thanks,
> Rajesh
>
> -----Original Message-----
> From: J. Bruce Fields [mailto:[email protected]]
> Sent: Tuesday, August 05, 2014 11:52 PM
> To: Steve Dickson
> Cc: Rishi Agrawal; [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
> > On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> > > +static int
> > > +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct
> > > +svc_fh *fhp) {
> > > + struct svc_export *exp;
> > > + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> > > + int err;
> > > +
> > > + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> > > + if (err) {
> > > + goto out;
> > > + }
> >
> > Actually, this isn't right: errors from fh_verify should be returned
> > to the client or weird things could happen (e.g. what should have been
> > a transient DELAY error could result in the client turning off
> > readdirplus).
>
> Apologies, I misread: as the comment above notes, it falls back on allowing readdirplus when this fails, so I don't think there's a real bug here.
>
> > And MAY_READ is more than nfsd_readdir actually asks for, I think,
> > probably should just be MAY_NOP here.
> >
> > I'll fix that up.--b.
>
> But it's probably still better to return the fh_verify error on failure, as follows.
>
> --b.
>
> diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c index 72ffd7cce3c3..30a739d896ff 100644
> --- a/fs/nfsd/export.c
> +++ b/fs/nfsd/export.c
> @@ -1145,6 +1145,7 @@ static struct flags {
> { NFSEXP_ALLSQUASH, {"all_squash", ""}},
> { NFSEXP_ASYNC, {"async", "sync"}},
> { NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
> + { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
> { NFSEXP_NOHIDE, {"nohide", ""}},
> { NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
> { NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}}, diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c index fa2525b2e9d7..247b06fb400d 100644
> --- a/fs/nfsd/nfs3proc.c
> +++ b/fs/nfsd/nfs3proc.c
> @@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
> resp->buflen = resp->count;
> resp->rqstp = rqstp;
> offset = argp->cookie;
> +
> + nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
> + if (nfserr)
> + RETURN_STATUS(nfserr);
> +
> + if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
> + RETURN_STATUS(nfserr_notsupp);
> +
> nfserr = nfsd_readdir(rqstp, &resp->fh,
> &offset,
> &resp->common,
> diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
> index cf47c313794e..584b6ef3a5e8 100644
> --- a/include/uapi/linux/nfsd/export.h
> +++ b/include/uapi/linux/nfsd/export.h
> @@ -28,7 +28,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40 80 100 currently unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80 100 currently unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
> @@ -47,7 +48,7 @@
> */
> #define NFSEXP_V4ROOT 0x10000
> /* All flags that we claim to support. (Note we don't support NOACL.) */
> -#define NFSEXP_ALLFLAGS 0x17E3F
> +#define NFSEXP_ALLFLAGS 0x1FE7F
>
> /* The flags that may vary depending on security flavor: */
> #define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html

2014-08-18 19:10:03

by J. Bruce Fields

[permalink] [raw]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 18, 2014 at 11:06:03AM -0700, Rajesh Ghanekar wrote:
> Hi Bruce/Steve,
> I am resending with the description of the patch for
> nfs-utils (copied from Bruce's text). Please note that both
> the patches, nfs kernel and nfs-utils, will have following
> same Signed-off-by signature.
>
> From: Rajesh Ghanekar <[email protected]>

OK, thanks, applying for 3.18.--b.

>
> One of our customer's application only needs file names, not file
> attributes. With directories having 10K+ inodes (assuming buffer cache
> has directory blocks cached having file names, but inode cache is
> limited and hence need eviction of older cached inodes), older inodes
> are evicted periodically. So if they keep on doing readdir(2) from NSF
> client on multiple directories, some directory's files are periodically
> removed from inode cache and hence new readdir(2) on same directory
> requires disk access to bring back inodes again to inode cache.
>
> As READDIRPLUS request fetches attributes also, doing getattr on each
> file on server, it causes unnecessary disk accesses. If READDIRPLUS on
> NFS client is returned with -ENOTSUPP, NFS client uses READDIR request
> which just gets the names of the files in a directory, not attributes,
> hence avoiding disk accesses on server.
>
> There's already a corresponding client-side mount option, but an export
> option reduces the need for configuration across multiple clients.
>
> This flag affects NFSv3 only. If it turns out it's needed for NFSv4 as
> well then we may have to figure out how to extend the behavior to NFSv4,
> but it's not currently obvious how to do that.
>
> ------
>
> Signed-off-by: Rajesh Ghanekar <[email protected]>
>
> diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
> --- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
> @@ -17,7 +17,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40, 80, 100 unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80, 100 unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800
> diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
> --- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
> @@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
> "in" : "");
> fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
> "no_" : "");
> + if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
> + fprintf(fp, "nordirplus,");
> if (ep->e_flags & NFSEXP_FSID) {
> fprintf(fp, "fsid=%d,", ep->e_fsid);
> }
> @@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
> clearflags(NFSEXP_ASYNC, active, ep);
> else if (!strcmp(opt, "async"))
> setflags(NFSEXP_ASYNC, active, ep);
> + else if (!strcmp(opt, "nordirplus"))
> + setflags(NFSEXP_NOREADDIRPLUS, active, ep);
> else if (!strcmp(opt, "nohide"))
> setflags(NFSEXP_NOHIDE, active, ep);
> else if (!strcmp(opt, "hide"))
> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
> @@ -360,6 +360,13 @@ supported so the same configuration can
> kernels alike.
>
> .TP
> +.IR nordirplus
> +This option will allow disabling READDIRPLUS request handling.
> +When enabled, READDIRPLUS requests from NFS client will be returned
> +with "not supported" reply. Most of the NFS client implementations
> +starts to use READDIR request if READDIRPLUS is returned with
> +"not supported" reply. This option is only applicable for NFSv3.
> +.TP
> .IR refer= path@host[+host][:path@host[+host]]
> A client referencing the export point will be directed to choose from
> the given list an alternative location for the filesystem.
>
> -----
>
> Thanks,
> Rajesh
>
>
> -----Original Message-----
> From: [email protected] [mailto:[email protected]] On Behalf Of Rajesh Ghanekar
> Sent: Monday, August 18, 2014 11:17 PM
> To: J. Bruce Fields; Steve Dickson
> Cc: Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> Hi Bruce, Steve,
> Here is the nfs-utils patch reworked. Sorry for top posting, though.
> We had to wait for internal legal approval to complete, and hence got delayed. Same "signed-off" by signature can go to nfsd kernel patch which you have reworked. Please let me know if I need to resend (copy from your mail with signed-off added) nfsd kernel patch.
>
> Signed-off-by: Rajesh Ghanekar <[email protected]>
>
>
> diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
> --- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
> @@ -17,7 +17,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40, 80, 100 unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80, 100 unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800
> diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
> --- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
> @@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
> "in" : "");
> fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
> "no_" : "");
> + if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
> + fprintf(fp, "nordirplus,");
> if (ep->e_flags & NFSEXP_FSID) {
> fprintf(fp, "fsid=%d,", ep->e_fsid);
> }
> @@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
> clearflags(NFSEXP_ASYNC, active, ep);
> else if (!strcmp(opt, "async"))
> setflags(NFSEXP_ASYNC, active, ep);
> + else if (!strcmp(opt, "nordirplus"))
> + setflags(NFSEXP_NOREADDIRPLUS, active, ep);
> else if (!strcmp(opt, "nohide"))
> setflags(NFSEXP_NOHIDE, active, ep);
> else if (!strcmp(opt, "hide"))
> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
> @@ -360,6 +360,13 @@ supported so the same configuration can kernels alike.
>
> .TP
> +.IR nordirplus
> +This option will allow disabling READDIRPLUS request handling.
> +When enabled, READDIRPLUS requests from NFS client will be returned
> +with "not supported" reply. Most of the NFS client implementations
> +starts to use READDIR request if READDIRPLUS is returned with "not
> +supported" reply. This option is only applicable for NFSv3.
> +.TP
> .IR refer= path@host[+host][:path@host[+host]]
> A client referencing the export point will be directed to choose from the given list an alternative location for the filesystem.
>
>
> Thanks,
> Rajesh
>
> -----Original Message-----
> From: J. Bruce Fields [mailto:[email protected]]
> Sent: Tuesday, August 05, 2014 11:52 PM
> To: Steve Dickson
> Cc: Rishi Agrawal; [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
> > On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> > > +static int
> > > +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct
> > > +svc_fh *fhp) {
> > > + struct svc_export *exp;
> > > + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> > > + int err;
> > > +
> > > + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> > > + if (err) {
> > > + goto out;
> > > + }
> >
> > Actually, this isn't right: errors from fh_verify should be returned
> > to the client or weird things could happen (e.g. what should have been
> > a transient DELAY error could result in the client turning off
> > readdirplus).
>
> Apologies, I misread: as the comment above notes, it falls back on allowing readdirplus when this fails, so I don't think there's a real bug here.
>
> > And MAY_READ is more than nfsd_readdir actually asks for, I think,
> > probably should just be MAY_NOP here.
> >
> > I'll fix that up.--b.
>
> But it's probably still better to return the fh_verify error on failure, as follows.
>
> --b.
>
> diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c index 72ffd7cce3c3..30a739d896ff 100644
> --- a/fs/nfsd/export.c
> +++ b/fs/nfsd/export.c
> @@ -1145,6 +1145,7 @@ static struct flags {
> { NFSEXP_ALLSQUASH, {"all_squash", ""}},
> { NFSEXP_ASYNC, {"async", "sync"}},
> { NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
> + { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
> { NFSEXP_NOHIDE, {"nohide", ""}},
> { NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
> { NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}}, diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c index fa2525b2e9d7..247b06fb400d 100644
> --- a/fs/nfsd/nfs3proc.c
> +++ b/fs/nfsd/nfs3proc.c
> @@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
> resp->buflen = resp->count;
> resp->rqstp = rqstp;
> offset = argp->cookie;
> +
> + nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
> + if (nfserr)
> + RETURN_STATUS(nfserr);
> +
> + if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
> + RETURN_STATUS(nfserr_notsupp);
> +
> nfserr = nfsd_readdir(rqstp, &resp->fh,
> &offset,
> &resp->common,
> diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
> index cf47c313794e..584b6ef3a5e8 100644
> --- a/include/uapi/linux/nfsd/export.h
> +++ b/include/uapi/linux/nfsd/export.h
> @@ -28,7 +28,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40 80 100 currently unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80 100 currently unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
> @@ -47,7 +48,7 @@
> */
> #define NFSEXP_V4ROOT 0x10000
> /* All flags that we claim to support. (Note we don't support NOACL.) */
> -#define NFSEXP_ALLFLAGS 0x17E3F
> +#define NFSEXP_ALLFLAGS 0x1FE7F
>
> /* The flags that may vary depending on security flavor: */
> #define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html

2014-08-18 17:55:42

by Rajesh Ghanekar

[permalink] [raw]
Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

Hi Bruce, Steve,
Here is the nfs-utils patch reworked. Sorry for top posting, though.
We had to wait for internal legal approval to complete, and hence
got delayed. Same "signed-off" by signature can go to nfsd kernel
patch which you have reworked. Please let me know if I need to
resend (copy from your mail with signed-off added) nfsd kernel patch.

Signed-off-by: Rajesh Ghanekar <[email protected]>


diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
--- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
@@ -17,7 +17,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40, 80, 100 unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80, 100 unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800
diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
--- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
@@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
"in" : "");
fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
"no_" : "");
+ if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
+ fprintf(fp, "nordirplus,");
if (ep->e_flags & NFSEXP_FSID) {
fprintf(fp, "fsid=%d,", ep->e_fsid);
}
@@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
clearflags(NFSEXP_ASYNC, active, ep);
else if (!strcmp(opt, "async"))
setflags(NFSEXP_ASYNC, active, ep);
+ else if (!strcmp(opt, "nordirplus"))
+ setflags(NFSEXP_NOREADDIRPLUS, active, ep);
else if (!strcmp(opt, "nohide"))
setflags(NFSEXP_NOHIDE, active, ep);
else if (!strcmp(opt, "hide"))
diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
--- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
@@ -360,6 +360,13 @@ supported so the same configuration can
kernels alike.

.TP
+.IR nordirplus
+This option will allow disabling READDIRPLUS request handling.
+When enabled, READDIRPLUS requests from NFS client will be returned
+with "not supported" reply. Most of the NFS client implementations
+starts to use READDIR request if READDIRPLUS is returned with
+"not supported" reply. This option is only applicable for NFSv3.
+.TP
.IR refer= path@host[+host][:path@host[+host]]
A client referencing the export point will be directed to choose from
the given list an alternative location for the filesystem.


Thanks,
Rajesh

-----Original Message-----
From: J. Bruce Fields [mailto:[email protected]]
Sent: Tuesday, August 05, 2014 11:52 PM
To: Steve Dickson
Cc: Rishi Agrawal; [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
> On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> > +static int
> > +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct
> > +svc_fh *fhp) {
> > + struct svc_export *exp;
> > + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> > + int err;
> > +
> > + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> > + if (err) {
> > + goto out;
> > + }
>
> Actually, this isn't right: errors from fh_verify should be returned
> to the client or weird things could happen (e.g. what should have been
> a transient DELAY error could result in the client turning off
> readdirplus).

Apologies, I misread: as the comment above notes, it falls back on allowing readdirplus when this fails, so I don't think there's a real bug here.

> And MAY_READ is more than nfsd_readdir actually asks for, I think,
> probably should just be MAY_NOP here.
>
> I'll fix that up.--b.

But it's probably still better to return the fh_verify error on failure, as follows.

--b.

diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c index 72ffd7cce3c3..30a739d896ff 100644
--- a/fs/nfsd/export.c
+++ b/fs/nfsd/export.c
@@ -1145,6 +1145,7 @@ static struct flags {
{ NFSEXP_ALLSQUASH, {"all_squash", ""}},
{ NFSEXP_ASYNC, {"async", "sync"}},
{ NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
+ { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
{ NFSEXP_NOHIDE, {"nohide", ""}},
{ NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
{ NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}}, diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c index fa2525b2e9d7..247b06fb400d 100644
--- a/fs/nfsd/nfs3proc.c
+++ b/fs/nfsd/nfs3proc.c
@@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
resp->buflen = resp->count;
resp->rqstp = rqstp;
offset = argp->cookie;
+
+ nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
+ if (nfserr)
+ RETURN_STATUS(nfserr);
+
+ if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
+ RETURN_STATUS(nfserr_notsupp);
+
nfserr = nfsd_readdir(rqstp, &resp->fh,
&offset,
&resp->common,
diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
index cf47c313794e..584b6ef3a5e8 100644
--- a/include/uapi/linux/nfsd/export.h
+++ b/include/uapi/linux/nfsd/export.h
@@ -28,7 +28,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40 80 100 currently unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80 100 currently unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
@@ -47,7 +48,7 @@
*/
#define NFSEXP_V4ROOT 0x10000
/* All flags that we claim to support. (Note we don't support NOACL.) */
-#define NFSEXP_ALLFLAGS 0x17E3F
+#define NFSEXP_ALLFLAGS 0x1FE7F

/* The flags that may vary depending on security flavor: */
#define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \

2014-08-18 18:19:53

by Rajesh Ghanekar

[permalink] [raw]
Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

Hi Bruce/Steve,
I am resending with the description of the patch for
nfs-utils (copied from Bruce's text). Please note that both
the patches, nfs kernel and nfs-utils, will have following
same Signed-off-by signature.

From: Rajesh Ghanekar <[email protected]>

One of our customer's application only needs file names, not file
attributes. With directories having 10K+ inodes (assuming buffer cache
has directory blocks cached having file names, but inode cache is
limited and hence need eviction of older cached inodes), older inodes
are evicted periodically. So if they keep on doing readdir(2) from NSF
client on multiple directories, some directory's files are periodically
removed from inode cache and hence new readdir(2) on same directory
requires disk access to bring back inodes again to inode cache.

As READDIRPLUS request fetches attributes also, doing getattr on each
file on server, it causes unnecessary disk accesses. If READDIRPLUS on
NFS client is returned with -ENOTSUPP, NFS client uses READDIR request
which just gets the names of the files in a directory, not attributes,
hence avoiding disk accesses on server.

There's already a corresponding client-side mount option, but an export
option reduces the need for configuration across multiple clients.

This flag affects NFSv3 only. If it turns out it's needed for NFSv4 as
well then we may have to figure out how to extend the behavior to NFSv4,
but it's not currently obvious how to do that.

------

Signed-off-by: Rajesh Ghanekar <[email protected]>

diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
--- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
@@ -17,7 +17,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40, 80, 100 unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80, 100 unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800
diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
--- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
@@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
"in" : "");
fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
"no_" : "");
+ if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
+ fprintf(fp, "nordirplus,");
if (ep->e_flags & NFSEXP_FSID) {
fprintf(fp, "fsid=%d,", ep->e_fsid);
}
@@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
clearflags(NFSEXP_ASYNC, active, ep);
else if (!strcmp(opt, "async"))
setflags(NFSEXP_ASYNC, active, ep);
+ else if (!strcmp(opt, "nordirplus"))
+ setflags(NFSEXP_NOREADDIRPLUS, active, ep);
else if (!strcmp(opt, "nohide"))
setflags(NFSEXP_NOHIDE, active, ep);
else if (!strcmp(opt, "hide"))
diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
--- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
@@ -360,6 +360,13 @@ supported so the same configuration can
kernels alike.

.TP
+.IR nordirplus
+This option will allow disabling READDIRPLUS request handling.
+When enabled, READDIRPLUS requests from NFS client will be returned
+with "not supported" reply. Most of the NFS client implementations
+starts to use READDIR request if READDIRPLUS is returned with
+"not supported" reply. This option is only applicable for NFSv3.
+.TP
.IR refer= path@host[+host][:path@host[+host]]
A client referencing the export point will be directed to choose from
the given list an alternative location for the filesystem.

-----

Thanks,
Rajesh


-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Rajesh Ghanekar
Sent: Monday, August 18, 2014 11:17 PM
To: J. Bruce Fields; Steve Dickson
Cc: Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

Hi Bruce, Steve,
Here is the nfs-utils patch reworked. Sorry for top posting, though.
We had to wait for internal legal approval to complete, and hence got delayed. Same "signed-off" by signature can go to nfsd kernel patch which you have reworked. Please let me know if I need to resend (copy from your mail with signed-off added) nfsd kernel patch.

Signed-off-by: Rajesh Ghanekar <[email protected]>


diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
--- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
@@ -17,7 +17,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40, 80, 100 unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80, 100 unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800
diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
--- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
@@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
"in" : "");
fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
"no_" : "");
+ if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
+ fprintf(fp, "nordirplus,");
if (ep->e_flags & NFSEXP_FSID) {
fprintf(fp, "fsid=%d,", ep->e_fsid);
}
@@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
clearflags(NFSEXP_ASYNC, active, ep);
else if (!strcmp(opt, "async"))
setflags(NFSEXP_ASYNC, active, ep);
+ else if (!strcmp(opt, "nordirplus"))
+ setflags(NFSEXP_NOREADDIRPLUS, active, ep);
else if (!strcmp(opt, "nohide"))
setflags(NFSEXP_NOHIDE, active, ep);
else if (!strcmp(opt, "hide"))
diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
--- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
+++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
@@ -360,6 +360,13 @@ supported so the same configuration can kernels alike.

.TP
+.IR nordirplus
+This option will allow disabling READDIRPLUS request handling.
+When enabled, READDIRPLUS requests from NFS client will be returned
+with "not supported" reply. Most of the NFS client implementations
+starts to use READDIR request if READDIRPLUS is returned with "not
+supported" reply. This option is only applicable for NFSv3.
+.TP
.IR refer= path@host[+host][:path@host[+host]]
A client referencing the export point will be directed to choose from the given list an alternative location for the filesystem.


Thanks,
Rajesh

-----Original Message-----
From: J. Bruce Fields [mailto:[email protected]]
Sent: Tuesday, August 05, 2014 11:52 PM
To: Steve Dickson
Cc: Rishi Agrawal; [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
> On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> > +static int
> > +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct
> > +svc_fh *fhp) {
> > + struct svc_export *exp;
> > + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> > + int err;
> > +
> > + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> > + if (err) {
> > + goto out;
> > + }
>
> Actually, this isn't right: errors from fh_verify should be returned
> to the client or weird things could happen (e.g. what should have been
> a transient DELAY error could result in the client turning off
> readdirplus).

Apologies, I misread: as the comment above notes, it falls back on allowing readdirplus when this fails, so I don't think there's a real bug here.

> And MAY_READ is more than nfsd_readdir actually asks for, I think,
> probably should just be MAY_NOP here.
>
> I'll fix that up.--b.

But it's probably still better to return the fh_verify error on failure, as follows.

--b.

diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c index 72ffd7cce3c3..30a739d896ff 100644
--- a/fs/nfsd/export.c
+++ b/fs/nfsd/export.c
@@ -1145,6 +1145,7 @@ static struct flags {
{ NFSEXP_ALLSQUASH, {"all_squash", ""}},
{ NFSEXP_ASYNC, {"async", "sync"}},
{ NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
+ { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
{ NFSEXP_NOHIDE, {"nohide", ""}},
{ NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
{ NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}}, diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c index fa2525b2e9d7..247b06fb400d 100644
--- a/fs/nfsd/nfs3proc.c
+++ b/fs/nfsd/nfs3proc.c
@@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
resp->buflen = resp->count;
resp->rqstp = rqstp;
offset = argp->cookie;
+
+ nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
+ if (nfserr)
+ RETURN_STATUS(nfserr);
+
+ if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
+ RETURN_STATUS(nfserr_notsupp);
+
nfserr = nfsd_readdir(rqstp, &resp->fh,
&offset,
&resp->common,
diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
index cf47c313794e..584b6ef3a5e8 100644
--- a/include/uapi/linux/nfsd/export.h
+++ b/include/uapi/linux/nfsd/export.h
@@ -28,7 +28,8 @@
#define NFSEXP_ALLSQUASH 0x0008
#define NFSEXP_ASYNC 0x0010
#define NFSEXP_GATHERED_WRITES 0x0020
-/* 40 80 100 currently unused */
+#define NFSEXP_NOREADDIRPLUS 0x0040
+/* 80 100 currently unused */
#define NFSEXP_NOHIDE 0x0200
#define NFSEXP_NOSUBTREECHECK 0x0400
#define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
@@ -47,7 +48,7 @@
*/
#define NFSEXP_V4ROOT 0x10000
/* All flags that we claim to support. (Note we don't support NOACL.) */
-#define NFSEXP_ALLFLAGS 0x17E3F
+#define NFSEXP_ALLFLAGS 0x1FE7F

/* The flags that may vary depending on security flavor: */
#define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \

2014-08-18 21:19:15

by J. Bruce Fields

[permalink] [raw]
Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus

On Mon, Aug 18, 2014 at 11:06:03AM -0700, Rajesh Ghanekar wrote:
> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
> @@ -360,6 +360,13 @@ supported so the same configuration can
> kernels alike.
>
> .TP
> +.IR nordirplus
> +This option will allow disabling READDIRPLUS request handling.
> +When enabled, READDIRPLUS requests from NFS client will be returned
> +with "not supported" reply. Most of the NFS client implementations
> +starts to use READDIR request if READDIRPLUS is returned with
> +"not supported" reply. This option is only applicable for NFSv3.

I'd make that:

"This option will disable READDIRPLUS request handling. When
set, READDIRPLUS requests from NFS clients return
NFS3ERR_NOTSUPP, and clients fall back on READDIR. This option
affects only NFSv3 clients."

--b.

> +.TP
> .IR refer= path@host[+host][:path@host[+host]]
> A client referencing the export point will be directed to choose from
> the given list an alternative location for the filesystem.
>
> -----
>
> Thanks,
> Rajesh
>
>
> -----Original Message-----
> From: [email protected] [mailto:[email protected]] On Behalf Of Rajesh Ghanekar
> Sent: Monday, August 18, 2014 11:17 PM
> To: J. Bruce Fields; Steve Dickson
> Cc: Rishi Agrawal; [email protected]; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: RE: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> Hi Bruce, Steve,
> Here is the nfs-utils patch reworked. Sorry for top posting, though.
> We had to wait for internal legal approval to complete, and hence got delayed. Same "signed-off" by signature can go to nfsd kernel patch which you have reworked. Please let me know if I need to resend (copy from your mail with signed-off added) nfsd kernel patch.
>
> Signed-off-by: Rajesh Ghanekar <[email protected]>
>
>
> diff -uprN nfs-utils-1.3.0.old/support/include/nfs/export.h nfs-utils-1.3.0/support/include/nfs/export.h
> --- nfs-utils-1.3.0.old/support/include/nfs/export.h 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/include/nfs/export.h 2014-08-18 22:28:24.420262810 +0530
> @@ -17,7 +17,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40, 80, 100 unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80, 100 unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800
> diff -uprN nfs-utils-1.3.0.old/support/nfs/exports.c nfs-utils-1.3.0/support/nfs/exports.c
> --- nfs-utils-1.3.0.old/support/nfs/exports.c 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/support/nfs/exports.c 2014-08-18 22:28:24.600262814 +0530
> @@ -273,6 +273,8 @@ putexportent(struct exportent *ep)
> "in" : "");
> fprintf(fp, "%sacl,", (ep->e_flags & NFSEXP_NOACL)?
> "no_" : "");
> + if (ep->e_flags & NFSEXP_NOREADDIRPLUS)
> + fprintf(fp, "nordirplus,");
> if (ep->e_flags & NFSEXP_FSID) {
> fprintf(fp, "fsid=%d,", ep->e_fsid);
> }
> @@ -539,6 +541,8 @@ parseopts(char *cp, struct exportent *ep
> clearflags(NFSEXP_ASYNC, active, ep);
> else if (!strcmp(opt, "async"))
> setflags(NFSEXP_ASYNC, active, ep);
> + else if (!strcmp(opt, "nordirplus"))
> + setflags(NFSEXP_NOREADDIRPLUS, active, ep);
> else if (!strcmp(opt, "nohide"))
> setflags(NFSEXP_NOHIDE, active, ep);
> else if (!strcmp(opt, "hide"))
> diff -uprN nfs-utils-1.3.0.old/utils/exportfs/exports.man nfs-utils-1.3.0/utils/exportfs/exports.man
> --- nfs-utils-1.3.0.old/utils/exportfs/exports.man 2014-03-25 20:42:07.000000000 +0530
> +++ nfs-utils-1.3.0/utils/exportfs/exports.man 2014-08-18 22:27:23.360261358 +0530
> @@ -360,6 +360,13 @@ supported so the same configuration can kernels alike.
>
> .TP
> +.IR nordirplus
> +This option will allow disabling READDIRPLUS request handling.
> +When enabled, READDIRPLUS requests from NFS client will be returned
> +with "not supported" reply. Most of the NFS client implementations
> +starts to use READDIR request if READDIRPLUS is returned with "not
> +supported" reply. This option is only applicable for NFSv3.
> +.TP
> .IR refer= path@host[+host][:path@host[+host]]
> A client referencing the export point will be directed to choose from the given list an alternative location for the filesystem.
>
>
> Thanks,
> Rajesh
>
> -----Original Message-----
> From: J. Bruce Fields [mailto:[email protected]]
> Sent: Tuesday, August 05, 2014 11:52 PM
> To: Steve Dickson
> Cc: Rishi Agrawal; [email protected]; Rajesh Ghanekar; Ram Pandiri; Sreeharsha Sarabu; Abhijit Dey; Tushar Shinde; [email protected]
> Subject: Re: [PATCH] nfsd: allow turning off nfsv3 readdir_plus
>
> On Mon, Aug 04, 2014 at 05:46:47PM -0400, J. Bruce Fields wrote:
> > On Mon, Aug 04, 2014 at 11:24:11AM -0400, bfields wrote:
> > > +static int
> > > +nfsd3_is_readdirplus_supported(struct svc_rqst *rqstp, struct
> > > +svc_fh *fhp) {
> > > + struct svc_export *exp;
> > > + int supported = 1; /* fall back to readdirplus supported in case of errors.*/
> > > + int err;
> > > +
> > > + err = fh_verify(rqstp, fhp, S_IFDIR, NFSD_MAY_READ);
> > > + if (err) {
> > > + goto out;
> > > + }
> >
> > Actually, this isn't right: errors from fh_verify should be returned
> > to the client or weird things could happen (e.g. what should have been
> > a transient DELAY error could result in the client turning off
> > readdirplus).
>
> Apologies, I misread: as the comment above notes, it falls back on allowing readdirplus when this fails, so I don't think there's a real bug here.
>
> > And MAY_READ is more than nfsd_readdir actually asks for, I think,
> > probably should just be MAY_NOP here.
> >
> > I'll fix that up.--b.
>
> But it's probably still better to return the fh_verify error on failure, as follows.
>
> --b.
>
> diff --git a/fs/nfsd/export.c b/fs/nfsd/export.c index 72ffd7cce3c3..30a739d896ff 100644
> --- a/fs/nfsd/export.c
> +++ b/fs/nfsd/export.c
> @@ -1145,6 +1145,7 @@ static struct flags {
> { NFSEXP_ALLSQUASH, {"all_squash", ""}},
> { NFSEXP_ASYNC, {"async", "sync"}},
> { NFSEXP_GATHERED_WRITES, {"wdelay", "no_wdelay"}},
> + { NFSEXP_NOREADDIRPLUS, {"nordirplus", ""}},
> { NFSEXP_NOHIDE, {"nohide", ""}},
> { NFSEXP_CROSSMOUNT, {"crossmnt", ""}},
> { NFSEXP_NOSUBTREECHECK, {"no_subtree_check", ""}}, diff --git a/fs/nfsd/nfs3proc.c b/fs/nfsd/nfs3proc.c index fa2525b2e9d7..247b06fb400d 100644
> --- a/fs/nfsd/nfs3proc.c
> +++ b/fs/nfsd/nfs3proc.c
> @@ -471,6 +471,14 @@ nfsd3_proc_readdirplus(struct svc_rqst *rqstp, struct nfsd3_readdirargs *argp,
> resp->buflen = resp->count;
> resp->rqstp = rqstp;
> offset = argp->cookie;
> +
> + nfserr = fh_verify(rqstp, &resp->fh, S_IFDIR, NFSD_MAY_NOP);
> + if (nfserr)
> + RETURN_STATUS(nfserr);
> +
> + if (resp->fh.fh_export->ex_flags & NFSEXP_NOREADDIRPLUS)
> + RETURN_STATUS(nfserr_notsupp);
> +
> nfserr = nfsd_readdir(rqstp, &resp->fh,
> &offset,
> &resp->common,
> diff --git a/include/uapi/linux/nfsd/export.h b/include/uapi/linux/nfsd/export.h
> index cf47c313794e..584b6ef3a5e8 100644
> --- a/include/uapi/linux/nfsd/export.h
> +++ b/include/uapi/linux/nfsd/export.h
> @@ -28,7 +28,8 @@
> #define NFSEXP_ALLSQUASH 0x0008
> #define NFSEXP_ASYNC 0x0010
> #define NFSEXP_GATHERED_WRITES 0x0020
> -/* 40 80 100 currently unused */
> +#define NFSEXP_NOREADDIRPLUS 0x0040
> +/* 80 100 currently unused */
> #define NFSEXP_NOHIDE 0x0200
> #define NFSEXP_NOSUBTREECHECK 0x0400
> #define NFSEXP_NOAUTHNLM 0x0800 /* Don't authenticate NLM requests - just trust */
> @@ -47,7 +48,7 @@
> */
> #define NFSEXP_V4ROOT 0x10000
> /* All flags that we claim to support. (Note we don't support NOACL.) */
> -#define NFSEXP_ALLFLAGS 0x17E3F
> +#define NFSEXP_ALLFLAGS 0x1FE7F
>
> /* The flags that may vary depending on security flavor: */
> #define NFSEXP_SECINFO_FLAGS (NFSEXP_READONLY | NFSEXP_ROOTSQUASH \
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html