Received-SPF: pass (google.com: best guess record for domain of linux-nfs-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67;
From:   Trond Myklebust <trondmy@gmail.com>
Message-ID: <388ff8a1abebdf0eab8e696cb09148c0704dd766.camel@hammerspace.com>
Subject: Re: 'ls -lrt' performance issue on large dir while dir is being
 modified
To:     Dai Ngo <dai.ngo@oracle.com>,
        "chuck.lever@oracle.com" <chuck.lever@oracle.com>
Cc:     "linux-nfs@vger.kernel.org" <linux-nfs@vger.kernel.org>,
        "Anna.Schumaker@netapp.com" <Anna.Schumaker@netapp.com>
In-Reply-To: <52079beb-1f27-35d8-c92a-6a6b430c7c8f@oracle.com>
References: <e04baa28-2460-4ced-e387-618ea32d827c@oracle.com>
         <a41af3d6-8280-e315-fb65-a9285bad50ec@oracle.com>
         <770937d3-9439-db4a-1f6e-59a59f2c08b9@oracle.com>
         <9fdf37ffe4b3f7016a60e3a61c2087a825348b28.camel@hammerspace.com>
         <49bfa6104b6a65311594efd47592b5c2b25d905a.camel@hammerspace.com>
         <8439e738-6c90-29d9-efc8-300420b096b1@oracle.com>
         <43fae563e93052f9dc9584ddd800770a7b3b10d2.camel@hammerspace.com>
         <9327BCC2-6B75-47E3-8056-30499E090E18@oracle.com>
         <3456dea05ac1a2d82c077146e8638130e313edca.camel@hammerspace.com>
         <52079beb-1f27-35d8-c92a-6a6b430c7c8f@oracle.com>
Organization: Hammerspace Inc
Content-Type: text/plain; charset="UTF-8"
MIME-Version: 1.0
Date:   Mon, 20 Jan 2020 12:52:13 -0800
User-Agent: Evolution 3.34.3 (3.34.3-1.fc31) 
Content-Transfer-Encoding: 7bit
Sender: linux-nfs-owner@vger.kernel.org
Precedence: bulk

On Sat, 2020-01-18 at 10:03 -0800, Dai Ngo wrote:
> 
> I think this is the contention point: the spec did not explicitly
> mention anything regarding mixing of cookies from READDIR &
> READDIRPLUS.
> 
> However, as I mentioned, the current client implementation already
> mixing
> cookies between READDIRPLUS and READDIR, everytime the user does a
> simple
> 'ls' on a large directory, without invalidating any mapping.
> 
> Also, as Chuck mentioned, we're not aware of any server
> implementation
> that has problems with this mixing of cookies.
> 

OK I did a little time warp and went back to the original emails around
this behaviour:

https://linux-nfs.vger.kernel.narkive.com/O0Xhnqxe/readdir-vs-getattr


Part of the problem that needed solving at the time was that even when
the directory and its contents were not changing, people were still
needing to do reams of GETATTR calls in order to typically satisfy an
'ls -l' or even 'ls --color'. When we see that pattern, we want to
switch from using GETATTR on all these files to using READDIRPLUS.

The cache invalidation was introduced in order to force the NFS client
to do these READDIRPLUS calls so we avoid the GETATTRs.

So one optimisation we could definitely do is try to track the index of
the last page our descriptor accessed on readdir(), and truncate only
the remaining pages. That way we don't keep re-reading the beginning of
the directory.

-- 
Trond Myklebust
Linux NFS client maintainer, Hammerspace
trond.myklebust@hammerspace.com