Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   "Benjamin Coddington" <bcodding@redhat.com>
To:     trondmy@gmail.com
Cc:     linux-nfs@vger.kernel.org
Subject: Re: [PATCH v3 00/17] Readdir enhancements
Date:   Sat, 07 Nov 2020 07:49:31 -0500
Message-ID: <0A45C334-A375-47DC-BA04-F25341F263FA@redhat.com>
In-Reply-To: <20201104161638.300324-1-trond.myklebust@hammerspace.com>
References: <20201104161638.300324-1-trond.myklebust@hammerspace.com>
MIME-Version: 1.0
Content-Type: text/plain
Precedence: bulk

On 4 Nov 2020, at 11:16, trondmy@gmail.com wrote:

> From: Trond Myklebust <trond.myklebust@hammerspace.com>
>
> The following patch series performs a number of cleanups on the readdir
> code.
> It also adds support for 1MB readdir RPC calls on-the-wire, and modifies
> the caching code to ensure that we cache the entire contents of that
> 1MB call (instead of discarding the data that doesn't fit into a single
> page).
>
> v2: Fix the handling of the NFSv3/v4 directory verifier
> v3: Optimise searching when the readdir cookies are seen to be ordered

Hi Trond, thanks for these.

I did a bit of testing with these on 4-core/4G client listing 1.5M files
with READDIR.  I compared v5.10-rc2 without/with this set.

+------+     v5.10.rc-2      +--+ this v3 patch set  +
| run  |  time   | rpc calls |  |  time  | rpc calls |

nfsv3 with dtsize 262144:
+------+---------+-----------+--+--------+-----------+
| 1    | 81.583  | 14710     |  | 53.568 | 215       |
| 2    | 81.147  | 14710     |  | 50.781 | 215       |
| 3    | 81.61   | 14710     |  | 50.514 | 215       |
| 4    | 82.405  | 14710     |  | 50.746 | 215       |
| 5    | 82.066  | 14710     |  | 50.397 | 215       |
| 6    | 82.395  | 14710     |  | 50.892 | 215       |
| 7    | 81.657  | 14710     |  | 50.882 | 215       |
| 8    | 81.555  | 14710     |  | 50.981 | 215       |
| 9    | 81.421  | 14710     |  | 50.558 | 215       |
| 10   | 81.472  | 14710     |  | 50.588 | 215       |

nfsv3 with dtsize 1048576:
+------+---------+-----------+--+--------+-----------+
| 1    | 81.563  | 14710     |  | 52.692 | 61        |
| 2    | 82.123  | 14710     |  | 49.934 | 61        |
| 3    | 81.714  | 14710     |  | 50.158 | 61        |
| 4    | 81.707  | 14710     |  | 50.083 | 61        |
| 5    | 81.44   | 14710     |  | 50.045 | 61        |
| 6    | 81.685  | 14710     |  | 50.021 | 61        |
| 7    | 81.17   | 14710     |  | 50.131 | 61        |
| 8    | 81.366  | 14710     |  | 49.928 | 61        |
| 9    | 81.067  | 14710     |  | 50.081 | 61        |
| 10   | 81.524  | 14710     |  | 50.442 | 61        |

nfsv4 with dtsize 32768:
+------+---------+-----------+--+--------+-----------+
| 1    | 99.534  | 14712     |  | 79.461 | 331       |
| 2    | 98.998  | 14712     |  | 79.338 | 331       |
| 3    | 99.462  | 14712     |  | 81.101 | 331       |
| 4    | 99.891  | 14712     |  | 78.888 | 331       |
| 5    | 99.516  | 14712     |  | 81.147 | 331       |
| 6    | 98.649  | 14712     |  | 83.084 | 331       |
| 7    | 101.159 | 14712     |  | 80.461 | 331       |
| 8    | 100.402 | 14712     |  | 79.003 | 331       |
| 9    | 98.548  | 14712     |  | 80.619 | 331       |
| 10   | 97.456  | 14712     |  | 81.317 | 331       |

nfsv4 with dtsize 1048576:
+------+---------+-----------+--+--------+-----------+
| 1    | 100.357 | 14712     |  | 78.976 | 91        |
| 2    | 99.61   | 14712     |  | 79.328 | 91        |
| 3    | 101.095 | 14712     |  | 80.649 | 91        |
| 4    | 107.904 | 14712     |  | 78.285 | 91        |
| 5    | 103.665 | 14712     |  | 79.258 | 91        |
| 6    | 98.877  | 14712     |  | 78.817 | 91        |
| 7    | 99.567  | 14712     |  | 81.11  | 91        |
| 8    | 99.096  | 14712     |  | 80.296 | 91        |
| 9    | 100.124 | 14712     |  | 78.865 | 91        |
| 10   | 100.603 | 14712     |  | 79.143 | 91        |

These look great.  Feel free to add either/both of my:
Reviewed-by: Benjamin Coddington <bcodding@redhat.com>
Tested-by: Benjamin Coddington <bcodding@redhat.com>

Ben