Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Chuck Lever III <chuck.lever@oracle.com>
To:     Frank van der Linden <fllinden@amazon.com>,
        Wang Yugui <wangyugui@e16-tech.com>
CC:     Linux NFS Mailing List <linux-nfs@vger.kernel.org>,
        Matthew Wilcox <matthew.wilcox@oracle.com>,
        Liam Howlett <liam.howlett@oracle.com>
Subject: Re: filecache LRU performance regression
Thread-Topic: filecache LRU performance regression
Thread-Index: AQHYcfvwqM9TwnG0lkutiJn4EA8Bxq0zLyiAgAAP6gCABnuxAA==
Date:   Wed, 1 Jun 2022 00:34:34 +0000
Message-ID: <BED36887-054D-4DC9-A5F1-CB6DD1F0DC16@oracle.com>
References: <5C7024DA-A792-4091-BFDE-CEED59BC1B69@oracle.com>
 <20220527203721.GA10628@dev-dsk-fllinden-2c-d7720709.us-west-2.amazon.com>
 <ADD1751A-7F67-4729-BFFC-D6938CA963A0@oracle.com>
In-Reply-To: <ADD1751A-7F67-4729-BFFC-D6938CA963A0@oracle.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?wWEs/1vgmaSAFe23WcTZXgWrr0qXw6ynPl9Y2gp5oLljmpslvBU+U92TrqsR?=
 =?us-ascii?Q?hdyft+s+dUiZn5ZTAk7lql7dvaLuLxInUIHX9Fl5Kpbe6fIhT8aVoxYCsZd4?=
 =?us-ascii?Q?cx0OQRjNmoOK4Y6eQFS1hbsYJlnpeheR3fomWDIEXDAmYCL9EucUeWb8sR2j?=
 =?us-ascii?Q?oFxxzijn29FOjIFxX4janpg3QH8hCkArd6sE/a0Yl2PDlL9xcGrGOOWsjajR?=
 =?us-ascii?Q?QlqsrhmyeQITqMjNbrzzTNpDp8kOawHhNyyrGeiMwTMle2lSElNpDEqVy+rA?=
 =?us-ascii?Q?w81pX//FzqnYBR7iMgTvRuS2xg0dXLH4V/lJKxb7Fp/Z8cM35yB8aSt5ViB9?=
 =?us-ascii?Q?ukeDK5oAtc8SzJlr492imzeqtwE60/PHsKlJJqzcci6jZa9W5YpaTNDTeZiZ?=
 =?us-ascii?Q?nvDD3o2O34ANakUWj8ZCQP7tap0OFyhJKprLUpRbJm59R5J3mXQvOr2mIAB+?=
 =?us-ascii?Q?k3ovvOgDXP2kbSEuzbwrbFn+z3x2j167S/LJOWn/Vn39wfeJeswnSa+z8sVh?=
 =?us-ascii?Q?x8iKvbCPR8n1DhmfX4xtiGMq5PfF3zophdYzl8C3sibJ/k6jW4Yhw3lNbPHz?=
 =?us-ascii?Q?Des9gPVOwaFEeSx9lvBogp03PKUfrWKomh9JS2WSwnGEAqzhUka255C5fsTj?=
 =?us-ascii?Q?mVY0qyPB59D8DaIXaagyoJ+mxnEv2aJEIVGhe/9wa2Fe978tk39AH5Sfhg92?=
 =?us-ascii?Q?FjIi/h89wnEc7JvDC8QVwuTjMFPghMuXMxPWZoSyRqg6GKq/XF7qZAaagOkf?=
 =?us-ascii?Q?EIOeBWwwjGsu3pZe3ORHuRpXs/2DlGur2iDYaURy26v+RcXbexv0Ge4m8ijo?=
 =?us-ascii?Q?OOxRBC4FNvbaK+Sar+kLWtiofKiFtlZJFBcYfNyuZKWKtJExbOlc7634HjaD?=
 =?us-ascii?Q?PxbsINzquMmOIZ3wQuMqwfNZ7rS3H21YZLdr3Y9GXvXglTVlebXCJZ6gGX+x?=
 =?us-ascii?Q?/3/ltSgGqm2cuoYs0utMCCXjlrjoJXCw3Z7HNx2N5Z3KOcsGZU1CpFDv8nhw?=
 =?us-ascii?Q?VoEg7wPLNHHf7CwBzBmX1fQZ0XJ6Ob/rA73MSgqR2VrnFUJ5b/d73B7upjln?=
 =?us-ascii?Q?7FbB9bIlCcW0RtJwbEz618yFxZvnmwmztYoJGJVHBMdfcJMKQBoVjbgxqKjT?=
 =?us-ascii?Q?E96xb5MmJjspLwb0ghUcDaQMejMeTGbAPle1YE4sgutPiYnp1pnS6LjQ/C0l?=
 =?us-ascii?Q?WIv7LSy0KeMuogBzWvFevRg4SbofbMPzGS2owlvHQI0U/mCA+AZqW3lHk+bP?=
 =?us-ascii?Q?gLwAx0BmnXfJ8kyAnuEuaq1MgJb2OAr1P6MYevT0IYqGZqjjDF/Xc1Dltati?=
 =?us-ascii?Q?57ZVBF/4NCfV97IjcIsuLZridM+dO6ZXaaniK5pzAvpCJIIe0it7RKPKSGVf?=
 =?us-ascii?Q?4sBl6C3jvcS11kZkPlpAiiuJ14WWVaNm4vbsTdtcb+617GBcyHKcRgPGgI+h?=
 =?us-ascii?Q?DTyvPqQ1DbaxcKF3mZN3DdeymzZ753zNmf3DMFcVdHT5b23VeXaJYIZshX77?=
 =?us-ascii?Q?D+oKr9ZtBsZXhtyvugBwHo2mj3q1chRRkyFY76D7JnS8E8VqEfzu3ppTRQUE?=
 =?us-ascii?Q?yxlBEA4bXXADPxTW2edCoJ0dWCdhwtiIaAGqt+k15MS7NQxUn5Uc0dFIwPOE?=
 =?us-ascii?Q?Nwm1a9NbzrWFqeca5LRD1X2EfKdAQTfUzLttxivivk5Rz7M56mAsnP7C1KD9?=
 =?us-ascii?Q?GuASw+WsMMSTmWPJ8r8sa9jvhRy5Ris4u3smxF1MrUu6kkbTxr4a1D6DcZD6?=
 =?us-ascii?Q?shTU/+CKsOv4+xbWrW6I9x8Nq9/W69s=3D?=
Content-Type: text/plain; charset="us-ascii"
Content-ID: <E20BBAA58CDA7E469367AA163DEC1596@namprd10.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN0PR10MB5128.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 451ef4bb-8853-4724-f798-08da43668097
X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Jun 2022 00:34:34.8889
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: y4A9LrCoHn0qRSgk7sI5KvahHy9PUzoiGWwG6Udo6lcHwIHSXi2qYS/9w2Js0vjEJOPFmtXLgvg6WzPDtKY0PQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN0PR10MB5191
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.517,18.0.874
 definitions=2022-05-31_08:2022-05-30,2022-05-31 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 bulkscore=0 suspectscore=0
 mlxlogscore=999 mlxscore=0 spamscore=0 adultscore=0 malwarescore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2204290000
 definitions=main-2205310105
X-Proofpoint-ORIG-GUID: I1JLdGZaqYfmWeszScKdLm9_Vuiv3xtc
X-Proofpoint-GUID: I1JLdGZaqYfmWeszScKdLm9_Vuiv3xtc
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,
        RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-nfs.vger.kernel.org>
X-Mailing-List: linux-nfs@vger.kernel.org


> On May 27, 2022, at 5:34 PM, Chuck Lever III <chuck.lever@oracle.com> wro=
te:
>=20
>=20
>=20
>> On May 27, 2022, at 4:37 PM, Frank van der Linden <fllinden@amazon.com> =
wrote:
>>=20
>> On Fri, May 27, 2022 at 06:59:47PM +0000, Chuck Lever III wrote:
>>>=20
>>>=20
>>> Hi Frank-
>>>=20
>>> Bruce recently reminded me about this issue. Is there a bugzilla somewh=
ere?
>>> Do you have a reproducer I can try?
>>=20
>> Hi Chuck,
>>=20
>> The easiest way to reproduce the issue is to run generic/531 over an
>> NFSv4 mount, using a system with a larger number of CPUs on the client
>> side (or just scaling the test up manually - it has a calculation based
>> on the number of CPUs).
>>=20
>> The test will take a long time to finish. I initially described the
>> details here:
>>=20
>> https://lore.kernel.org/linux-nfs/20200608192122.GA19171@dev-dsk-fllinde=
n-2c-c1893d73.us-west-2.amazon.com/
>>=20
>> Since then, it was also reported here:
>>=20
>> https://lore.kernel.org/all/20210531125948.2D37.409509F4@e16-tech.com/T/=
#m8c3e4173696e17a9d5903d2a619550f352314d20
>=20
> Thanks for the summary. So, there isn't a bugzilla tracking this
> issue? If not, please create one here:
>=20
>  https://bugzilla.linux-nfs.org/
>=20
> Then we don't have to keep asking for a repeat summary ;-)

I can easily reproduce this scenario in my lab. I've opened:

  https://bugzilla.linux-nfs.org/show_bug.cgi?id=3D386


--
Chuck Lever