Received-SPF: pass (google.com: domain of linux-nfs-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Chuck Lever III <chuck.lever@oracle.com>
To:     Neil Brown <neilb@suse.de>
CC:     Jeff Layton <jlayton@kernel.org>,
        Linux NFS Mailing List <linux-nfs@vger.kernel.org>
Subject: Re: [PATCH 0/8] NFSD: clean up locking.
Thread-Topic: [PATCH 0/8] NFSD: clean up locking.
Thread-Index: AQHYkO+nUhzdndZueEy9RTo7pT1nKa1xiSYAgAiEbACAAMTsgIAA7tMAgACi9ACAAmEZgIAAwNYA
Date:   Fri, 15 Jul 2022 14:06:13 +0000
Message-ID: <39D88652-8163-48A6-8A7E-950C209C1FB7@oracle.com>
References: <165708033167.1940.3364591321728458949.stgit@noble.brown>
 <3FF88D5A-9DBF-4115-A31C-6C6A888F272F@oracle.com>
 <165759318889.25184.8939985512802350340@noble.neil.brown.name>
 <3C945625-ED72-4CC1-9CC0-F354FEF0C2E4@oracle.com>
 <165768676476.25184.1334928545636067316@noble.neil.brown.name>
 <13CEFBB0-45FB-4051-8F69-B41DC40CBD52@oracle.com>
 <165785256143.25184.15897431161933266918@noble.neil.brown.name>
In-Reply-To: <165785256143.25184.15897431161933266918@noble.neil.brown.name>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?/Gacfawam5J/rQOiAuHJGQWy+Pql5BBEllfYfrFpcUI8Oc5CpFN3W4d1IsDa?=
 =?us-ascii?Q?UXzNd5WcaiIuCoD6hnwxZ2KJdlFHmyM/424JdFxuQTk+mBa2GBN5yAIeDQH5?=
 =?us-ascii?Q?clvke2YJg6a62yfwubMXYuod4cEIYU8hVf7L+2/Wk/6xoT3GORB5msnwQrsr?=
 =?us-ascii?Q?TJvCJU4ZUUVewB45nipYIO/WkMCE9V0zZQ1RJhr2M7XOYErMuA9phlk3lT4C?=
 =?us-ascii?Q?9/bRfC63056wHXZ4n3J3RZT9/sqgwoA5FY3/Me67cAssebo8UMCUvwwRLtwU?=
 =?us-ascii?Q?NSDUJZ7hPCv/oyRFndV0vUYdIiKbFFYmrhFRF5e6GIbCOpgFIvlQrRX1XP9C?=
 =?us-ascii?Q?h+y0GpX/f2AosTES1WF2IMGkUxd6EhwE+2b/9DuxzsZNLpy5NwT6DWSt/54B?=
 =?us-ascii?Q?BjQkHrpxnhDPFwqH/kRLxKU7zAoUC1TxIqTbqYaDHsCKyCgulmJUgPfJI114?=
 =?us-ascii?Q?I/GoHVNdruuNy904fl0dp/hsR5Dm6EXfFFPbcTnaZR15j5gxt2icszypRlmJ?=
 =?us-ascii?Q?RZZY8ZPN4Mwuzt0OtXmRMBEWHi9WOcxh9H4TVTboxEftXyYgunlyWFUtrPMP?=
 =?us-ascii?Q?bWGtxcu3f1fTsiurwHAIPOhdQGgJltBt3axIqA44m83v2YNC/+PudIeh6gnI?=
 =?us-ascii?Q?iwbq/912kWTu47BWd5zT3WqxT3Xa3GyM2IyOrt8YtWk56HsQco109Qdsr+7t?=
 =?us-ascii?Q?deLckNTFonz3SO7tWFei1lhnLm7q/zmBfX+82Dr1DXdJAMavculxzCbkrf6F?=
 =?us-ascii?Q?495hLFDaIeRuL8qU/cWlNmt6tRmL4pkVXcZIXqAl1CJ/DjMKf+PsMdbZtsW0?=
 =?us-ascii?Q?00OmZCD5fjL3ud12mykFnrnPenJUkBlXV8lDIhyWjIueFHElCpxxdShis0KB?=
 =?us-ascii?Q?R9ah17mvSXEXfrpKKpPukx10v3aZOI1HldC43tMvCDf9ZedIES/jISKPx/JH?=
 =?us-ascii?Q?Vycm7HTFLGFoldw21P4T27jWZemn2fwETDsznKfWk1S7Dgp/2O5hMJBjlxfb?=
 =?us-ascii?Q?hapIVV8XyAv8iB9aFMr277KNuhjmPvXnhRYzF1CBNa7w8IcNutEQcv2AK37u?=
 =?us-ascii?Q?zf60CynzgdPPWdrUZg3zgB+42kLyO24MDHJ8WBijEjY1jLU2hjUlniZEdwQq?=
 =?us-ascii?Q?ak9bpGaBg0Fj7zo8QXxMDe8avkHxZUdWiwRpu6WBGg7QVAC8IUxVtEtRahI6?=
 =?us-ascii?Q?StKlhaPyV9MFlF2/0WVnvVcAtYyW9HXp/u9CBC9COvcMpabzA/y05ulCMYE7?=
 =?us-ascii?Q?+1zghEkiynp9qsaKsLKibpzbUhpPEqBVnMl1rs0c4+l1suSdTy2RLt35cMLC?=
 =?us-ascii?Q?lL39WI1wXukWtxpQK3X7E+9aZwppiwKv1M3XDCLYm3DrVHZ4+hFZtRLqEMnj?=
 =?us-ascii?Q?TS0c6DHUMtl4xkwg1c1uX6mpcQpxG/fChlIpiPJXrllf1deYTJFGbBlwggIs?=
 =?us-ascii?Q?xHRHxvRlD3tcAj7WGFfKtXoQ6552Lmyc1cHh29gUylx+1AdaLMpT5Ag4oKzN?=
 =?us-ascii?Q?EtkIx9v2eMQNWXcCCX9MRZjdQ2QREJJwBADVMEggn2xgOvgS7VCdilf85oQa?=
 =?us-ascii?Q?fYDbOFvxnYynEfUo4LXJfB3yd4UlM1MJpqx8XTIdKbOGeeJDTUyTg+6tK27F?=
 =?us-ascii?Q?bw=3D=3D?=
Content-Type: text/plain; charset="us-ascii"
Content-ID: <07C172380C16E64D99C466C8E1F9BC02@namprd10.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: BN0PR10MB5128.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3b9b05f9-2bba-4072-eb78-08da666b2d78
X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Jul 2022 14:06:13.6154
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: WvVxTum7jB3R/GwuAqEB5/2oKVL46eZwwHVVsdnBymhflEywrVhrI1bSSPXGbV7DxffVNEYslmlz7OOmXKqsfg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR10MB3965
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.517,18.0.883
 definitions=2022-07-15_05:2022-07-14,2022-07-15 signatures=0
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 phishscore=0 mlxscore=0
 suspectscore=0 adultscore=0 spamscore=0 mlxlogscore=629 bulkscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2206140000
 definitions=main-2207150062
X-Proofpoint-GUID: o5cZp21aaCCDs7avYaCDM-jp6E7PFrUM
X-Proofpoint-ORIG-GUID: o5cZp21aaCCDs7avYaCDM-jp6E7PFrUM
X-Spam-Status: No, score=-2.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW,
        RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-nfs.vger.kernel.org>
X-Mailing-List: linux-nfs@vger.kernel.org


> On Jul 14, 2022, at 10:36 PM, NeilBrown <neilb@suse.de> wrote:
>=20
> On Thu, 14 Jul 2022, Chuck Lever III wrote:
>>=20
>>> On Jul 13, 2022, at 12:32 AM, NeilBrown <neilb@suse.de> wrote:
>>>=20
>>> On Wed, 13 Jul 2022, Chuck Lever III wrote:
>>=20
>>>>>> Secondarily, the series adds more bells and whistles to the generic
>>>>>> NFSD VFS APIs on behalf of NFSv4-specific requirements. In particula=
r:
>>>>>>=20
>>>>>> - ("NFSD: change nfsd_create() to unlock directory before returning.=
")
>>>>>> makes some big changes to nfsd_create(). But that helper itself
>>>>>> is pretty small. Seems like cleaner code would result if NFSv4
>>>>>> had its own version of nfsd_create() to deal with the post-change
>>>>>> cases.
>>>>>=20
>>>>> I would not like that approach. Duplicating code is rarely a good ide=
a.
>>>>=20
>>>> De-duplicating code /can/ be a good idea, but isn't always a good
>>>> idea. If the exceptional cases add a lot of logic, that can make the
>>>> de-duplicated code difficult to read and reason about, and it can
>>>> make it brittle, just as it does in this case. Modifications on
>>>> behalf of NFSv4 in this common piece of code is possibly hazardous
>>>> to NFSv3, and navigating around the exception logic makes it
>>>> difficult to understand and review.
>>>=20
>>> Are we looking at the same code?
>>> The sum total of extra code needed for v4 is:
>>> - two extra parameters:
>>> 	 void (*post_create)(struct svc_fh *fh, void *data),
>>> 	 void *data)
>>> - two lines of code:
>>> 	if (!err && post_create)
>>> 		post_create(resfhp, data);
>>>=20
>>> does that really make anything hard to follow?
>>=20
>> The synopsis of nfsd_create() is already pretty cluttered.
>=20
> Would it help to collect related details (name, type, attributes, acl,
> label) into a struct and pass a reference to that around?
> One awkwardness in my latest patch is that the acl and label are not set
> in nfsd_create_setattr().  If they were passed around together with the
> attributes, that would be a lot easier to achieve.

That kind of makes my point: using nfsd_create() for both classic
NFSv2/3 and the new NFSv4 hotness overloads the API.

But OK, you seem very set on this. So, let's construct a set
of parameters for a create operation and give the set a
sensible name. The "_args" suffix already has some meaning
and precedence in this code. How about "struct nfsd_create_info" ?


>> You're adding that extra code in nfsd_symlink() too IIRC? And,
>> this change adds a virtual function call (which has significant
>> overhead these days) for reasons of convenience rather than
>> necessity.
>=20
> "significant"?  In context of creation a file, I don't think one more
> virtual function call is all that significant?

If you consider how fast underlying storage has become, and how
fast it will become soon (eg, NVRAM-backed filesystems) then the
cost of a virtual function call becomes significant.

And note there is also control flow integrity. A virtual function
can be used to branch into malicious code unless we are careful
to lock it down correctly.

But these are details, and kind of miss my main point.


> I started writing code to avoid the function pointer, but the function
> args list exploded.  If you could be happy with e.g.  a struct
> nfs_create_args which contains attrs, acl, label, and was passed into
> nfsd_create_setattr(), then I think that would cleanly avoid the desire
> for a function pointer.

Note that my complaint was also about adding more logic in these
functions. It isn't much now, but having an "info struct" means
we can pass all kinds of junk into nfsd_create() and add lots
more exceptions to the code path.

Do you see why I really don't like this approach?


--
Chuck Lever