Received-SPF: pass (google.com: domain of linux-kernel+bounces-66194-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99;
Date: Wed, 14 Feb 2024 20:46:21 -0400
From: Jason Gunthorpe <jgg@nvidia.com>
To: David Ahern <dsahern@kernel.org>
Cc: Jakub Kicinski <kuba@kernel.org>,
	Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
	Saeed Mahameed <saeed@kernel.org>, Arnd Bergmann <arnd@arndb.de>,
	Leon Romanovsky <leonro@nvidia.com>, Jiri Pirko <jiri@nvidia.com>,
	Leonid Bloch <lbloch@nvidia.com>, Itay Avraham <itayavr@nvidia.com>,
	Saeed Mahameed <saeedm@nvidia.com>,
	Aron Silverton <aron.silverton@oracle.com>,
	Christoph Hellwig <hch@infradead.org>,
	andrew.gospodarek@broadcom.com, linux-kernel@vger.kernel.org,
	netdev@vger.kernel.org
Subject: Re: [PATCH V4 0/5] mlx5 ConnectX control misc driver
Message-ID: <20240215004621.GJ1088888@nvidia.com>
References: <20240207072435.14182-1-saeed@kernel.org>
 <20240207070342.21ad3e51@kernel.org>
 <ZcRgp76yWcDfEbMy@x130>
 <20240208181555.22d35b61@kernel.org>
 <2bdc5510-801a-4601-87a3-56eb941d661a@kernel.org>
 <20240209145828.30e1d000@kernel.org>
 <df5d7538-52c6-465c-b250-13532b90c6ae@kernel.org>
 <0daa6f37-8c50-4051-873a-4e8cd4e6cc58@kernel.org>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <0daa6f37-8c50-4051-873a-4e8cd4e6cc58@kernel.org>
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?us-ascii?Q?X+FSgSHdUZrTJ5AljF4PO7G7HzmOLNf0QetBQNLCVT+xoyg0NDSZJOIYedA6?=
 =?us-ascii?Q?yYGp8wvab0MTPUrxhJXfZjd00fj2PPhyy05z2kRB/guTTvoTgC3mXXymoSjm?=
 =?us-ascii?Q?rIGMDNx/KJcInCfrdbJuKu8ZNiOeIJxXqNCCiJzVfKHwogudm4/4k5B+nDNC?=
 =?us-ascii?Q?H3cNtbGW20y9BZEqEapNNH2WmpQMdNrsXPQ/6tulvnZsjqScae2yboTswuUU?=
 =?us-ascii?Q?juot1kd/aGATb+uo6AuQWigQIq8gT4A4dfSiGmrq1gzZwLxPiu+GokgJoo5K?=
 =?us-ascii?Q?yWVEFrtcxMixS/E+wttTAYo/vfgHv6rhA/UaZtTFLImNFpQ4HexFe82xapuR?=
 =?us-ascii?Q?6J/CI//r6VVOwnL5xpSrZ3NUvKB/ypa4fc9I+ZH/DgHAKYHypbCYIuOWogoX?=
 =?us-ascii?Q?JUBgkr4wTOv4hjRv0l8Ujnp3Yy+Q01rx9GgeQlkdBKWlIERJHx+sV0crbK7t?=
 =?us-ascii?Q?lbDsNC2kklCbYaOHJrshFaUMg4GgQDP+FT5a9jtpY5esukAT8233sRVj8/4E?=
 =?us-ascii?Q?MtNJr7K38pYi4m2HiTJpan6QrrhkYX2SASpWsk6F9RlsA8iZvEL5Pil0/34l?=
 =?us-ascii?Q?q19ZF6gdxV6II5sXHhSSRB2a6W2We8yxPjxVGrpmbj8VLUcjq8IbKbES6ljj?=
 =?us-ascii?Q?bZq2HPPKwftSpgBktzS6JoXhK4HExsqe51u947kl1bY1NXzg+YYLgMWFdgrs?=
 =?us-ascii?Q?qdUkj76STl6u12nmxYQeaXKiJpczZACVjtICZQEIXQclillj969Efh3/2bZQ?=
 =?us-ascii?Q?YuWCewl5PY1qUJnWVpepacdVpwQlHuN8f217AlhSCQA+gyYCUlRcPm+3ZHn+?=
 =?us-ascii?Q?vPs1IN3unB3zMFdyZWwmtBipzhJHs8wfnrr7w84cLyCk7GJ81NAvxM0uepFM?=
 =?us-ascii?Q?NTpYjQLllD8nyqRV/xX0FTd1fSStJOBk5BS0sqhsVc6FzQPEXqyt4IyCaqSS?=
 =?us-ascii?Q?dR6WiCfJp9hzZ2FwW8WfGm2VPshybxNHJvOCaCViMhpy8XW8L+QtD/viTcH1?=
 =?us-ascii?Q?mGR8CV3Sike10pcd1mrIgpu8mHfSCnUk4h/mBSQ1nnR7x1Bk5ZhC9lOaNWXt?=
 =?us-ascii?Q?DYJ/GHpd+PIVe3XZISEk496fTUuAqCpfSxLakfvc8a05+UDhR647idN0BMwI?=
 =?us-ascii?Q?lglSK8I76T0jjLA4FdVW/5k+VGm/nlYRKuJ0zTe9WkFhdeMptsa5taJ8S0CI?=
 =?us-ascii?Q?Uo69ItvTGST5xvHARwJmDnYWXPaYpPMx7aNqcSgj/S2RlpMzAruH0XIupqB4?=
 =?us-ascii?Q?KoZPx5VFYqxWEirRbqGLV0XB8pwYnKicP0zDNg6nozPAbKAgWs/9ZC4rNJwO?=
 =?us-ascii?Q?stR3QAscmUBg115bIGuSUZ0ubVOhE4B7Z57pgJacQd4AW2ZlsDcxm49xWuN/?=
 =?us-ascii?Q?dUlZEQCM75unfmC48NHrM48JDXs9rZTJ1PaYyCR2RzsOa1lHX3aZzo2s9JR3?=
 =?us-ascii?Q?innbMkRJ3k/uzbc0kMStDAU3dwgMMygzB1r7fjZkfvKuyVxVybTvoFAcoKy+?=
 =?us-ascii?Q?T2H4O9ds6+Ixj9ycWQ1Cn8tMDI+r8bfboZA6C4dbGmGn+1Hq9ago6pyYp6IO?=
 =?us-ascii?Q?QC5vSIpkGso3WEnylCo=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: afc72857-4a19-4114-33fe-08dc2dbf882c
X-MS-Exchange-CrossTenant-AuthSource: LV2PR12MB5869.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Feb 2024 00:46:22.7768
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 11ijVVXViIIPHSDNCIObyP/a/6XKrQJzw2t7u4TawPukSTxZs0cK2ysMYeqiYSW+
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR12MB5434

On Wed, Feb 14, 2024 at 01:31:29PM -0700, David Ahern wrote:
> On 2/9/24 10:01 PM, David Ahern wrote:
> > Maybe my bigger question is should drivers that can do different
> > physical layers, or can operate without a netdev, should they be split
> > into different drivers? drivers/misc for the PCI interface, drivers/net
> > for ethernet interfaces and its APIs and drivers/infiniband for IB and
> > its APIs? Generic capabilities like this debugging interface belong to
> > the PCI device since it is generic to the device hence drivers/misc.
> > 
> 
> I do not recall seeing a response to this line of questions. We are
> considering splitting our driver along these lines to upstream it given
> the independent nature of the capabilities and need to interact with
> different S/W APIs and hence different maintainers. Any reason new
> drivers should not be split along these lines?

I think it is essential to split them up like this, it is why auxbus
was created in the first place. The subsystem specific logic should
live in the subsystem space.

I've had some conversations where we have disagreements about which
functions end up in which directories in these split up drivers, but
the general principle is good.

I like mlx5's split where the core is about booting and communicating
with the FW and some common helpers then every subsystem has its own
FW calls in its own functions. Other people liked the idea that as
much "low level" code was in the core and the subsystems would call
helper functions in the core that invoke the FW functions.

> If the answer is no, then where is the best home for the PCI device
> driver piece of it? drivers/misc or drivers/accel or create a new
> drivers/multifcn/?

I've had conversations about this too, I would vote for a new
directory going forward. drivers/auxbus or something specifically for
these core components of an auxbus based multi-subsystem driver.

We likely need some reasonable rules so that the core driver remains
an in-kernel component and doesn't start growing weird uapi. If you
want uapi it needs to come through an appropriate subsystem specific
thing, even if that is misc.

Jason