Received-SPF: pass (google.com: domain of linux-kernel+bounces-66969-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161;
Date: Thu, 15 Feb 2024 09:21:38 -0400
From: Jason Gunthorpe <jgg@nvidia.com>
To: Jakub Kicinski <kuba@kernel.org>
Cc: Christoph Hellwig <hch@infradead.org>,
	Saeed Mahameed <saeed@kernel.org>, Arnd Bergmann <arnd@arndb.de>,
	Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
	Leon Romanovsky <leonro@nvidia.com>, Jiri Pirko <jiri@nvidia.com>,
	Leonid Bloch <lbloch@nvidia.com>, Itay Avraham <itayavr@nvidia.com>,
	Saeed Mahameed <saeedm@nvidia.com>,
	David Ahern <dsahern@kernel.org>,
	Aron Silverton <aron.silverton@oracle.com>,
	andrew.gospodarek@broadcom.com, linux-kernel@vger.kernel.org,
	netdev@vger.kernel.org
Subject: Re: [PATCH V4 0/5] mlx5 ConnectX control misc driver
Message-ID: <20240215132138.GK1088888@nvidia.com>
References: <20240207072435.14182-1-saeed@kernel.org>
 <Zcx53N8lQjkpEu94@infradead.org>
 <20240214074832.713ca16a@kernel.org>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20240214074832.713ca16a@kernel.org>
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?us-ascii?Q?MvvysQZiDqyfoN0a40l/rVQFQNRgcLSBQbZdzupLTwpPc0xjiYZJKrXSuhGd?=
 =?us-ascii?Q?byl6n9+ZBHEzUAAPXONovf8tBrpuKJ+liozaZ5uihb/EethrPNjdAl4sdIKJ?=
 =?us-ascii?Q?to9sWfzQHF3+ivQZcP6oX3T8zLIUwIJeR81n5mGyOhoxbfdiNp8DW2HKqmUP?=
 =?us-ascii?Q?H5YzwhaeK7I7GOHz4Y6hom8ouaKvuO/+UlqILLxvYYxCMZu6GnFJbIxQtPOy?=
 =?us-ascii?Q?3hFVixXP7XZMYe2wcqSiyBM2y23lhthmM4/MdXnePbj+IAmAPvJb2JvRnJSB?=
 =?us-ascii?Q?WzOPNMKoVxuChsTUIjTD+E2K1q+7tA6lCKGExG81NW+PJ7XafVBvMGMFBNZJ?=
 =?us-ascii?Q?Ykn4pPXwhDilj7Wp8eIeJa0A0+ykBX4j/qvw9nJn9p8wXMTCvXTsqU7HlmvY?=
 =?us-ascii?Q?fnoB1MlzaQiS7v6IPrYHSafEj1CWRhdDGeg7KLYSdhjDWygOAjpOzS/w+QR4?=
 =?us-ascii?Q?RZ360ULFv/NWYhgWYTTWhjUWfXF+N7XX1suiLAwvlvLfDhkBQ0/KRmFzpOpC?=
 =?us-ascii?Q?6Zia/qHL+M3mgTxGxS5xp2L04adTln3GuUD2g+IE1bFauAqMTQeAbZV6AEsc?=
 =?us-ascii?Q?K5ldT1MHLWRQzXdNKfe2fSSKrQBfUdJjvfikbCAl3kkaLJAZ0HeeqStM3i2G?=
 =?us-ascii?Q?hy1A5TsPTzCAwgRz5obqf079XL0mLXzEpRzvTGEkYpRe4p375fBGK8MXEpGm?=
 =?us-ascii?Q?47dEwVpNPKBNrh8ExSyScLgHqGqu6l4chAfzXwqAZXs++BBc8AkdFY0QZEmX?=
 =?us-ascii?Q?JVgjp6P/et8io4jYXWdVvac2+zm6As/HFMLpWSCBuv3LEuQITdQLiGNOMRTs?=
 =?us-ascii?Q?nzqiT6W9Fpu93MZ3vCi89kc2ZfvI3niPwyIhgUrZtebQcs39QI3VbwtOXD0I?=
 =?us-ascii?Q?f4c5bEN42ucg5ypf3ncpgYlZl0eaTWRVedWmq4mAYO++9uDrpluj4PB8/vvd?=
 =?us-ascii?Q?Wn2uWZZH2ndGJcHQQND6Se4B8mIOFZdjwQ5vDLHlVLeoKWWkBoz76N3PrM4Q?=
 =?us-ascii?Q?udg8lchmRoXH7FoWWvrM8Yhsg8tPHnJBLmWIXTVQcvByX9Bud8njq5YC2Zzn?=
 =?us-ascii?Q?du4hENtXyDlnsWsLgRN9sz5D54dFBUBcoJ3j4TdfML9RMiVuVNFMn39YJfg6?=
 =?us-ascii?Q?6PEXdD3RRpVo2LV8Sc2aYLhWrNKtgBAnLNFlAhfJaBN04Otq10+JvEvk6mYl?=
 =?us-ascii?Q?ayxV9oIDSKRs3KKHkvxWy3eICyjUkQfKQlw6E7RNzosRWGnSiTT/QrjjkSLc?=
 =?us-ascii?Q?PhNdfcoysf24gl0SBHvV7dtTu54GTXUxLklJuJ5ZQchLHyuWA/DMjnrdOflk?=
 =?us-ascii?Q?AW4qqPBp+3IJV7wfqw8vXiCBqYFOTNXAg7Wb9TKzozeSPyNY55NSEuETKx9j?=
 =?us-ascii?Q?2/msCsBl9Q2gxE0fyurkj+fR7rSwNFnxmR5NCA8rbmvkzd/+P8NrziJeMye4?=
 =?us-ascii?Q?QC1T7G+svrJWIHVF1cSSY9iww9fMjhWnwbviFWhj3qJXrRo6aIvHSP8wf7JI?=
 =?us-ascii?Q?1L1Vvl99WP61m46yteCqW+aSz/UHKQgvioLlfgAyLTTfL74CeJgrmKgA1Kj3?=
 =?us-ascii?Q?0yHbgVrSJyAzuFMVh0U=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 154f9bcf-bd83-4506-3f23-08dc2e290b8c
X-MS-Exchange-CrossTenant-AuthSource: LV2PR12MB5869.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Feb 2024 13:21:40.5241
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: hs7jX5lFC/WymGmWZGTXYgJPAF0E1o9OjnY8LDsaImHHtZHUlksVpLUylfllwnuS
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY5PR12MB6622

On Wed, Feb 14, 2024 at 07:48:32AM -0800, Jakub Kicinski wrote:
> On Wed, 14 Feb 2024 00:29:16 -0800 Christoph Hellwig wrote:
> > With my busy kernel contributor head on I have to voice my
> > dissatisfaction with the subsystem maintainer overreach that's causing
> > the troubles here. 
> 
> Overreach is unfortunate, I'd love to say "please do merge it as part 
> of RDMA". You probably don't trust my opinion but Jason admitted himself
> this is primarily for RDMA.

"admitted"? You make it sound like a crime. I've been very clear on
this need from the RDMA community since the first posting.

> The problem is that some RDMA stuff is built really closely on TCP,

Huh? Since when? Are you talking about soft-iwarp? That is a reasearch
project and Bernard is very responsive, if you have issues ask him and
he will help.

Otherwise the actual HW devices are not entangled with netdev TCP, the
few iWarp devices have their own TCP implementation, in accordance
with what the IETF standardized.

> and given Jason's and co. inability to understand that good fences
> make good neighbors it will soon start getting into the netdev stack :|

I seem to recall you saying RDMA shouldn't call any netdev APIs at
all. We were unable to agree on where to build the fence for this
reason.

> Ah, and I presume they may also want it for their DOCA products. 
> So 80% RDMA, 15% DOCA, 5% the rest is my guess.

I don't know all details about DOCA, but what I know about runs over
RDMA.

> Not sure what you mean by "without lots of precedence" but you can ask
> around netdev. We have nacked such interfaces multiple times.
> The best proof the rule exists and is well established it is that Saeed
> has himself asked us a number of times to lift it.
> 
> What should be expected of us is fairness and not engaging in politics.
> We have a clear rule against opaque user space to FW interfaces,
> and I don't see how we could enforce that fairly for pure Ethernet
> devices if big vendors get to do whatever they want.

If your community is telling your rules are not working for them
anymore, it is not nice to tell them that rules exist and cannot be
questioned. Try working together toward a reasonable consensus
solution.

The world has changed alot, the use cases are different, the users are
different, the devices are different. When Dave made that prohibition
long ago it was not in a world of a multi billion transistor NIC being
deployed in uniform clusters of unimaginable size.

Jason