Received: by 2002:a05:7412:1e0b:b0:fc:a2b0:25d7 with SMTP id kr11csp817485rdb; Thu, 15 Feb 2024 17:10:42 -0800 (PST) X-Forwarded-Encrypted: i=3; AJvYcCU12yGBdDtKhBhaA6dBERUFwXNQJWlsGdiJgXbyFKZHBisxMOsBwe8WBu6V23rLoEZjOy9j9BzAlEd7XocW+wICpBp7GlE0YCV3YgQ0ig== X-Google-Smtp-Source: AGHT+IEaUPoeLlum4Q1CJuIiWgEOrFGG++HK/ZyjJwirvWBmnip6/xY5sKj7OyBYoKgkivLT/NFt X-Received: by 2002:a05:620a:e8f:b0:785:d9e3:bc2d with SMTP id w15-20020a05620a0e8f00b00785d9e3bc2dmr3498752qkm.30.1708045842619; Thu, 15 Feb 2024 17:10:42 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1708045842; cv=pass; d=google.com; s=arc-20160816; b=dzxm01OXSIYDOuELgqDBMTSZyuKxr93RVULqwZTgwGdYspd4rshMUwu8M2RwkDBNnW yiQmciiKoAqGPn15TJRuWqMsIvigHumwoH+V/EK8AwpNfH3ApETsB5r37kuuOKytP0ui 2K2v8jLX9v5nD7MlX+wqx3P2WL3mUiDoJ+gHOlnQp4OHfY/KxsT9fMK3+w9tdl4Nmx3Q woIowfwBlrKs88Epp5N1lqsDuTlRqU0kbjWQCXDAddZAMGkjnuoywzFtJTLbvO1nR6Iy XRVDCJtwWbUCeL+YHVYEL1DF75fIOsAO3wBi9s9V3BAN7UHw/L4iRjTLNXHA+gWJJUBn YcpA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :subject:cc:to:from:date:dkim-signature; bh=Nzw4GixvcVyyB9TraLuct7jjT0/I9sxTWvN7XYyx8kk=; fh=GjjgLK6zp6c2Fg4/CaU0G4QB25v/JhN4jqvquGJPKB8=; b=aboZ70eX/pKFrkTAIYoOaDLydsqUuBQxn+X+wz47koDGwWPXuKCuTkFM9flBhn/h8m WsFr4w0QMC8Z7UnYtBE+U+VdSVd5zIGV+GseDaaP0nIeGS/dPSB+8I2lLfpyD1zf/gBq 2K+K5KcHcLI44mT8HSwgJhwcxUQZn/7TFEaE/X3scCfr0dUBg5WcSROqWETT/7cR37eR 9yN/xEY7/qVn8si/8pDkpJ2zudcmrRvH20BqZTOClVMTqnUUYkKG77dFOpB3eafackoh DUrOHhNM0eBOmqou8YswTqHdX/pPuAE2MB2aF26Nh6dnwc2P0mppVM4qS62YnDhb+bwP sMlQ==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=BCqteF2K; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-67927-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-67927-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [2604:1380:45d1:ec00::1]) by mx.google.com with ESMTPS id f10-20020a05620a15aa00b007871951e0bfsi2981600qkk.451.2024.02.15.17.10.42 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 15 Feb 2024 17:10:42 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-67927-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=BCqteF2K; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-67927-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) smtp.mailfrom="linux-kernel+bounces-67927-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 157A61C20B7A for ; Fri, 16 Feb 2024 01:10:35 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 9A50BDDC6; Fri, 16 Feb 2024 01:00:49 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="BCqteF2K" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id BB16E8F55; Fri, 16 Feb 2024 01:00:48 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1708045248; cv=none; b=T35SKdWDwGM7rrhW5yASyNWn57YZqrQBj1dYPVIxXrvBnSn5LoAn2tyXrKRSgU6ombTqz8ClRN1neCe5Gs2pyfJvZAY7M8Mj5/MXzQM6SIe2we6f5KW9IsDyqnSCy88EbEiWjRg330L1n3MTSNLmz3WMvfz748/5B8uMHtQgP1s= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1708045248; c=relaxed/simple; bh=+dDgnU3ZkrjHe2f8ANYZEXxyh3W3/N5+qFKaHROFQjU=; h=Date:From:To:Cc:Subject:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=hR6tp7xY4lLeceN5QlLarKBHN0uY/dmNszCK3QwOQD0TnuTgnQhl/Q/duhuOwcop6XRFZxkxoV1++h5MVqq9GUQ5g0NWIhAZJQkc3SRc6WHTRT3a5bVTCU1WBBiCm8NU+qAlewW8ghXiGHaFedNP8SZg3q1tMLE+O126r+gQti4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=BCqteF2K; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 693EEC433F1; Fri, 16 Feb 2024 01:00:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1708045248; bh=+dDgnU3ZkrjHe2f8ANYZEXxyh3W3/N5+qFKaHROFQjU=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=BCqteF2KZkBD/XMzhKjjbxKUtvLqdkGNuCWI6A6kWgqy+syTndaIHpsbIhS4pxbAp UmMEkDDCao9xjdSYkDm918Pe9jerH5dLqNeZecLL9epIYcUVa2Wh9XaqOa8Q0wJChH LyNbx57nXbkJWKvWX9aYrj3gMnnlnsHnwYGzv5Hs1lHC49ajycJ38Fk/pwZJZJ3uNY WmSIxelgEKaoYY8p2UUD2trduuEQ49XwsN6zBKl6fh3Nr785Q8CQEGszFEn2+UTMJc z4vwAs/mm5M+FkBxUtOsZ+CB8h99b4zHz5aX7TXxka3YG+Msx94e84uU2yTu2fVxgY yVC2AwsLICM9g== Date: Thu, 15 Feb 2024 17:00:46 -0800 From: Jakub Kicinski To: Christoph Hellwig Cc: Saeed Mahameed , Arnd Bergmann , Greg Kroah-Hartman , Leon Romanovsky , Jason Gunthorpe , Jiri Pirko , Leonid Bloch , Itay Avraham , Saeed Mahameed , David Ahern , Aron Silverton , andrew.gospodarek@broadcom.com, linux-kernel@vger.kernel.org, netdev@vger.kernel.org Subject: Re: [PATCH V4 0/5] mlx5 ConnectX control misc driver Message-ID: <20240215170046.58d565ef@kernel.org> In-Reply-To: References: <20240207072435.14182-1-saeed@kernel.org> <20240214074832.713ca16a@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit On Wed, 14 Feb 2024 23:00:40 -0800 Christoph Hellwig wrote: > On Wed, Feb 14, 2024 at 07:48:32AM -0800, Jakub Kicinski wrote: > > Overreach is unfortunate, I'd love to say "please do merge it as part > > of RDMA". You probably don't trust my opinion but Jason admitted himself > > this is primarily for RDMA. RDMA is what it is in terms of openness and > > all vendors trying to sell their secret magic sauce. > > Common. RDMA has two important open standards, one of them even done > in IETF that most open of all standards organizations. While I don't dispute that there are standards which can be read, the practical interoperability of RDMA devices is extremely low. By practical I mean having two devices from different vendors achieve any reasonable performance talking to each other. Even two devices from _the same_ vendor but different generations are unlikely to perform. Given how RDMA is deployed (uniform, greenfield/full replacement) this is entirely reasonable from the engineering perspective. But this is a bit of a vicious cycle, vendors have little incentive to interoperate, and primarily focus on adding secret sauce outside of the standard. In fact you're lucky if the vendor didn't bake some extension which requires custom switches into the NICs :( Compare that to WiFi, which is a level of standardization netdev folks are more accustomed to. You can connect a new device from vendor X to a 10 year old AP from vendor Y and it will run with high perf. Unfortunately because of the AI craze I have some experience with RDMA deployments now. Perhaps you have more, perhaps your experience differs.