From:   Shay Drory <shayd@nvidia.com>
To:     "David S . Miller" <davem@davemloft.net>,
        Jakub Kicinski <kuba@kernel.org>
Cc:     jiri@nvidia.com, saeedm@nvidia.com, netdev@vger.kernel.org,
        linux-kernel@vger.kernel.org, Shay Drory <shayd@nvidia.com>,
        Moshe Shemesh <moshe@nvidia.com>
Subject: [PATCH net-next v4 2/7] devlink: Add new "io_eq_size" generic device param
Date:   Thu,  9 Dec 2021 12:09:24 +0200
Message-Id: <20211209100929.28115-3-shayd@nvidia.com>
In-Reply-To: <20211209100929.28115-1-shayd@nvidia.com>
References: <20211209100929.28115-1-shayd@nvidia.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?rC4qUpuZFyhXFn9Pw3B1B+aCiivcbatFzmY8G3olJDEmJkywDwLthsYJCxX8?=
 =?us-ascii?Q?sCrdglwCbTmOEVU3SJeLAcHmat2BBYICMSf5AHMIYVBe6yX0jAi0j1Bz4TA4?=
 =?us-ascii?Q?NBJiD0ci7ukGGdXHFCFkC83tJCNyKesLGlx9nhTFZPSLauRd7ZsE3vlRE+Br?=
 =?us-ascii?Q?Z6VaUYqi0YOwl1e67RrskcAof6J7eqixhsgUfCrdnY6M3naZzUS6FPtVUgYr?=
 =?us-ascii?Q?RiLrKHKPhAqAzkSfYrY9Jl3R+NTvIbQ0iEkr3cExo39pzmN8RNTnlTlwbRbn?=
 =?us-ascii?Q?f4onnv++8TrHKoVyt86x8j0cNFqJTqwNT4w0PMZZpQ5TSvfVFrFLfK8BM3D/?=
 =?us-ascii?Q?NIscmnfDRMCYXoZKkS4sa2zgtKbToREi89Hz+eF1F5daHNlN4uxBx5wt6eLc?=
 =?us-ascii?Q?xCDy8sRBF5WwRFt59BJEd8oO2G1GOBwMWtU0yLu3nwD4Vski8zmYR1Lb2EWF?=
 =?us-ascii?Q?AcOEk3papjT2crbA/MzVh2xjdaYIZDQczLJbrp/Kz9emDkRykmpFPx3EU9sG?=
 =?us-ascii?Q?PE3mBs3uOeQzVXX+G/EvzznWBZNdoU3gRKlqT1fof3u3V21DHzhPci41Ayuw?=
 =?us-ascii?Q?Q+3aX3rkgEV8FpzJQh5beamXQoDeDYNRmyjnbsr5Grv+j9S4L1XeE3CRq8WX?=
 =?us-ascii?Q?+3Y3ings3fzhZVBHVmQv28qaTDzK+NCrv3IDjSA8gK8OSlf9vI6F0ewAI59W?=
 =?us-ascii?Q?KwtcsxJlZTGQHRMC5zTHUuD08jzhX95sBDn3JL9/sV2kqW21t40pLnMkLC+i?=
 =?us-ascii?Q?wOXNQXX4ZuKKsnmncFCs3kYxBGC1lQEiKLiDlakQZDD7MHeqLtDdvA/OoV1J?=
 =?us-ascii?Q?owkB1Lk32T5Q2AEC/jS/KI3QzYGLQ9zd/Kw7LSnkgHpz3yNDS/8RE7EqdMTE?=
 =?us-ascii?Q?ENM5EDP/BmlUwKyGOgOGBP1bEpgie2rEVLcJI/mZ3iEqHFUQfkNQAMqRFQZv?=
 =?us-ascii?Q?tafcELqkgOsh8woYIR/LkYeEsWDjf+Xfm9CKzJ9iNQyeT1JTW3BcXB1uO+QN?=
 =?us-ascii?Q?rICKMHseQAwPimIoWyxNxALvEtfCqIJKg3BWcmpgVpRfQulvFH6tiaZEWEJr?=
 =?us-ascii?Q?H9teVpiAQadtl+MHvzFmQkAUHTY2qtA3BuCg9hFWrQXqfDrNj69mlY+to1nJ?=
 =?us-ascii?Q?NEyHkxIq9mc2Omcw2bp3KaLOZ8sSfny5MIenncv1es0r8wpriVROSzzlcedG?=
 =?us-ascii?Q?Fjuk9Hx8r1WKtlGtz5ROPFHmVIXiImudoWXSdtjplm/DxC7CTjTUFeHGPFDP?=
 =?us-ascii?Q?o0cjKWG5MH7FpePZbSsQHfp6LTT2WnWWm7IfwcFYnkaJGFb7qDhmF/ThwPGa?=
 =?us-ascii?Q?8buVOX0ZnkGkPS9anDZ9OX1xmtPShMp/jjOqh0ZHePbywKofJLwAeeZ/1Bqu?=
 =?us-ascii?Q?9AJ9Ss4BS7x1+sSMtSULmNj9lvFMpi2GtXGQiWf9CCqb3RfPv4/VcZyiF5fg?=
 =?us-ascii?Q?a3nDozkOO6zP6p9LLnIkEpwoG0CndtQer+kBfTZ7cqDdKO4JRWvZiDMRdQQG?=
 =?us-ascii?Q?1ZZZ1uPSai/SS8m6jnP1X10Bb0ztnft4MlegGYVr06tb808lkAFIIZEg+waS?=
 =?us-ascii?Q?Hkv2UvMnbMe0srcgttBlA0aQlLcI4J3ORYGvgg3iU4LhHrpWMOFn76o/WbGH?=
 =?us-ascii?Q?kTVXKJL52LyPJwDPu0xWNRc=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 412cdcca-8be2-41ad-204b-08d9bafc0dbb
X-MS-Exchange-CrossTenant-AuthSource: DM4PR12MB5373.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Dec 2021 10:09:57.6808
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: VytJVOTjHE0elYocKfthCURk0Bti+UJCNocnBsUKdgYzd9rluc+if0KUz85YsJAZjkvkg4EBFxAWBKWugsMwuw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB5311
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Add new device generic parameter to determine the size of the
I/O completion EQs.

For example, to reduce I/O EQ size to 64, execute:
$ devlink dev param set pci/0000:06:00.0 \
              name io_eq_size value 64 cmode driverinit
$ devlink dev reload pci/0000:06:00.0

Signed-off-by: Shay Drory <shayd@nvidia.com>
Reviewed-by: Moshe Shemesh <moshe@nvidia.com>
---
 Documentation/networking/devlink/devlink-params.rst | 3 +++
 include/net/devlink.h                               | 4 ++++
 net/core/devlink.c                                  | 5 +++++
 3 files changed, 12 insertions(+)

diff --git a/Documentation/networking/devlink/devlink-params.rst b/Documentation/networking/devlink/devlink-params.rst
index b7dfe693a332..547c0b430c9e 100644
--- a/Documentation/networking/devlink/devlink-params.rst
+++ b/Documentation/networking/devlink/devlink-params.rst
@@ -129,3 +129,6 @@ own name.
        will NACK any attempt of other host to reset the device. This parameter
        is useful for setups where a device is shared by different hosts, such
        as multi-host setup.
+   * - ``io_eq_size``
+     - u32
+     - Control the size of I/O completion EQs.
diff --git a/include/net/devlink.h b/include/net/devlink.h
index 3276a29f2b81..b5f4acd0e0cd 100644
--- a/include/net/devlink.h
+++ b/include/net/devlink.h
@@ -459,6 +459,7 @@ enum devlink_param_generic_id {
 	DEVLINK_PARAM_GENERIC_ID_ENABLE_RDMA,
 	DEVLINK_PARAM_GENERIC_ID_ENABLE_VNET,
 	DEVLINK_PARAM_GENERIC_ID_ENABLE_IWARP,
+	DEVLINK_PARAM_GENERIC_ID_IO_EQ_SIZE,
 
 	/* add new param generic ids above here*/
 	__DEVLINK_PARAM_GENERIC_ID_MAX,
@@ -511,6 +512,9 @@ enum devlink_param_generic_id {
 #define DEVLINK_PARAM_GENERIC_ENABLE_IWARP_NAME "enable_iwarp"
 #define DEVLINK_PARAM_GENERIC_ENABLE_IWARP_TYPE DEVLINK_PARAM_TYPE_BOOL
 
+#define DEVLINK_PARAM_GENERIC_IO_EQ_SIZE_NAME "io_eq_size"
+#define DEVLINK_PARAM_GENERIC_IO_EQ_SIZE_TYPE DEVLINK_PARAM_TYPE_U32
+
 #define DEVLINK_PARAM_GENERIC(_id, _cmodes, _get, _set, _validate)	\
 {									\
 	.id = DEVLINK_PARAM_GENERIC_ID_##_id,				\
diff --git a/net/core/devlink.c b/net/core/devlink.c
index db3b52110cf2..0d4e63d11585 100644
--- a/net/core/devlink.c
+++ b/net/core/devlink.c
@@ -4466,6 +4466,11 @@ static const struct devlink_param devlink_param_generic[] = {
 		.name = DEVLINK_PARAM_GENERIC_ENABLE_IWARP_NAME,
 		.type = DEVLINK_PARAM_GENERIC_ENABLE_IWARP_TYPE,
 	},
+	{
+		.id = DEVLINK_PARAM_GENERIC_ID_IO_EQ_SIZE,
+		.name = DEVLINK_PARAM_GENERIC_IO_EQ_SIZE_NAME,
+		.type = DEVLINK_PARAM_GENERIC_IO_EQ_SIZE_TYPE,
+	},
 };
 
 static int devlink_param_generic_verify(const struct devlink_param *param)
-- 
2.21.3