Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Shay Drory <shayd@nvidia.com>
To:     "David S . Miller" <davem@davemloft.net>,
        Jakub Kicinski <kuba@kernel.org>
Cc:     jiri@nvidia.com, saeedm@nvidia.com, parav@nvidia.com,
        netdev@vger.kernel.org, linux-kernel@vger.kernel.org,
        Shay Drory <shayd@nvidia.com>
Subject: [PATCH net-next 3/4] devlink: Add new cpu_affinity generic device param
Date:   Tue, 22 Feb 2022 12:58:11 +0200
Message-Id: <20220222105812.18668-4-shayd@nvidia.com>
In-Reply-To: <20220222105812.18668-1-shayd@nvidia.com>
References: <20220222105812.18668-1-shayd@nvidia.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?yveZrskN/+0RUoMk5xuCYWXnd+au2inFixjW9muoGYZQ3qKycB+VQ8mnnWGV?=
 =?us-ascii?Q?tw9neWD3l7JcRSbng/efAlxY7g/ud440CX2iiYV0+0ZsyFvq4JWyln+x8cwz?=
 =?us-ascii?Q?FqFBAykph996hmPzg7Kfqje5sAhCayLPg/NJJIXQknr1gH3s+UsFWYAqRI5+?=
 =?us-ascii?Q?/OHpctyZueQn91JnoCTBmi3GNhWDzgPFTkhz5C8+9IQME7s02SimpwfJ4zhp?=
 =?us-ascii?Q?po+t1leglzTRfxuyWJTkns8QKFzcIelW11T5GxGqhhSjHJvxHWgTXOHlNq1V?=
 =?us-ascii?Q?NmC4E4ORvECCewOhNx6WzNqSYBrxiciZG0GgzTN2oLVYbqKN5DcEbBl4J0fa?=
 =?us-ascii?Q?jzE+wCuvfn9YgaiG9170ZQfNQJJFCWNfywZ1BnGklVhPTrMC4HHSyNulTvaY?=
 =?us-ascii?Q?EKsScHP2cOZkao2yoQU4Ey/aJoAflfBEfc3mgxI8IDs/onSAdoTCnSDPx7dM?=
 =?us-ascii?Q?LPo1k2RSAoTF31XBSVhigelhRdmo9CnHGd7rkRFMPZlBUdn5oP50t77NUC8P?=
 =?us-ascii?Q?NokmV1QjdvQRMHtP8I5/rB/eSne5AzwiKZCspe1kum/7KPOURJYlecW31j1q?=
 =?us-ascii?Q?ywBTJWn5pNCY8ulL/v4CKgYUf3IJP+0nE21P9NssPVfbgv8Tz9QrJH0+ekZx?=
 =?us-ascii?Q?lRSjYe/SiL8jcXDFy19zZu4nZLjQgy4YneS2awi2zxKY5odoGmkXHZdcdnJX?=
 =?us-ascii?Q?HJHQN7YMkAybuNhZpoS0Tns+h+BFDCK/I89Vl1qgAcADgPCftrG1MFJebkaO?=
 =?us-ascii?Q?1TVU3sEBLGjQaQDW9cgIFJ3W3pEqGkEee8F78vZ2d4dgIbKxAnf5croLeI7Q?=
 =?us-ascii?Q?T7msxOlzgWsP3LWf733L1cKAJ5RGoQ5tSfMBGrIPHw3W07Jb6rW9ErHNMFvn?=
 =?us-ascii?Q?Vk+d+yQflQZeNAiLxjJALAnDcj6rf34XOUy2UtYxH14WW+1yVpR6UYN5xPl3?=
 =?us-ascii?Q?Wsq8C2K/jZMjbPPw147rPMk4c0LVxfPlexjxdEyeEodFLYsuAW+8/j/BcZNl?=
 =?us-ascii?Q?MGWYqvpX+o4PaF6+gAJ/1EZCV7S7rZ6Ds+EBPRhMenxDB2oHdtIHoSUKC5b/?=
 =?us-ascii?Q?bXkz8OGjfD2Ykgawe/ZZeMiUK7jUwexLvykuUivUUQAudejRK2ktzxaf/xTW?=
 =?us-ascii?Q?s+Zw3LUow2R3W+yfFMcGzRkdBL8Ng8csHsLmmx3whkEXKtVet4I4W5jo+6sI?=
 =?us-ascii?Q?vQwE5t+DPOACZDEOo3W+TEStvRXEtpcV5mDVJcT7XVeHdS6RtNCQhu9csoGV?=
 =?us-ascii?Q?IrFkLZ+5n8d7Pl5Ux1ha7+qcwZ5IPuuS0wQXT+gwL8U0WJwLYyQjlntKv9su?=
 =?us-ascii?Q?Ub6Aw8zNQQ4Gz0WWGlqCvLpeqSciRVTf2O5XWkqCiVKSJGfFkJ6v2U0apvi2?=
 =?us-ascii?Q?G+BWYc8LL7Tvo69liGHH7y3dLmvzBwB2SdcAcJe9xccPlG5+ychMjWq9yYkj?=
 =?us-ascii?Q?JNDEtzgSillmthTfTFTAO5mEcpyEwC/IhjdmYvuZoQFAvdLsZOxVDBATAuBm?=
 =?us-ascii?Q?EtVhWfp3SUR/WryVxFjPfPxiF3oCQrDPdlKtptiuJJ/oSnHxHgDSBf7HoUB3?=
 =?us-ascii?Q?b/cGMdQ6zsWajwHTk9WPn0R2/rNbL4jmCQqkvwxsN1YIP7MfKR0ChDuSEGln?=
 =?us-ascii?Q?Kp3etB32nQAolLTWcNiz2DA=3D?=
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: e1db2b02-12c7-49f4-c72b-08d9f5f38c2a
X-MS-Exchange-CrossTenant-AuthSource: MWHPR12MB1310.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Feb 2022 11:07:42.9138
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: WQnutLVm59t42NhKh4s0c9So2UUJIoNU37BxKuO9dCaiBmr8fUKX3DQ1IkIYzxSxQ25Y8xBvjiME+uqpQhQFcw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB5552
X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE,
        T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Add new device generic parameter to configure device affinity.

A user who wishes to customize the affinity of the device can do it
using below example.

$ devlink dev param set auxiliary/mlx5_core.sf.4 name cpu_affinity \
              value [cpu_bitmask] cmode driverinit
$ devlink dev reload pci/0000:06:00.0

At this point devlink instance will use the customize affinity.

Signed-off-by: Shay Drory <shayd@nvidia.com>
---
 Documentation/networking/devlink/devlink-params.rst | 5 +++++
 include/net/devlink.h                               | 4 ++++
 net/core/devlink.c                                  | 5 +++++
 3 files changed, 14 insertions(+)

diff --git a/Documentation/networking/devlink/devlink-params.rst b/Documentation/networking/devlink/devlink-params.rst
index 4e01dc32bc08..2f9f5baf4373 100644
--- a/Documentation/networking/devlink/devlink-params.rst
+++ b/Documentation/networking/devlink/devlink-params.rst
@@ -137,3 +137,8 @@ own name.
    * - ``event_eq_size``
      - u32
      - Control the size of asynchronous control events EQ.
+   * - ``cpu_affinity``
+     - Bitfield
+     - control the cpu affinity of the device. user is able to change cpu
+       affinity also via procfs interface (/proc/irq/\*/smp_affinity). This will
+       overwrite the devlink setting.
diff --git a/include/net/devlink.h b/include/net/devlink.h
index f411482f716d..595a4d54a2bd 100644
--- a/include/net/devlink.h
+++ b/include/net/devlink.h
@@ -466,6 +466,7 @@ enum devlink_param_generic_id {
 	DEVLINK_PARAM_GENERIC_ID_ENABLE_IWARP,
 	DEVLINK_PARAM_GENERIC_ID_IO_EQ_SIZE,
 	DEVLINK_PARAM_GENERIC_ID_EVENT_EQ_SIZE,
+	DEVLINK_PARAM_GENERIC_ID_CPU_AFFINITY,
 
 	/* add new param generic ids above here*/
 	__DEVLINK_PARAM_GENERIC_ID_MAX,
@@ -524,6 +525,9 @@ enum devlink_param_generic_id {
 #define DEVLINK_PARAM_GENERIC_EVENT_EQ_SIZE_NAME "event_eq_size"
 #define DEVLINK_PARAM_GENERIC_EVENT_EQ_SIZE_TYPE DEVLINK_PARAM_TYPE_U32
 
+#define DEVLINK_PARAM_GENERIC_CPU_AFFINITY_NAME "cpu_affinity"
+#define DEVLINK_PARAM_GENERIC_CPU_AFFINITY_TYPE DEVLINK_PARAM_TYPE_BITFIELD
+
 #define DEVLINK_PARAM_GENERIC(_id, _cmodes, _get, _set, _validate)	\
 {									\
 	.id = DEVLINK_PARAM_GENERIC_ID_##_id,				\
diff --git a/net/core/devlink.c b/net/core/devlink.c
index 3d7e27abc487..d2dfd9a88eb1 100644
--- a/net/core/devlink.c
+++ b/net/core/devlink.c
@@ -4477,6 +4477,11 @@ static const struct devlink_param devlink_param_generic[] = {
 		.name = DEVLINK_PARAM_GENERIC_EVENT_EQ_SIZE_NAME,
 		.type = DEVLINK_PARAM_GENERIC_EVENT_EQ_SIZE_TYPE,
 	},
+	{
+		.id = DEVLINK_PARAM_GENERIC_ID_CPU_AFFINITY,
+		.name = DEVLINK_PARAM_GENERIC_CPU_AFFINITY_NAME,
+		.type = DEVLINK_PARAM_GENERIC_CPU_AFFINITY_TYPE,
+	},
 };
 
 static int devlink_param_generic_verify(const struct devlink_param *param)
-- 
2.21.3