From:   Vladimir Oltean <vladimir.oltean@nxp.com>
To:     netdev@vger.kernel.org
Cc:     "David S. Miller" <davem@davemloft.net>,
        Eric Dumazet <edumazet@google.com>,
        Jakub Kicinski <kuba@kernel.org>,
        Paolo Abeni <pabeni@redhat.com>,
        Jamal Hadi Salim <jhs@mojatatu.com>,
        Cong Wang <xiyou.wangcong@gmail.com>,
        Jiri Pirko <jiri@resnulli.us>,
        Vinicius Costa Gomes <vinicius.gomes@intel.com>,
        Kurt Kanzenbach <kurt@linutronix.de>,
        Gerhard Engleder <gerhard@engleder-embedded.com>,
        Amritha Nambiar <amritha.nambiar@intel.com>,
        Claudiu Manoil <claudiu.manoil@nxp.com>,
        Alexandre Belloni <alexandre.belloni@bootlin.com>,
        UNGLinuxDriver@microchip.com, Andrew Lunn <andrew@lunn.ch>,
        Florian Fainelli <f.fainelli@gmail.com>,
        Ferenc Fejes <ferenc.fejes@ericsson.com>,
        Xiaoliang Yang <xiaoliang.yang_1@nxp.com>,
        linux-kernel@vger.kernel.org
Subject: [PATCH net-next 12/12] net: enetc: add support for preemptible traffic classes
Date:   Fri, 17 Feb 2023 01:21:26 +0200
Message-Id: <20230216232126.3402975-13-vladimir.oltean@nxp.com>
In-Reply-To: <20230216232126.3402975-1-vladimir.oltean@nxp.com>
References: <20230216232126.3402975-1-vladimir.oltean@nxp.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?EWs83fWYUA0o1FfJgzqm/4Nanj7jEWQm8hl2VmhspHNV1NNZ/3yvpbae+OVb?=
 =?us-ascii?Q?bzfRTfkx8mV7+QlnitU+axjLqZYc4isuidGetge+X0iDF4b/guj9KerHPHcz?=
 =?us-ascii?Q?EyYSJXV2gzb60KEv32SYPcQhvPYUiZBgGC76SQM3x8GeoqNNdG6PKzTpJSH+?=
 =?us-ascii?Q?77Ym5Y7EWAV0oOMXxYUclaEklKwxOoIOK6E1IWbG5nsrUBt+kR2UnQZr+cgM?=
 =?us-ascii?Q?62FBpzgY/l2UvHFHmrTYV2Cww71PWaQJnxNiLkSjb8zCn2kTiwuCHriqrwyx?=
 =?us-ascii?Q?UtJdEteOPKB+WO2xN8R2ORFOWoIt10nbO8A3dtN9o+xvtZxtqLW0puvBhfar?=
 =?us-ascii?Q?v/BgUcbsrcaPEyas6T1dbO7vN5ekyfM8XZK4yoQOWFHhBckMtItMAgdGX6yD?=
 =?us-ascii?Q?IFdG8l4oLNtEKcO5KaVAo5Pbu1ZIMHhWD9g8GO6cZcllz22bari9OHMNlCis?=
 =?us-ascii?Q?/G+P+/lSOI1Zmp1sjakzmFLNAwMEht8elI2/mAKiiHqyMth2Cj69QzU8lEMv?=
 =?us-ascii?Q?aq3jxXH3hJZJH1SWZV7kboYGqu8X1zDgDTfQhX3QE73Jcau6UCnCiwZy/bOD?=
 =?us-ascii?Q?ATLsP/7KtmNv/6UqWWla7s+nZXfsAdp9NEMaCO/axR9nMRWxx9Wq6ayCDrIa?=
 =?us-ascii?Q?iBjQqIrrveAnqW6oUQ+oI+6k0duqws5Lk5jwyWmkJ2TjZMTneD2AwVlzVe77?=
 =?us-ascii?Q?1pQUuYte6mmPMBo7h4PXXFhaScRaVmp9TZAKLlErYxFiyzBl5qcSxWoVFzZC?=
 =?us-ascii?Q?Lsyj/sMpkHzaoQf6NV0McOBZJcFUenMv274GUaCXHF8ODguR5qmwBnZ3xLLM?=
 =?us-ascii?Q?XgFkWQ4WnH/NJmkU9XF09TA+vsEW3zw8tzaD5UU90xaY7wfZwhjgPuAlEnI/?=
 =?us-ascii?Q?/Ki9hLvoJxf5Lv8Q+UqLaBC2Bzggp7wJg7tzaJHxrC+97wm2u7hYGaRKDfas?=
 =?us-ascii?Q?ZDm/faMVq8F1Q617xW4diDJQgkzw6hu1Wkh+be9OoLJhCiAzI/1BUzG0N8eY?=
 =?us-ascii?Q?C/w/46iaNOt9tdUH9rBSykb56SX5RZafqbveBE2GqRmbw9kXGg12tr4y0AQD?=
 =?us-ascii?Q?AEvSFyyBEVEZ10jBbx8ya/P2ZsEQBCCmEkjdCedVFBdwRv8hOgi4VAjSJM7j?=
 =?us-ascii?Q?7BjiT7vQHr1C1bjCE/785o+rFpcUHcowRY0wZXYbHqD8C8urLL76Kg1D9lMR?=
 =?us-ascii?Q?YC7L0zIDELA9sZrXsyJW4tgBq2jv2lbDyqR8gGlygZ6ZY5d/Mx4A3LM2fDPh?=
 =?us-ascii?Q?9YNXtbiFd1Kxk7e+45Ge7TZg6OPgtzqCn4CR7sxA5gmGprxeUDkurA/ziCq4?=
 =?us-ascii?Q?COMeHGT4f1kIbkwvCA6zD7j8n9Swn15Zu9cBHZl+CAhnWAJqRr11C10GUCvw?=
 =?us-ascii?Q?Vf5ayZUQub0T+lNKlOwW01sIl3ZY8DoSF3hHP9IGgK+OP4NvkH1uSxBsFMnE?=
 =?us-ascii?Q?jzOOJfGdMvX7hLjg1mbHMQ/d2KsbcGn/j/QGw9Qv9g4dryjD/vTG39ZBBHkU?=
 =?us-ascii?Q?meUfFSIMOG3cExsz3Bt3ewJIQL/TEgi+vfDqV4dlzsIp2aLa4yqbZo3zN7nA?=
 =?us-ascii?Q?BbmrhcUik0AKgvskOmOVwH+Gicr9cnI3Y+TSqXORBAlWwCWxpxrl/dFeEBMW?=
 =?us-ascii?Q?4w=3D=3D?=
X-OriginatorOrg: nxp.com
X-MS-Exchange-CrossTenant-Network-Message-Id: e8911449-bddc-44a0-99fb-08db107496d7
X-MS-Exchange-CrossTenant-AuthSource: VI1PR04MB5136.eurprd04.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Feb 2023 23:21:53.7582
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: nu3vfOyMkgFsQ+i7S2Kkaai4W59X+YOK6gLYNSB2OB8GnqFS0Pe79stX6FEJaVgLQoZqNiV413H/h5DMMCU0Xw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PR3PR04MB7436
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

PFs which support the MAC Merge layer also have a set of 8 registers
called "Port traffic class N frame preemption register (PTC0FPR - PTC7FPR)".
Through these, a traffic class (group of TX rings of same dequeue
priority) can be mapped to the eMAC or to the pMAC.

There's nothing particularly spectacular here. We should probably only
commit the preemptible TCs to hardware once the MAC Merge layer became
active, but unlike Felix, we don't have an IRQ that notifies us of that.
We'd have to sleep for up to verifyTime (127 ms) to wait for a
resolution coming from the verification state machine; not only from the
ndo_setup_tc() code path, but also from enetc_mm_link_state_update().
Since it's relatively complicated and has a relatively small benefit,
I'm not doing it.

Signed-off-by: Vladimir Oltean <vladimir.oltean@nxp.com>
---
 drivers/net/ethernet/freescale/enetc/enetc.c  | 22 +++++++++++++++++++
 drivers/net/ethernet/freescale/enetc/enetc.h  |  1 +
 .../net/ethernet/freescale/enetc/enetc_hw.h   |  4 ++++
 3 files changed, 27 insertions(+)

diff --git a/drivers/net/ethernet/freescale/enetc/enetc.c b/drivers/net/ethernet/freescale/enetc/enetc.c
index e0207b01ddd6..41c194c1672d 100644
--- a/drivers/net/ethernet/freescale/enetc/enetc.c
+++ b/drivers/net/ethernet/freescale/enetc/enetc.c
@@ -25,6 +25,24 @@ void enetc_port_mac_wr(struct enetc_si *si, u32 reg, u32 val)
 }
 EXPORT_SYMBOL_GPL(enetc_port_mac_wr);
 
+void enetc_set_ptcfpr(struct enetc_hw *hw, unsigned long preemptible_tcs)
+{
+	u32 val;
+	int tc;
+
+	for (tc = 0; tc < 8; tc++) {
+		val = enetc_port_rd(hw, ENETC_PTCFPR(tc));
+
+		if (preemptible_tcs & BIT(tc))
+			val |= ENETC_PTCFPR_FPE;
+		else
+			val &= ~ENETC_PTCFPR_FPE;
+
+		enetc_port_wr(hw, ENETC_PTCFPR(tc), val);
+	}
+}
+EXPORT_SYMBOL_GPL(enetc_set_ptcfpr);
+
 static int enetc_num_stack_tx_queues(struct enetc_ndev_priv *priv)
 {
 	int num_tx_rings = priv->num_tx_rings;
@@ -2640,6 +2658,8 @@ static void enetc_reset_tc_mqprio(struct net_device *ndev)
 	}
 
 	enetc_debug_tx_ring_prios(priv);
+
+	enetc_set_ptcfpr(hw, 0);
 }
 
 int enetc_setup_tc_mqprio(struct net_device *ndev, void *type_data)
@@ -2694,6 +2714,8 @@ int enetc_setup_tc_mqprio(struct net_device *ndev, void *type_data)
 
 	enetc_debug_tx_ring_prios(priv);
 
+	enetc_set_ptcfpr(hw, mqprio->preemptible_tcs);
+
 	return 0;
 
 err_reset_tc:
diff --git a/drivers/net/ethernet/freescale/enetc/enetc.h b/drivers/net/ethernet/freescale/enetc/enetc.h
index 8010f31cd10d..143078a9ef16 100644
--- a/drivers/net/ethernet/freescale/enetc/enetc.h
+++ b/drivers/net/ethernet/freescale/enetc/enetc.h
@@ -486,6 +486,7 @@ static inline void enetc_cbd_free_data_mem(struct enetc_si *si, int size,
 
 void enetc_reset_ptcmsdur(struct enetc_hw *hw);
 void enetc_set_ptcmsdur(struct enetc_hw *hw, u32 *queue_max_sdu);
+void enetc_set_ptcfpr(struct enetc_hw *hw, unsigned long preemptible_tcs);
 
 #ifdef CONFIG_FSL_ENETC_QOS
 int enetc_qos_query_caps(struct net_device *ndev, void *type_data);
diff --git a/drivers/net/ethernet/freescale/enetc/enetc_hw.h b/drivers/net/ethernet/freescale/enetc/enetc_hw.h
index de2e0ee8cdcb..36bb2d6d5658 100644
--- a/drivers/net/ethernet/freescale/enetc/enetc_hw.h
+++ b/drivers/net/ethernet/freescale/enetc/enetc_hw.h
@@ -965,6 +965,10 @@ static inline u32 enetc_usecs_to_cycles(u32 usecs)
 	return (u32)div_u64(usecs * ENETC_CLK, 1000000ULL);
 }
 
+/* Port traffic class frame preemption register */
+#define ENETC_PTCFPR(n)			(0x1910 + (n) * 4) /* n = [0 ..7] */
+#define ENETC_PTCFPR_FPE		BIT(31)
+
 /* port time gating control register */
 #define ENETC_PTGCR			0x11a00
 #define ENETC_PTGCR_TGE			BIT(31)
-- 
2.34.1