Received: by 2002:ab2:6c55:0:b0:1fd:c486:4f03 with SMTP id v21csp590114lqp; Wed, 12 Jun 2024 10:07:01 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCXrPup9C1LmX3cCjwdFfO9/Wb5cYXP+cESYXzXynhoeZU+q5oEpzGhckBsyh3GpJwQkBOBgitQOgqrbbe7WGlU2tXJuP43+xs1sMyOCRw== X-Google-Smtp-Source: AGHT+IGINFzwgKx08yoAlgyMGYt+EK3fbTN0kNP+ZTZqAIl1bUpNmDdlC4vXOeaDlF2omc+0g1/s X-Received: by 2002:ac8:7e90:0:b0:440:7b08:a399 with SMTP id d75a77b69052e-4415abf4591mr31717921cf.37.1718212021307; Wed, 12 Jun 2024 10:07:01 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1718212021; cv=pass; d=google.com; s=arc-20160816; b=Zvxzj3s2Zpg2C9db6eJ3IWxxa/sprO7N+sqVrMeFF/sOT5lBsU1sD7sDxM8KYDBHmY kkVirbl8mNDYnVKSt8+5yEqVQ7/8zaNpaz2p9OKcxFE6fpfUOFqcLPAhheJc5fZnkEX6 4rFhYMkE6IpbTrldFgn+k/Q0yJTUTm8AzBzMA5He9Zj3zmRWyRclgrj8+tkPuzIu4MAw KXKJAOutMwmlMZTBb7n/zDQ4pMZn9XH+gBgBB30V0BwebVYyomptxqLL/8G2vEru2nlK 4/Qz3TFnEIWA1Af3L+ItgHqQnnKyAhDVKZGtOhsgpmVVuE+gvfNoZMOrBQbx51xdlDRb fFZw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:dkim-signature:dkim-signature:from; bh=IeTJF40iEq+NZZllVmnIBl8wcOsjOidTGbpcz9abXes=; fh=Kh2oMxNPIz5e840R47MDpxJ3RpBpvOPASWfhcyFb/0k=; b=CoigjNBQWI93AdRg8FDAqim72Hq1AY9hZiQzvfNuAcCkBV6Klo5dnnUmexiB/Jq2sK NTs2JiPPYjFmlMscODAhuZHCOtndyzarBSPmv6oJIs78PGy9Ez9NTbG5x2kSTtKzLm1+ Ii0V6jAbj1N/xSroRKlI3koCOKs0lA7Hk2GD36h5P5f7ifdKedF1jOp7JnRH2qpWtDm8 mSxw+LuG+U8Zp1IPQtpCfhYIMhlZ3hisTeksT02OHxlH4ts/oGv9h/f/scZBiMrT3ILd OHgwFTvYutcxO2AMWZLCTwcMYjNjB5oeNe4VXpvGBSluamhhiFhX26K/6SSpieAivbvt zNCg==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=U8CYlAP3; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-211972-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-211972-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id d75a77b69052e-4403bbeb065si161973491cf.666.2024.06.12.10.07.01 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 12 Jun 2024 10:07:01 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-211972-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; dkim=pass header.i=@linutronix.de header.s=2020 header.b=U8CYlAP3; dkim=neutral (no key) header.i=@linutronix.de header.s=2020e; arc=pass (i=1 spf=pass spfdomain=linutronix.de dkim=pass dkdomain=linutronix.de dmarc=pass fromdomain=linutronix.de); spf=pass (google.com: domain of linux-kernel+bounces-211972-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-211972-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=linutronix.de Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id EE3F21C2130B for ; Wed, 12 Jun 2024 17:07:00 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 19A84187575; Wed, 12 Jun 2024 17:03:29 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="U8CYlAP3"; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b="h+Q2UvtJ" Received: from galois.linutronix.de (Galois.linutronix.de [193.142.43.55]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 86994183072; Wed, 12 Jun 2024 17:03:24 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=193.142.43.55 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718211807; cv=none; b=Qc/w8liZQ4T92lwf3eB3k53srsg7VdAZWbzfW3SfP0OGeZrOKoBiv1M+hEtJyVolPFTmm92j7Z2FxZI7T8xKxV64ioKeWjtLDBXoVxwCHop8+6FHz1D/Afo5FhkoIj/n/uXBLnPkFNFzC+6+Y6q7i0U/QpOTplNtrSx+Gtk+l1A= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1718211807; c=relaxed/simple; bh=8mNx9FPoHj4JNcDCiK2qJg5jIW+93DxmgJLrP1yB8cs=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=QXgWST5PAVvLgAXH1wkqUTtODgb348mBfgTuJKBQbfZJzlH5GhYVz0GT55eJk3FDtTERWG1dG4OncWPhh352QcLRM5YPjc2D4syF3H1G4c95PIqKsZO/R5GQrF4pn8xgbFn/ryFbXEHRgWJVFJOkPoTbmCvqscKHx1OxP+cVTDg= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de; spf=pass smtp.mailfrom=linutronix.de; dkim=pass (2048-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=U8CYlAP3; dkim=permerror (0-bit key) header.d=linutronix.de header.i=@linutronix.de header.b=h+Q2UvtJ; arc=none smtp.client-ip=193.142.43.55 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linutronix.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linutronix.de From: Sebastian Andrzej Siewior DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020; t=1718211797; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IeTJF40iEq+NZZllVmnIBl8wcOsjOidTGbpcz9abXes=; b=U8CYlAP3M7UyeA2rF7aIo75QSZzoFqOS/0NINtpqToPfokhiObYvGdb0GXULAnfiQWlUvF zk0HMKo4kIxNOjO3kVgvU7VFEUjUo0QNYfOoDuLPapNTrKiqW16opfRmG9bgVZvmP/7VUF dMSm25S9uPvdIY9WZSuT/Wn7UbhhwY8JLE+vo6LAxdoEJc3d0gwjCGfY6JfDnWlpCs3VD1 752rlAALydgavJKr5AtnxfUfs1VNV9H5ymFriHqhcbAWqRy4dKzAvuGq0mwMwsP0dcDF1T x6eE3vTqeApr5BNBvOUFx7/fKBvbToq2uX86Po7lnkPHpOpc02FFyIOvFQMs6Q== DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=linutronix.de; s=2020e; t=1718211797; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IeTJF40iEq+NZZllVmnIBl8wcOsjOidTGbpcz9abXes=; b=h+Q2UvtJWf3O4utp+8HLCT6K8vHoTmy7wbw3TI0MsEf5iqSb0PHcWJilK2kOpK7OG8/mrK XMr7Sj+lm5wQFFCw== To: linux-kernel@vger.kernel.org, netdev@vger.kernel.org Cc: "David S. Miller" , Daniel Bristot de Oliveira , Boqun Feng , Daniel Borkmann , Eric Dumazet , Frederic Weisbecker , Ingo Molnar , Jakub Kicinski , Paolo Abeni , Peter Zijlstra , Thomas Gleixner , Waiman Long , Will Deacon , Sebastian Andrzej Siewior , Ben Segall , Daniel Bristot de Oliveira , Dietmar Eggemann , Juri Lelli , Mel Gorman , Steven Rostedt , Valentin Schneider , Vincent Guittot Subject: [PATCH v6 net-next 08/15] net: softnet_data: Make xmit.recursion per task. Date: Wed, 12 Jun 2024 18:44:34 +0200 Message-ID: <20240612170303.3896084-9-bigeasy@linutronix.de> In-Reply-To: <20240612170303.3896084-1-bigeasy@linutronix.de> References: <20240612170303.3896084-1-bigeasy@linutronix.de> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Softirq is preemptible on PREEMPT_RT. Without a per-CPU lock in local_bh_disable() there is no guarantee that only one device is transmitting at a time. With preemption and multiple senders it is possible that the per-CPU recursion counter gets incremented by different threads and exceeds XMIT_RECURSION_LIMIT leading to a false positive recursion alert. Instead of adding a lock to protect the per-CPU variable it is simpler to make the counter per-task. Sending and receiving skbs happens always in thread context anyway. Having a lock to protected the per-CPU counter would block/ serialize two sending threads needlessly. It would also require a recursive lock to ensure that the owner can increment the counter further. Make the recursion counter a task_struct member on PREEMPT_RT. Cc: Ben Segall Cc: Daniel Bristot de Oliveira Cc: Dietmar Eggemann Cc: Juri Lelli Cc: Mel Gorman Cc: Steven Rostedt Cc: Valentin Schneider Cc: Vincent Guittot Signed-off-by: Sebastian Andrzej Siewior --- include/linux/netdevice.h | 11 +++++++++++ include/linux/sched.h | 4 +++- net/core/dev.h | 20 ++++++++++++++++++++ 3 files changed, 34 insertions(+), 1 deletion(-) diff --git a/include/linux/netdevice.h b/include/linux/netdevice.h index d20c6c99eb887..b5ec072ec2430 100644 --- a/include/linux/netdevice.h +++ b/include/linux/netdevice.h @@ -3223,7 +3223,9 @@ struct softnet_data { #endif /* written and read only by owning cpu: */ struct { +#ifndef CONFIG_PREEMPT_RT u16 recursion; +#endif u8 more; #ifdef CONFIG_NET_EGRESS u8 skip_txqueue; @@ -3256,10 +3258,19 @@ struct softnet_data { =20 DECLARE_PER_CPU_ALIGNED(struct softnet_data, softnet_data); =20 +#ifdef CONFIG_PREEMPT_RT +static inline int dev_recursion_level(void) +{ + return current->net_xmit_recursion; +} + +#else + static inline int dev_recursion_level(void) { return this_cpu_read(softnet_data.xmit.recursion); } +#endif =20 void __netif_schedule(struct Qdisc *q); void netif_schedule_queue(struct netdev_queue *txq); diff --git a/include/linux/sched.h b/include/linux/sched.h index 61591ac6eab6d..a9b0ca72db55f 100644 --- a/include/linux/sched.h +++ b/include/linux/sched.h @@ -975,7 +975,9 @@ struct task_struct { /* delay due to memory thrashing */ unsigned in_thrashing:1; #endif - +#ifdef CONFIG_PREEMPT_RT + u8 net_xmit_recursion; +#endif unsigned long atomic_flags; /* Flags requiring atomic access. */ =20 struct restart_block restart_block; diff --git a/net/core/dev.h b/net/core/dev.h index b7b518bc2be55..2f96d63053ad0 100644 --- a/net/core/dev.h +++ b/net/core/dev.h @@ -150,6 +150,25 @@ struct napi_struct *napi_by_id(unsigned int napi_id); void kick_defer_list_purge(struct softnet_data *sd, unsigned int cpu); =20 #define XMIT_RECURSION_LIMIT 8 + +#ifdef CONFIG_PREEMPT_RT +static inline bool dev_xmit_recursion(void) +{ + return unlikely(current->net_xmit_recursion > XMIT_RECURSION_LIMIT); +} + +static inline void dev_xmit_recursion_inc(void) +{ + current->net_xmit_recursion++; +} + +static inline void dev_xmit_recursion_dec(void) +{ + current->net_xmit_recursion--; +} + +#else + static inline bool dev_xmit_recursion(void) { return unlikely(__this_cpu_read(softnet_data.xmit.recursion) > @@ -165,5 +184,6 @@ static inline void dev_xmit_recursion_dec(void) { __this_cpu_dec(softnet_data.xmit.recursion); } +#endif =20 #endif --=20 2.45.1