Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.36 as permitted sender) client-ip=23.128.96.36;
From:   Aleksandar Rikalo <aleksandar.rikalo@syrmia.com>
To:     Thomas Bogendoerfer <tsbogend@alpha.franken.de>
Cc:     Aleksandar Rikalo <arikalo@gmail.com>,
        Chao-ying Fu <cfu@wavecomp.com>,
        Daniel Lezcano <daniel.lezcano@linaro.org>,
        Dragan Mladjenovic <dragan.mladjenovic@syrmia.com>,
        Geert Uytterhoeven <geert@linux-m68k.org>,
        Greg Ungerer <gerg@kernel.org>,
        Hauke Mehrtens <hauke@hauke-m.de>,
        Ilya Lipnitskiy <ilya.lipnitskiy@gmail.com>,
        Jiaxun Yang <jiaxun.yang@flygoat.com>,
        linux-kernel@vger.kernel.org, linux-mips@vger.kernel.org,
        Marc Zyngier <maz@kernel.org>,
        Paul Burton <paulburton@kernel.org>,
        Peter Zijlstra <peterz@infradead.org>,
        Serge Semin <fancer.lancer@gmail.com>,
        Thomas Gleixner <tglx@linutronix.de>,
        Tiezhu Yang <yangtiezhu@loongson.cn>
Subject: [PATCH v3 01/11] MIPS: CPS: Add a couple of multi-cluster utility functions
Date:   Tue, 31 Oct 2023 17:49:17 +0100
Message-Id: <20231031164927.371663-2-aleksandar.rikalo@syrmia.com>
In-Reply-To: <20231031164927.371663-1-aleksandar.rikalo@syrmia.com>
References: <20231031164927.371663-1-aleksandar.rikalo@syrmia.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?xEddZ16Vfy9XVW3TlGCbi8l5XRxRGMbFz6DqcFottOeBmIUZp5JF0sgpEfIf?=
 =?us-ascii?Q?QvZeE9rU8qqKIpwcdz0MHZovNpAsA7K81hCWz2zD4SY+V2rkIc/zdOI5Ero7?=
 =?us-ascii?Q?OGgE842PID7lP/pA96eQ9ViLHCAZC48kznaBvKKnAnI4h9MIVGhxl/vnNpVb?=
 =?us-ascii?Q?gwiWNH8IYsyF53nFxu+x6yCMM53xpDznlnoQ0Kj9xwTUhuV0NuXxZKY0Jiz3?=
 =?us-ascii?Q?Miyr07TKvJcVVYJINtJ6Ug/8Rtx5rZCs17z1RXUMtYCSR8+KvJCov/Zn7QWJ?=
 =?us-ascii?Q?9zh+3YRHzQigPOhCXCPpzNNi18Mx07/xMn/HydYmtCReQGck0oOsc4XKJ8nU?=
 =?us-ascii?Q?gP9LJmqBeTjk/HXrgkFlyye/PmnGbPo2YVwHURVF5lI4upA91z0H26dh+thW?=
 =?us-ascii?Q?1bc+FMPrQaEbtaYEqCdO7L2LCR+1B6Eiow+4opztkQhARh2hoMXyqI8zEaSo?=
 =?us-ascii?Q?fNRyht1v8KHieK/4eN0MF/nR/op7knD9UCrJ9z6Ya1L6UCORW6YdLq8so2XT?=
 =?us-ascii?Q?ZZFIOjcXRkFBytSmdrGuUdWButVShgK/J67uz7Jrovsgz91FNFAxhZIXAJ7j?=
 =?us-ascii?Q?xqiSGL2pH3CpsMjvtSzwX0Fr+MCrvf2v/XxRjV3nit+TOynQhG9jCJ1F4nsm?=
 =?us-ascii?Q?OCf0OcnKlNUU8naSUh2wRsz1ahD4shcagl8FX1uG3dFNtZ4BPV1KiC2Dnkva?=
 =?us-ascii?Q?C0FJtqetmYLuw7xmQ1FfprIeAKBGfmonxQ/GtSWI8I/RrFHboOm3Sd4+mCKs?=
 =?us-ascii?Q?+Hqsj2UY3XbYZsx4aiV9wqdGsNxElldnJW2pvUDmrNW+4vxNIKTFSAbblidc?=
 =?us-ascii?Q?iIeoBNQW4qLGIDtQLe3ApAxMqC0h6WRpozj4fhp3mLs6M7WE6AjhwMia+mCp?=
 =?us-ascii?Q?k8gZ8HNCpIKlaR2kGfsDTPr4mnepZuFFAUs9xcK4aJ4/GWJes+C1iX+Rucmk?=
 =?us-ascii?Q?IU37oxSbV+EvNSaCcag8Wl3zq+ucr4hNbwPuXUYZJ+hkOD19bs1kq571UwZ8?=
 =?us-ascii?Q?1vnTJCEQHW0Saamr5qLyQy4Tuk3Uu4G6cJ+zT7eStiHGfEl1XoIDy4gvcdPN?=
 =?us-ascii?Q?oXEJPvDWMA0nGgQ81IfcWXSxkZkgqrdkozbBQsd9TNeGtBMiTRDt9ItqgyQS?=
 =?us-ascii?Q?JATEw0s0uv5qIqWeeta8pfjoXYZPQFu5zxLCwSjbsXwbgkcgeUD8E/C23+zy?=
 =?us-ascii?Q?TfXcH4sBF/FJgHMDHnzHexhUoZu93e7Eq6OPJjcQZKDUds2RfWprhEVF795s?=
 =?us-ascii?Q?x8KdH0aMcwKyxyYEoE0ALOnRvZURi9H2LWUJjcrX6FSfdVgEKk6NH7uU13/9?=
 =?us-ascii?Q?akRpVlRzTil8qR0ho31FdfAjki1gC/oSOr1blHTgcOX7T1SA+xfhY8k2W0s0?=
 =?us-ascii?Q?HXdrorni9+tltCKLxVqw3LJmJ/oLqs6/SCC5J27iVL7/PFVd5igNInjTtBPe?=
 =?us-ascii?Q?dX+7t4Xpa2bi4ieJUH3tvKSszITdEH3vfYlxGpegPplHxul5KTCKJ57wGL0J?=
 =?us-ascii?Q?soed7SAPL58Z8sVW3dv1uW+Sh6pP0ZN7DOw+5+6a6K285N+1LX/kLAgvxzz2?=
 =?us-ascii?Q?+NPStoqa+lYQBQ44gYzl15XK2DGPngVosRBBOULCDATmvPYfCHJLYBQy6zqf?=
 =?us-ascii?Q?aA=3D=3D?=
X-OriginatorOrg: syrmia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: a58be8d6-331a-4342-f1aa-08dbda315e89
X-MS-Exchange-CrossTenant-AuthSource: VI1PR0302MB3486.eurprd03.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Oct 2023 16:49:37.8713
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 19214a73-c1ab-4e19-8f59-14bdcb09a66e
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: FYDvuTF9hLWFt69mvyz6pr+xy4s/nQbZjfQwoERftrpwdGr6arPMmJXXk4TVZC8NtU24bf9FjJ+VXFDYWK/BUgMDUIPmpafTuR5xIOMpbHY=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR03MB7187
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,
	DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,
	SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable
	autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on pete.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (pete.vger.email [0.0.0.0]); Tue, 31 Oct 2023 09:53:11 -0700 (PDT)

From: Paul Burton <paulburton@kernel.org>

This patch introduces a couple of utility functions which help later
patches with introducing support for multi-cluster systems.

 - mips_cps_multicluster_cpus() allows its caller to determine whether
   the system includes CPUs spread across multiple clusters. This is
   useful because in some cases behaviour can be more optimal taking
   this knowledge into account. The means by which we check this is
   dependent upon the way we probe CPUs & assign their numbers, so
   keeping this knowledge confined here in arch/mips/ seems appropriate.

 - mips_cps_first_online_in_cluster() allows its caller to determine
   whether it is running upon the first CPU online within its cluster.
   This information is useful in cases where some cluster-wide
   configuration may need to occur, but should not be repeated if
   another CPU in the cluster is already online. Similarly to the above
   this is determined based upon knowledge of CPU numbering so it makes
   sense to keep that knowledge in arch/mips/. The function is defined
   in mips-cm.c rather than in asm/mips-cps.h in order to allow us to
   use asm/cpu-info.h & linux/smp.h without encountering an include
   nightmare.

Signed-off-by: Paul Burton <paulburton@kernel.org>
Signed-off-by: Chao-ying Fu <cfu@wavecomp.com>
Signed-off-by: Dragan Mladjenovic <dragan.mladjenovic@syrmia.com>
Signed-off-by: Aleksandar Rikalo <aleksandar.rikalo@syrmia.com>
---
 arch/mips/include/asm/mips-cps.h | 38 ++++++++++++++++++++++++++++++++
 arch/mips/kernel/mips-cm.c       | 37 +++++++++++++++++++++++++++++++
 2 files changed, 75 insertions(+)

diff --git a/arch/mips/include/asm/mips-cps.h b/arch/mips/include/asm/mips-cps.h
index c077e8d100f5..fa71cf3a25d7 100644
--- a/arch/mips/include/asm/mips-cps.h
+++ b/arch/mips/include/asm/mips-cps.h
@@ -228,4 +228,42 @@ static inline unsigned int mips_cps_numvps(unsigned int cluster, unsigned int co
 	return FIELD_GET(CM_GCR_Cx_CONFIG_PVPE, cfg + 1);
 }
 
+/**
+ * mips_cps_multicluster_cpus() - Detect whether CPUs are in multiple clusters
+ *
+ * Determine whether the system includes CPUs in multiple clusters - ie.
+ * whether we can treat the system as single or multi-cluster as far as CPUs
+ * are concerned. Note that this is slightly different to simply checking
+ * whether multiple clusters are present - it is possible for there to be
+ * clusters which contain no CPUs, which this function will effectively ignore.
+ *
+ * Returns true if CPUs are spread across multiple clusters, else false.
+ */
+static inline bool mips_cps_multicluster_cpus(void)
+{
+	unsigned int first_cl, last_cl;
+
+	/*
+	 * CPUs are numbered sequentially by cluster - ie. CPUs 0..X will be in
+	 * cluster 0, CPUs X+1..Y in cluster 1, CPUs Y+1..Z in cluster 2 etc.
+	 *
+	 * Thus we can detect multiple clusters trivially by checking whether
+	 * the first & last CPUs belong to the same cluster.
+	 */
+	first_cl = cpu_cluster(&boot_cpu_data);
+	last_cl = cpu_cluster(&cpu_data[nr_cpu_ids - 1]);
+	return first_cl != last_cl;
+}
+
+/**
+ * mips_cps_first_online_in_cluster() - Detect if CPU is first online in cluster
+ *
+ * Determine whether the local CPU is the first to be brought online in its
+ * cluster - that is, whether there are any other online CPUs in the local
+ * cluster.
+ *
+ * Returns true if this CPU is first online, else false.
+ */
+extern unsigned int mips_cps_first_online_in_cluster(void);
+
 #endif /* __MIPS_ASM_MIPS_CPS_H__ */
diff --git a/arch/mips/kernel/mips-cm.c b/arch/mips/kernel/mips-cm.c
index 3f00788b0871..2a59f0842a4a 100644
--- a/arch/mips/kernel/mips-cm.c
+++ b/arch/mips/kernel/mips-cm.c
@@ -518,3 +518,40 @@ void mips_cm_error_report(void)
 	/* reprime cause register */
 	write_gcr_error_cause(cm_error);
 }
+
+unsigned int mips_cps_first_online_in_cluster(void)
+{
+	unsigned int local_cl;
+	int i;
+
+	local_cl = cpu_cluster(&current_cpu_data);
+
+	/*
+	 * We rely upon knowledge that CPUs are numbered sequentially by
+	 * cluster - ie. CPUs 0..X will be in cluster 0, CPUs X+1..Y in cluster
+	 * 1, CPUs Y+1..Z in cluster 2 etc. This means that CPUs in the same
+	 * cluster will immediately precede or follow one another.
+	 *
+	 * First we scan backwards, until we find an online CPU in the cluster
+	 * or we move on to another cluster.
+	 */
+	for (i = smp_processor_id() - 1; i >= 0; i--) {
+		if (cpu_cluster(&cpu_data[i]) != local_cl)
+			break;
+		if (!cpu_online(i))
+			continue;
+		return false;
+	}
+
+	/* Then do the same for higher numbered CPUs */
+	for (i = smp_processor_id() + 1; i < nr_cpu_ids; i++) {
+		if (cpu_cluster(&cpu_data[i]) != local_cl)
+			break;
+		if (!cpu_online(i))
+			continue;
+		return false;
+	}
+
+	/* We found no online CPUs in the local cluster */
+	return true;
+}
-- 
2.25.1