Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Dragan Mladjenovic <Dragan.Mladjenovic@syrmia.com>
To:     Thomas Bogendoerfer <tsbogend@alpha.franken.de>
Cc:     Paul Burton <paulburton@kernel.org>,
        Geert Uytterhoeven <geert+renesas@glider.be>,
        Ilya Lipnitskiy <ilya.lipnitskiy@gmail.com>,
        Greg Ungerer <gerg@kernel.org>,
        Chao-ying Fu <cfu@wavecomp.com>,
        Jiaxun Yang <jiaxun.yang@flygoat.com>,
        linux-mips@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: [PATCH 01/12] MIPS: CPS: Add a couple of multi-cluster utility functions
Date:   Thu, 19 May 2022 20:51:14 +0200
Message-Id: <20220519185125.11686-2-Dragan.Mladjenovic@syrmia.com>
In-Reply-To: <20220519185125.11686-1-Dragan.Mladjenovic@syrmia.com>
References: <20220519185125.11686-1-Dragan.Mladjenovic@syrmia.com>
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?MEeBHc6sRFM0yoalDh8GRqv3HkxoMy6upXMQL7ywy9ot5MDjqvCuPsiFxBw0?=
 =?us-ascii?Q?YHvNzXng1Sgnm/t/byIwlKPk8P1J7FqxBnu/QTTbKwALAWQDB5a+yvyO3glj?=
 =?us-ascii?Q?WV22iAcY1lWuUP/9VXrf4wBwDqQmvsXeIjWfkKeZj+2Fd4FjNPsJA4c5YpvZ?=
 =?us-ascii?Q?5GUTx3wGqGPEbj0TPvYag+kB1IpGFdIj7SmVa8QqH+tqQ8bTOJf1uLb+oOAh?=
 =?us-ascii?Q?yHYtoz7Ph/EdAWk1bwu396LXr9fb3Z3GFsCh4egYFsY0NvdPKyhicFhox8xG?=
 =?us-ascii?Q?Kt5Jdr3AFSp0l+MM5XhPiK6iaBM08xT9K1INR96w0KdaXXmcjkW/VAS4k50n?=
 =?us-ascii?Q?IfSlma6VQOEJcNpjbvwdKlA9DMiTMIe3VJUYQElZ1RfiLM9T4PQw+9sw6bHh?=
 =?us-ascii?Q?gE4fN24CYrl5PVUa49bK+ztvmQ0CSfP3kCtMkoe7Xq5mmJ0idgjqdLknCfG1?=
 =?us-ascii?Q?Ht8i24uMza4A1uhZf29rqZovL5fvyvGtQswzXkd+AtOn8RnghWPwnzxRI+A1?=
 =?us-ascii?Q?4tX93CDdRxVhLp2VuOmlJPW5jDQ+B4Q2vLPq3SKzZv7bEi3l7zpMZi+UIw2M?=
 =?us-ascii?Q?Ov2mcWgZpeGe4Cz3HG+bI6eedWHKtTLE67xvFzBiX3dAEFv3troj8/44mrs5?=
 =?us-ascii?Q?5r4FGVVsiL0Nf435BWhAsqS0md5Ftcva5YneHDa16eKOMFXRe9jR8IqkJECu?=
 =?us-ascii?Q?fLpMdK6pCm3cjcYGioXFYPiVbay2NaJYhkrWceEodA5uJrG5UbI+mw7OZfLS?=
 =?us-ascii?Q?H3pXMnZ8B7l2LEQMZKUVboF0kpd36P6THJVdBILEzQznZCDEnNgHPcnak6Ik?=
 =?us-ascii?Q?3Hxui2WVFl6LYo3mzqWO1ej3L5P0HQvf1qzyt5+5au6a0LM80PuYNJXAtzgI?=
 =?us-ascii?Q?aqVqY9AsDHtwZBqquQTd/GmWgHX9QVrAWNoHCuOVXBKpN6NY4ee955IT9SXB?=
 =?us-ascii?Q?QQvgfYIqyyn4ss7pW9yoIE6srA7dOcKF08rokAhgmYdgB1iwAJGnEGEW0OAK?=
 =?us-ascii?Q?nXdAubXIOz/M5b/Lq2kWb1y/iowQl5JJDZDaxfgQBpHPasO/Z6GMzr9ecEUC?=
 =?us-ascii?Q?b64a3hMdhHqEqehrzE2DFT9FWEdSvoT9ewkTcsVrpfs4V26679dqBL9XYR+l?=
 =?us-ascii?Q?virreVGakY0eiQwWbbTFNpM+FoGYPADhzbto3lADzWHQJkpcePO1cdhWSuqQ?=
 =?us-ascii?Q?jscFpNFJZBwMRMOg6IyMzN1EUYsO/yMDbJ3bziQjISJKzRMwYwuM3Tf/UwjF?=
 =?us-ascii?Q?8HWlzmfJOE9ppx3uoSKhBRkJGd6k2JOLjBA6bZgGA/8xqrKBLbis4V2mrkWd?=
 =?us-ascii?Q?yiCXK1vTvZrNrXPnzkQv6n13WXrC93aBnYxy4vwS5YxQnINBcG2LK1Eo4gWq?=
 =?us-ascii?Q?zbzGDz/ABx4fjHEWgQe/8CgUgTnmD+8NiqsiUU3Icmxi1UyyPWKM76lCkmJ5?=
 =?us-ascii?Q?7/uAdbV0rqw84JRi9LF7DCYUcQphue6lnsY0NqKyg5ZCPC6mNAE/Pk4QUybR?=
 =?us-ascii?Q?zdZ+feR+D5vcOfIItLUJqyIjJ7ZMk+dundexltTmhaFc0M2/b9qOYFzUAV3e?=
 =?us-ascii?Q?RnaI37RmwFftTTTigv0RVosG4NRN3s19qkWHRy9BU+MAwBH581/RimLB1h8C?=
 =?us-ascii?Q?O3dzKoLzGj0leo4GcA/mmOG8R3mMqW8b4HtA38j32nTQ4bVWi5XDoRv0Eph9?=
 =?us-ascii?Q?FpWEWwVcI5lvUiLl5fPNwV6dxkcgm0rDpssXaKWlFN1XPsIvB1FNWzkbxT9e?=
 =?us-ascii?Q?okz6rSchSvvTKkBL0eQyb9UE0olpFYY=3D?=
X-OriginatorOrg: syrmia.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 63da7aa5-206d-4a7f-ff24-08da39c89e2c
X-MS-Exchange-CrossTenant-AuthSource: VI1PR03MB4208.eurprd03.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 May 2022 18:51:43.8681
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 19214a73-c1ab-4e19-8f59-14bdcb09a66e
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: tPCmlLnUiUS2vrJoXXE6ZoD6EKod03CfSmAxIKMA/QbcszV9Gn4SpO2/469ahRYYXr2Lq39Y87WwX41uln1HJK+XUeaEANFPDXSwH9rEgiA=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0301MB2546
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

From: Paul Burton <paulburton@kernel.org>

This patch introduces a couple of utility functions which help later
patches with introducing support for multi-cluster systems.

 - mips_cps_multicluster_cpus() allows its caller to determine whether
   the system includes CPUs spread across multiple clusters. This is
   useful because in some cases behaviour can be more optimal taking
   this knowledge into account. The means by which we check this is
   dependent upon the way we probe CPUs & assign their numbers, so
   keeping this knowledge confined here in arch/mips/ seems appropriate.

 - mips_cps_first_online_in_cluster() allows its caller to determine
   whether it is running upon the first CPU online within its cluster.
   This information is useful in cases where some cluster-wide
   configuration may need to occur, but should not be repeated if
   another CPU in the cluster is already online. Similarly to the above
   this is determined based upon knowledge of CPU numbering so it makes
   sense to keep that knowledge in arch/mips/. The function is defined
   in mips-cm.c rather than in asm/mips-cps.h in order to allow us to
   use asm/cpu-info.h & linux/smp.h without encountering an include
   nightmare.

Signed-off-by: Paul Burton <paulburton@kernel.org>
Signed-off-by: Chao-ying Fu <cfu@wavecomp.com>

diff --git a/arch/mips/include/asm/mips-cps.h b/arch/mips/include/asm/mips-cps.h
index c077e8d100f5..fa71cf3a25d7 100644
--- a/arch/mips/include/asm/mips-cps.h
+++ b/arch/mips/include/asm/mips-cps.h
@@ -228,4 +228,42 @@ static inline unsigned int mips_cps_numvps(unsigned int cluster, unsigned int co
 	return FIELD_GET(CM_GCR_Cx_CONFIG_PVPE, cfg + 1);
 }
 
+/**
+ * mips_cps_multicluster_cpus() - Detect whether CPUs are in multiple clusters
+ *
+ * Determine whether the system includes CPUs in multiple clusters - ie.
+ * whether we can treat the system as single or multi-cluster as far as CPUs
+ * are concerned. Note that this is slightly different to simply checking
+ * whether multiple clusters are present - it is possible for there to be
+ * clusters which contain no CPUs, which this function will effectively ignore.
+ *
+ * Returns true if CPUs are spread across multiple clusters, else false.
+ */
+static inline bool mips_cps_multicluster_cpus(void)
+{
+	unsigned int first_cl, last_cl;
+
+	/*
+	 * CPUs are numbered sequentially by cluster - ie. CPUs 0..X will be in
+	 * cluster 0, CPUs X+1..Y in cluster 1, CPUs Y+1..Z in cluster 2 etc.
+	 *
+	 * Thus we can detect multiple clusters trivially by checking whether
+	 * the first & last CPUs belong to the same cluster.
+	 */
+	first_cl = cpu_cluster(&boot_cpu_data);
+	last_cl = cpu_cluster(&cpu_data[nr_cpu_ids - 1]);
+	return first_cl != last_cl;
+}
+
+/**
+ * mips_cps_first_online_in_cluster() - Detect if CPU is first online in cluster
+ *
+ * Determine whether the local CPU is the first to be brought online in its
+ * cluster - that is, whether there are any other online CPUs in the local
+ * cluster.
+ *
+ * Returns true if this CPU is first online, else false.
+ */
+extern unsigned int mips_cps_first_online_in_cluster(void);
+
 #endif /* __MIPS_ASM_MIPS_CPS_H__ */
diff --git a/arch/mips/kernel/mips-cm.c b/arch/mips/kernel/mips-cm.c
index b4f7d950c846..5b843c2ff077 100644
--- a/arch/mips/kernel/mips-cm.c
+++ b/arch/mips/kernel/mips-cm.c
@@ -513,3 +513,40 @@ void mips_cm_error_report(void)
 	/* reprime cause register */
 	write_gcr_error_cause(cm_error);
 }
+
+unsigned int mips_cps_first_online_in_cluster(void)
+{
+	unsigned int local_cl;
+	int i;
+
+	local_cl = cpu_cluster(&current_cpu_data);
+
+	/*
+	 * We rely upon knowledge that CPUs are numbered sequentially by
+	 * cluster - ie. CPUs 0..X will be in cluster 0, CPUs X+1..Y in cluster
+	 * 1, CPUs Y+1..Z in cluster 2 etc. This means that CPUs in the same
+	 * cluster will immediately precede or follow one another.
+	 *
+	 * First we scan backwards, until we find an online CPU in the cluster
+	 * or we move on to another cluster.
+	 */
+	for (i = smp_processor_id() - 1; i >= 0; i--) {
+		if (cpu_cluster(&cpu_data[i]) != local_cl)
+			break;
+		if (!cpu_online(i))
+			continue;
+		return false;
+	}
+
+	/* Then do the same for higher numbered CPUs */
+	for (i = smp_processor_id() + 1; i < nr_cpu_ids; i++) {
+		if (cpu_cluster(&cpu_data[i]) != local_cl)
+			break;
+		if (!cpu_online(i))
+			continue;
+		return false;
+	}
+
+	/* We found no online CPUs in the local cluster */
+	return true;
+}
-- 
2.17.1