Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
From:   Darren Hart <darren@os.amperecomputing.com>
To:     LKML <linux-kernel@vger.kernel.org>,
        Linux Arm <linux-arm-kernel@lists.infradead.org>
Cc:     Catalin Marinas <catalin.marinas@arm.com>,
        Will Deacon <will@kernel.org>,
        Peter Zijlstra <peterz@infradead.org>,
        Vincent Guittot <vincent.guittot@linaro.org>,
        Barry Song <song.bao.hua@hisilicon.com>,
        Valentin Schneider <valentin.schneider@arm.com>,
        "D . Scott Phillips" <scott@os.amperecomputing.com>,
        Ilkka Koskinen <ilkka@os.amperecomputing.com>
Subject: [PATCH 0/1] arm64: smp: Skip MC sched domain on SoCs with no LLC
Date:   Mon, 28 Feb 2022 16:28:59 -0800
Message-Id: <cover.1646094455.git.darren@os.amperecomputing.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?FxkO9L+QNr8R8vB6WOpztgD+KJb45VltLmggoiUcNGEaTRmwPv2Vp/juAw+A?=
 =?us-ascii?Q?3/ZFAmVic/sJ+XKvyQMb7e2bSbpre28GUrvBBNpArGQw+JC7vsBAeEk9v4lw?=
 =?us-ascii?Q?0xNOnucJ9BuwfcFOuIm9mdPe1qkRpGB03cKyMLH5VoJKQzCYSZIQuitdxzYw?=
 =?us-ascii?Q?pI2ifW9ULNpHjDa/Hs82t96Q9Sym5iRcPtAyaljdMuc9aEdAmDKVtXOg3aEn?=
 =?us-ascii?Q?KDZTWC6+IucA7919vUKj97N7furUpzimCjroK2wSlqRLCJAgWwB+rhReU4Ht?=
 =?us-ascii?Q?du7PvwZMSJDMWtZ38oXDe4sD+2kC/4TOUT50+mAvhXcrYYpmeaNjbSi3+x9r?=
 =?us-ascii?Q?d2bgmyxQ7nnqqIttfsDw36aDutXIBfgUG+ew8c0pGapvp557bds3AhZIcS+6?=
 =?us-ascii?Q?zTuxW7pW2tI+NtXIPChCDJ607zc5nmaf8tK8vcCV2wRmrlLuNwI6AYMZDaBH?=
 =?us-ascii?Q?/AsM3DCR0X24XZe67lRvDYmWGZC1FKi+GYG/VVnxLshOGHTSYml1OjVfGZQ0?=
 =?us-ascii?Q?Eh1rt/5KUb46Hs1Z61Z8mTnhpjkUeESSqsQyM9ROEdWkvbrB64T127+9hAeW?=
 =?us-ascii?Q?tMtKx3l6ENGEUOXCDOu2v3TE0LIs3MFDtwnl8Wxp/l+ksUbGYasWSLkxdAEa?=
 =?us-ascii?Q?T682jVz1doqplxzMYZGyzLiIIY7K0g4S8f6lB1nXJ+/Co5Sp3TFm/2ajUmMQ?=
 =?us-ascii?Q?ogLcSiQmh1KELYBbezaHnr9jN+iyW7QReJGSTDIBM74WBe4OOztixN8hjG2D?=
 =?us-ascii?Q?T35ypPRkUkfZfco7vW9u/P6kQdAmm6x3A8I2mlJrhHDOss1YmO8APt4dW+Qg?=
 =?us-ascii?Q?SjVb+3Oxa0s//KpBtAn0xo7lknUSndGRAR3rlSJq+PF8QbjS86tQK0LQXlo7?=
 =?us-ascii?Q?SvXZpQd0IFRbAquhNHu6xN4GlozXdCnp9hbynXvO3lPMIqp3GsijJhMiYiHR?=
 =?us-ascii?Q?mC3XUU8wOlHmKrPhdFKcZYW5P+xF52TwHL02VfCIqj01uN2lc5gjVlUaCx8L?=
 =?us-ascii?Q?5kiL3Lg8Q2l9E/1mnmvfL1vrgd7Uk4/sVWn4Cq9l3EQLScZbxYgc7bN7Kyb2?=
 =?us-ascii?Q?YesCHAu9mvkyYW6KsFADXehZixgvM8/ji0kzRNcwWn9SEWIooyrhibGx0PXE?=
 =?us-ascii?Q?Sij7uW4oPHbIVlMkb0JywICJ7xe0do0F8S+x0tB6tO87zP8H3tHa83xUAtap?=
 =?us-ascii?Q?p+W36SDpF8lN+EXlQcvNuU6ZJB7dOPjRbvxJGIXBSpkS96uZ1BnJlFd+LyLE?=
 =?us-ascii?Q?8YJYMkVP4g9xXSEI99/3+Lyiak/xlxPwPEIkB4WuFTYCgfjRPAr+c128BpDs?=
 =?us-ascii?Q?1pEE7w5v6R2bQgsoEFXe6wZGDSfWiY/GbjU2c6ONXKghkSuZZAr9sKftkq1o?=
 =?us-ascii?Q?WH0Mpkcnu7ePxTfTAZm2/qhAJYY+4GnGDZ2ykG2SXB+KMukFbEf0JgBPUDka?=
 =?us-ascii?Q?v3My6Qf2ttufsVvjfFrYLUrpaLA32XGqiuSnY5u8ZLXYP1RfE5EkuX2m4rMs?=
 =?us-ascii?Q?2BEbRYvpZkj6F/S4I7iG/BC3qrIWcEFGxMvr2Ya+h+GBy6BHNtLcgd4fW3Qj?=
 =?us-ascii?Q?BXAutaWEnwg7YlZLP4b12hNtE3Q2H9kSjDAPiUfMq/wXyeykXnLJ4GmsSKL8?=
 =?us-ascii?Q?7oFiYU9prjMVQlucl4SIf6RtzwShPlyyftCLL+mVhL+X/yZLgjD6rmYav6nl?=
 =?us-ascii?Q?FY9wGLg3cwrkH+2viHZinfoyAUEPLeDaMbULSE/b/VeWGAWjCZB1bFzAviyL?=
 =?us-ascii?Q?l8AxcADxgQ=3D=3D?=
X-OriginatorOrg: os.amperecomputing.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 21af4431-a0bc-4e3d-72db-08d9fb1b5e3c
X-MS-Exchange-CrossTenant-AuthSource: SA0PR01MB6329.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Mar 2022 00:35:21.9921
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: xUQN3eEzugMMQiUwMl4/Z7L+cPoS/5tfaoB8TrqtwUaRZw81MIxTXjRGnkqCeexLEGqq3jQzAw0vgYoTvyUmI+lrnPgy3iroJuheQqHLpu4yP9KGNFFzq7qXTPv5gSpN
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR01MB5219
X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,
        SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

After the feedback from Vincent and Barry, I wrote a version of this which
performed the test in topology.c and added an ACPI pptt API to detect ancestry
of cpu topology nodes. In the end, the new API felt forced and was inconsistent
with the other APIs, and the detection loop was pretty ugly with a lot corner
case cleanup. It seemed fragile and not very extensible.

This version follows the approach taken by other architectures: wait until smp
cpus are online and take advantage of the stored cpu_topology structure to make
sched domain topology decisions.

This adds a single point to test and decide on which sched domain topology
should be used for an arm64 system without impacting the scheduler code, acpi
code, or the construction of the cpu_topology structures. I think this is a
cleaner and less invasive solution which properly encapsulates the sched domain
topology decision in a way that is easy to maintain and extend over time.

Vincent did mention in an earlier version that by relying on cpumasks and
removing the MC sched domain, I didn't address possible future architectures
which may have clusters without shared cache and an MC level with shared cache.
In this version, I limit the removal of the MC level to topologies where the
coregroup weight is 1 (so it doesn't impact such future architectures). I also
think that by encapsulating the sched domain topology decision into a single
function after smp boot, it will be simple enough for someone to support such a
topology if and when it exists, allowing us to create a minimal solution to the
immediate problem of BUGing on the current topology.

Cc: Catalin Marinas <catalin.marinas@arm.com>
Cc: Will Deacon <will@kernel.org>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Vincent Guittot <vincent.guittot@linaro.org>
Cc: Barry Song <song.bao.hua@hisilicon.com>
Cc: Valentin Schneider <valentin.schneider@arm.com>
Cc: D. Scott Phillips <scott@os.amperecomputing.com>
Cc: Ilkka Koskinen <ilkka@os.amperecomputing.com>

Darren Hart (1):
  arm64: smp: Skip MC sched domain on SoCs with no LLC

 arch/arm64/kernel/smp.c | 28 ++++++++++++++++++++++++++++
 1 file changed, 28 insertions(+)

-- 
2.31.1