Received: by 2002:a05:7412:b101:b0:e2:908c:2ebd with SMTP id az1csp2403542rdb; Tue, 14 Nov 2023 22:36:07 -0800 (PST) X-Google-Smtp-Source: AGHT+IHCLtYKA39RlTjqGBNvrB7DB3ij2OXyCvOUDf7C61IGAsrrOs+4Avth8QFvs78du8jLBWfH X-Received: by 2002:a05:6871:b1e:b0:1f4:b55c:46b4 with SMTP id fq30-20020a0568710b1e00b001f4b55c46b4mr15520560oab.43.1700030166645; Tue, 14 Nov 2023 22:36:06 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1700030166; cv=none; d=google.com; s=arc-20160816; b=MPGMMJRIIpB6MhhsnfPlcyuVB8znxh5hqRd8NgQU0DpzgXzvEKNMVUyhb0Bfv393mK d2yseKPPOTGc2TJoITc9mtIFVMU4M0rBDdcuo3PcTSl+4FA2z60Il5VqM3FL2IFIKE9F LIH0a83J97Lmziwa/PWOCDrjtB6Uiy2UgUH7oAGvfFHf7gc/oMtByusxCa5FRYoMmZIH pc/DSWB8Vw4ADqMrXm77709iDeATWstDIX8g1Or5DsBeofyQ4CGhRHF+68PvOYTJL93e 7GlbVx6pRr2bWClT2vRsBgNRWf8jpqB1Z9Tv1DyX+2PPADwu0xLq3myqTtGTYF/gB9d4 Qw3w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:message-id:date:references :in-reply-to:subject:cc:to:from:dkim-signature; bh=ut7fifdv33BYvwHtYbVTvqP5YI7gnOZ6t4YXoSMkfGI=; fh=W/GQjj5WqjEyjpWjQqt9d19EbZxDOCORuFYQmu98tcA=; b=D1fWfHu8f0ZwBN10KQ4MxJBZ9LE6ElpAfpxky0RNV0BcojOhUBe+te1hEf7Hct9/3y zbsqqtPy9V+1Qh2I1XYoJ88zk43o9qy8IKLBExj2mOF2Tq6ZNHtjG0VnVfwBz4q+FeGo YbyA3XFtkDUpNxWUza4JNiALNBOE5s7Bzm8cGuq1MqgkJeB9L8F1Yai6vnwocVbJ+5nb 3/gwYV1pihaPjxCGtucs2cUic7wNPx70MkXojyPbF1AJ2GHloKeWQyibxi+q/nzp9Wqo XHUePZQx5w/4SqanYKwAHebqKi1GVFoAfvlE58DP8jbljUs1o4Cf+6u7dFFtw5dmFrgx 8QOg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=J9SaU2Jp; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.35 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Return-Path: Received: from groat.vger.email (groat.vger.email. [23.128.96.35]) by mx.google.com with ESMTPS id 143-20020a630095000000b005c1cd55bef1si1044586pga.301.2023.11.14.22.36.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 14 Nov 2023 22:36:06 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.35 as permitted sender) client-ip=23.128.96.35; Authentication-Results: mx.google.com; dkim=pass header.i=@ibm.com header.s=pp1 header.b=J9SaU2Jp; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.35 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=ibm.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by groat.vger.email (Postfix) with ESMTP id B093380BB231; Tue, 14 Nov 2023 22:36:03 -0800 (PST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.11 at groat.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234545AbjKOGfz (ORCPT + 99 others); Wed, 15 Nov 2023 01:35:55 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:36952 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230364AbjKOGfx (ORCPT ); Wed, 15 Nov 2023 01:35:53 -0500 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 67721D9 for ; Tue, 14 Nov 2023 22:35:50 -0800 (PST) Received: from pps.filterd (m0353729.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 3AF67Gll003267; Wed, 15 Nov 2023 06:35:31 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : in-reply-to : references : date : message-id : mime-version : content-type; s=pp1; bh=ut7fifdv33BYvwHtYbVTvqP5YI7gnOZ6t4YXoSMkfGI=; b=J9SaU2JpwMgCY/5dsRzWMbkol7KCRf9wdd7xLUiIWX/YUyBYLofwS0xOcMdAnvBREfra lFjbXlcFhKQopKtaGTGuZu91oSx//nhH+fNKjc+nLRKpFH2zpBzG2ACVOV7pzgImfOqA HtM3XDz0Fk9gmHEQTRxDV+GyftyhkhSS73f7ZnSdX2WeG+r1WfMoLR5vwhb6PQqKKuy8 cHCF27UGA65OcdXBaS83rPyS4EZbPhYObCoh3uVjDnlZ/xNMH5GnhPfLlHHgcGn04PQp VuiimpweNZCBU0w8qBCq8LLWvlspdXSa0XTfdRQWDaRZF3EO5zQhOImaNRhSvQVOFpYn LQ== Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3ucrej0t1r-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 15 Nov 2023 06:35:30 +0000 Received: from m0353729.ppops.net (m0353729.ppops.net [127.0.0.1]) by pps.reinject (8.17.1.5/8.17.1.5) with ESMTP id 3AF67WWO004918; Wed, 15 Nov 2023 06:35:30 GMT Received: from ppma13.dal12v.mail.ibm.com (dd.9e.1632.ip4.static.sl-reverse.com [50.22.158.221]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3ucrej0t16-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 15 Nov 2023 06:35:30 +0000 Received: from pps.filterd (ppma13.dal12v.mail.ibm.com [127.0.0.1]) by ppma13.dal12v.mail.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 3AF4oQ5q026532; Wed, 15 Nov 2023 06:35:29 GMT Received: from smtprelay03.wdc07v.mail.ibm.com ([172.16.1.70]) by ppma13.dal12v.mail.ibm.com (PPS) with ESMTPS id 3uap5k4xr4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 15 Nov 2023 06:35:29 +0000 Received: from smtpav03.dal12v.mail.ibm.com (smtpav03.dal12v.mail.ibm.com [10.241.53.102]) by smtprelay03.wdc07v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 3AF6ZSIX16188122 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 15 Nov 2023 06:35:28 GMT Received: from smtpav03.dal12v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 1C23B58060; Wed, 15 Nov 2023 06:35:28 +0000 (GMT) Received: from smtpav03.dal12v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 2E2015803F; Wed, 15 Nov 2023 06:35:24 +0000 (GMT) Received: from skywalker.linux.ibm.com (unknown [9.43.109.250]) by smtpav03.dal12v.mail.ibm.com (Postfix) with ESMTP; Wed, 15 Nov 2023 06:35:23 +0000 (GMT) X-Mailer: emacs 29.1 (via feedmail 11-beta-1 I) From: "Aneesh Kumar K.V" To: Srikar Dronamraju , Michael Ellerman , Nicholas Piggin , Christophe Leroy Cc: Mark Rutland , Valentin Schneider , Vincent Guittot , Srikar Dronamraju , "Paul E. McKenney" , Peter Zijlstra , "ndesaulniers@google.com" , linux-kernel@vger.kernel.org, Rohan McLure , linuxppc-dev , Josh Poimboeuf Subject: Re: [PATCH v4 1/5] powerpc/smp: Enable Asym packing for cores on shared processor In-Reply-To: <20231109054938.26589-2-srikar@linux.vnet.ibm.com> References: <20231109054938.26589-1-srikar@linux.vnet.ibm.com> <20231109054938.26589-2-srikar@linux.vnet.ibm.com> Date: Wed, 15 Nov 2023 12:05:22 +0530 Message-ID: <87zfzf8qxh.fsf@linux.ibm.com> MIME-Version: 1.0 Content-Type: text/plain X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: QAZM2NYRk9by9piyiZQly4B8ZaTZku5C X-Proofpoint-GUID: XYYMQwFesiGHGZnDMijCfZBK3cm8Xvkm X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.987,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-11-15_04,2023-11-14_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 clxscore=1015 spamscore=0 lowpriorityscore=0 suspectscore=0 impostorscore=0 adultscore=0 phishscore=0 bulkscore=0 mlxscore=0 malwarescore=0 priorityscore=1501 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311060000 definitions=main-2311150048 X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on groat.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (groat.vger.email [0.0.0.0]); Tue, 14 Nov 2023 22:36:03 -0800 (PST) Srikar Dronamraju writes: > If there are shared processor LPARs, underlying Hypervisor can have more > virtual cores to handle than actual physical cores. > > Starting with Power 9, a big core (aka SMT8 core) has 2 nearly > independent thread groups. On a shared processors LPARs, it helps to > pack threads to lesser number of cores so that the overall system > performance and utilization improves. PowerVM schedules at a big core > level. Hence packing to fewer cores helps. > > For example: Lets says there are two 8-core Shared LPARs that are > actually sharing a 8 Core shared physical pool, each running 8 threads > each. Then Consolidating 8 threads to 4 cores on each LPAR would help > them to perform better. This is because each of the LPAR will get > 100% time to run applications and there will no switching required by > the Hypervisor. > > To achieve this, enable SD_ASYM_PACKING flag at CACHE, MC and DIE level > when the system is running in shared processor mode and has big cores. > > Signed-off-by: Srikar Dronamraju > --- > Changelog: > v3 -> v4: > - Dont use splpar_asym_pack with SMT > - Conflict resolution due to rebase > (DIE changed to PKG) > v2 -> v3: > - Handle comments from Michael Ellerman. > - Rework using existing cpu_has_features static key > v1->v2: Using Jump label instead of a variable. > > arch/powerpc/kernel/smp.c | 37 +++++++++++++++++++++++++++++-------- > 1 file changed, 29 insertions(+), 8 deletions(-) > > diff --git a/arch/powerpc/kernel/smp.c b/arch/powerpc/kernel/smp.c > index ab691c89d787..69a3262024f1 100644 > --- a/arch/powerpc/kernel/smp.c > +++ b/arch/powerpc/kernel/smp.c > @@ -993,16 +993,20 @@ static bool shared_caches; > /* cpumask of CPUs with asymmetric SMT dependency */ > static int powerpc_smt_flags(void) > { > - int flags = SD_SHARE_CPUCAPACITY | SD_SHARE_PKG_RESOURCES; > + if (!cpu_has_feature(CPU_FTR_ASYM_SMT)) > + return SD_SHARE_CPUCAPACITY | SD_SHARE_PKG_RESOURCES; > > - if (cpu_has_feature(CPU_FTR_ASYM_SMT)) { > - printk_once(KERN_INFO "Enabling Asymmetric SMT scheduling\n"); > - flags |= SD_ASYM_PACKING; > - } > - return flags; > + return SD_SHARE_CPUCAPACITY | SD_SHARE_PKG_RESOURCES | SD_ASYM_PACKING; > } > #endif > Only relevant change there is dropping printk_once(). Rest of the changes are not needed? -aneesh