Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:6 as permitted sender) client-ip=2620:137:e000::3:6;
Message-ID: <4bca7ca1-d452-4cb7-b721-b2273f9a71b5@intel.com>
Date:   Tue, 5 Dec 2023 15:18:16 -0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 01/15] x86/resctrl: Remove hard-coded memory bandwidth
 limit
Content-Language: en-US
To:     Babu Moger <babu.moger@amd.com>, <corbet@lwn.net>,
        <fenghua.yu@intel.com>, <tglx@linutronix.de>, <mingo@redhat.com>,
        <bp@alien8.de>, <dave.hansen@linux.intel.com>
CC:     <x86@kernel.org>, <hpa@zytor.com>, <paulmck@kernel.org>,
        <rdunlap@infradead.org>, <tj@kernel.org>, <peterz@infradead.org>,
        <seanjc@google.com>, <kim.phillips@amd.com>, <jmattson@google.com>,
        <ilpo.jarvinen@linux.intel.com>, <jithu.joseph@intel.com>,
        <kan.liang@linux.intel.com>, <nikunj@amd.com>,
        <daniel.sneddon@linux.intel.com>, <pbonzini@redhat.com>,
        <rick.p.edgecombe@intel.com>, <rppt@kernel.org>,
        <maciej.wieczor-retman@intel.com>, <linux-doc@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>, <eranian@google.com>,
        <peternewman@google.com>, <dhagiani@amd.com>
References: <20231201005720.235639-1-babu.moger@amd.com>
 <20231201005720.235639-2-babu.moger@amd.com>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <20231201005720.235639-2-babu.moger@amd.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?QmM5RVZHdUNJU3k4L2xsbDRmTld5UGplOC8ya3plWXZvaTllcnZNdGRyaDFL?=
 =?utf-8?B?bmFxcG1GVVpadk5iMms4U0RYNXFFYU9RVDI4Q1Q5ZU5MY1BNMEdPMWNyRUs3?=
 =?utf-8?B?eVdyQ1dvaFdtL2VhbnAzazJ2TmFyWEgzOTFEVU8walNXR3M0TU0yQzdyN2lG?=
 =?utf-8?B?WVYwOVJKNHNsbmUxWTRoMkliU3NjOHVHNDZYdGx2WWRadFVqSDFZS3FrOFla?=
 =?utf-8?B?dzkwQysxWEZ5OFBYRlJob3l3UUJVTlNCV3FPR1lHZzRBN21rTDdZTFNUWXVn?=
 =?utf-8?B?clAxcEVUcExMcjF2YUVvdm1NSy9EdGM2VjZHSnFWT3lJclV6Ymt3eDl3ZlNa?=
 =?utf-8?B?a2hITWcvdU5OWUU0Ui95UlZhMHd6Z3hlWkQ5Z0U0bUMvZWVFWW4xUGZPdmZO?=
 =?utf-8?B?NlFuYVgwL1Z5clhQOVVablErTVkwNFZIWWNWN3Raa25JaXFvN0M1cDRQR2pm?=
 =?utf-8?B?K1p3SThXUGh5c3ozUlUrc2JLcHlOVERMR1FZb0JnMk9kVzRESWZUSUtyaDdT?=
 =?utf-8?B?cFhaZy9TMTI0aEtTU213Rk02QUhUcUVJUmlkUnBtK2QwNm0vam1DMUN6OHNS?=
 =?utf-8?B?UUlEcGlTeWJXNHZoY0M4dHFaUURxMUFhZkFvRmpHUXR0TUx2T25zREZSUEtE?=
 =?utf-8?B?QjNsSkVXaUJCc1pXa2lITlFTZWs5T1A0bFNya2poQk51d20xdktVVzVBdFhF?=
 =?utf-8?B?MWY0RGwwVUZ0QUVlSGp3L2tlZnFFZk4xN0tSVUwxVnMrcEYvODdaRXNyc2Ri?=
 =?utf-8?B?L0dxMDYzRTdyUzl1NGVuODFpc044TnpjbmRLNlU4TjdnS2l0eFNiVHVieW9w?=
 =?utf-8?B?TUFNZXJyaTl4ektjNytKSDJyUE00V3U2Y1d6UzRXNmZLMTZTOWE4K3NDbUJX?=
 =?utf-8?B?dzMzRGZ6V0dod3N4OUtud1RQOVM5YUZjeEVJTlppMTNmd3VYK1l1VUZaQWlp?=
 =?utf-8?B?ckp0d3RGR2wzS0xhWkpyTmowVW8yUDZIemVZOWRKdHo1bnZkd0duWnhqcHZm?=
 =?utf-8?B?dmp3WUhDbGJQcXhkRDU2My9RaGZha0NqM3RWaTZWTUVLYnpUdktPWWRUTkZM?=
 =?utf-8?B?dFJiS1doWUVZTkd2THFUYlJvMXkyQmxMSndIT2NIN3J6U1VnQUU2Y2k1bUNU?=
 =?utf-8?B?Yzg2a3pRT0FtdUh1VnY0dlRidWJtSjVQdDlDWWZXSVZ2cEw1ZitEMnJqY2lN?=
 =?utf-8?B?QnFVTVNaakQvUWdrVXlSQmh4VTVRSzNZRFdBd3JiOWdSMk5tbC96K2p5VEVV?=
 =?utf-8?B?c0JQSjFPRzl6T1I1ZDlTVk82YWxDNm1idlppckF2d2RMQWJLZWJIM3loRTVE?=
 =?utf-8?B?aDBnU29ncjhCVVRTVzU0TEpWcHE1RkY3N3RtMnJjQURWMHVWNmJzK1RTQ1RB?=
 =?utf-8?B?K2FrTXRLOGxxRGdYdUdnbkJaY0VRRDQ5WE1Lb2Riemo3d24xS0o3SEVBcDNS?=
 =?utf-8?B?WWF5R3JVWGgzVCtCbEVkZ1V5TmFxeklKWUZKOWhtMTNDZ2l4ZTBwaS9sVW8v?=
 =?utf-8?B?eUZaTFAzQUl4UFhuTHZnckJ6MXFYbHNxTjF5ZTRoZUI4dHQrSld3RDFMUjNq?=
 =?utf-8?B?YnJBNXFpK1M2TmViL0FyMENxaVU0eEFoT0hXYkg2RGd1MDRZcE5hd05JdG55?=
 =?utf-8?B?eHRqVnl5OE5nWGVEcU5tUWdSNlVaMGhWRFZxOEhvYUFnVEdNdWw4VzF0OU9D?=
 =?utf-8?B?eGNGV1FmZkRIWlROR1NVTk9yZzFpZmdaMnZqYTV1b0p6YlhMdkl1ZTEwRUth?=
 =?utf-8?B?SUU4Q3V3YkNQaEtCOEthL3gzREVzYUo3TkpCdzNiOVJhZVBGSDRHTllndmVj?=
 =?utf-8?B?clhXWkk4UEZWN1BjbmxjN3czRld2ekdaTStmeWlia0E5WmtIVGg1T3VIRk9Y?=
 =?utf-8?B?bitwdmhGdkxhZVNlWHo2YWZiVTJTcHgxbUlGRldqZTI1VnNyajZ5VkFxd0w2?=
 =?utf-8?B?bWhnQWJWWHlNZWJPR21YOTgzTlJmQmthamIrVlFrVVlvVEFaZTZDRzZZenl3?=
 =?utf-8?B?ZGg1Vy9Wa0VOTk5lZDBsRG1QeCtuVk5KOVQ4dkR6TVV4UG9mZDU0bk9CemZH?=
 =?utf-8?B?L1RuNUsvY0xwUlF0cGNOZ0ZOS0sydkF2bkVzOXRxUjBQbUtKOXNncFRxaisz?=
 =?utf-8?B?Z3BqRG5pM0ZVM0o2cEJKdll6bEg1b0s5QjVtR1FtMzJ5aTNUa0gwMkdhR1dJ?=
 =?utf-8?B?T2c9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: d2418f5c-f5d0-47b6-5abc-08dbf5e876b6
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Dec 2023 23:18:17.7592
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: G3Q0KChKMdwrB9RAV/5AwlBYicdpB3+o4gn6lA6r8tZnCqzHg//85OzVOk6uVyGtygk9V36rga8MLVcyPBMvwHd/r1jACUUqF1YPTSz4dU8=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB7319
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE
	autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on pete.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (pete.vger.email [0.0.0.0]); Tue, 05 Dec 2023 15:18:43 -0800 (PST)

Hi Babu,

On 11/30/2023 4:57 PM, Babu Moger wrote:
> The QOS Memory Bandwidth Enforcement Limit is reported by
> CPUID_Fn80000020_EAX_x01.
> Bits Description
> 31:0 BW_LEN: Size of the QOS Memory Bandwidth Enforcement Limit.
> 
> Remove the hardcoded bandwidth limit value and detect using CPUID command.
> 
> The CPUID details are documentation in the PPR listed below [1].
> [1] Processor Programming Reference (PPR) Vol 1.1 for AMD Family 19h Model
> 11h B1 - 55901 Rev 0.25.
> 
> Fixes: 4d05bf71f157 ("x86/resctrl: Introduce AMD QOS feature")

What makes this change worthy of the "Fixes:" tag. What is the impact
of this? Does this mean that there is AMD hardware out there that is
not being used correctly? In this case it should be highlighted and
the stable folks included?

This also does not seem like it belongs in this series and should
be sent separately as a fix.

> Signed-off-by: Babu Moger <babu.moger@amd.com>
> Link: https://bugzilla.kernel.org/show_bug.cgi?id=206537
> ---
>  arch/x86/kernel/cpu/resctrl/core.c     | 2 +-
>  arch/x86/kernel/cpu/resctrl/internal.h | 1 -
>  2 files changed, 1 insertion(+), 2 deletions(-)
> 
> diff --git a/arch/x86/kernel/cpu/resctrl/core.c b/arch/x86/kernel/cpu/resctrl/core.c
> index 19e0681f0435..3fbae10b662d 100644
> --- a/arch/x86/kernel/cpu/resctrl/core.c
> +++ b/arch/x86/kernel/cpu/resctrl/core.c
> @@ -243,7 +243,7 @@ static bool __rdt_get_mem_config_amd(struct rdt_resource *r)
>  
>  	cpuid_count(0x80000020, subleaf, &eax.full, &ebx, &ecx, &edx.full);
>  	hw_res->num_closid = edx.split.cos_max + 1;
> -	r->default_ctrl = MAX_MBA_BW_AMD;
> +	r->default_ctrl = 1 << eax.full;

This does not seem appropriate. You are using eax because it
it convenient but if you take a look at its definition it does not
match the AMD CPUID instruction output at all.

>  
>  	/* AMD does not use delay */
>  	r->membw.delay_linear = false;
> diff --git a/arch/x86/kernel/cpu/resctrl/internal.h b/arch/x86/kernel/cpu/resctrl/internal.h
> index a4f1aa15f0a2..d2979748fae4 100644
> --- a/arch/x86/kernel/cpu/resctrl/internal.h
> +++ b/arch/x86/kernel/cpu/resctrl/internal.h
> @@ -18,7 +18,6 @@
>  #define MBM_OVERFLOW_INTERVAL		1000
>  #define MAX_MBA_BW			100u
>  #define MBA_IS_LINEAR			0x4
> -#define MAX_MBA_BW_AMD			0x800
>  #define MBM_CNTR_WIDTH_OFFSET_AMD	20
>  
>  #define RMID_VAL_ERROR			BIT_ULL(63)

Reinette