Received-SPF: pass (google.com: domain of linux-kernel+bounces-214160-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45e3:2400::1 as permitted sender) client-ip=2604:1380:45e3:2400::1;
Message-ID: <da81b315-a97f-4b43-84a2-5bb347bfafe0@intel.com>
Date: Thu, 13 Jun 2024 17:56:49 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v4 04/19] x86/resctrl: Detect Assignable Bandwidth
 Monitoring feature details
To: Babu Moger <babu.moger@amd.com>, <corbet@lwn.net>, <fenghua.yu@intel.com>,
	<tglx@linutronix.de>, <mingo@redhat.com>, <bp@alien8.de>,
	<dave.hansen@linux.intel.com>
CC: <x86@kernel.org>, <hpa@zytor.com>, <paulmck@kernel.org>,
	<rdunlap@infradead.org>, <tj@kernel.org>, <peterz@infradead.org>,
	<yanjiewtw@gmail.com>, <kim.phillips@amd.com>, <lukas.bulwahn@gmail.com>,
	<seanjc@google.com>, <jmattson@google.com>, <leitao@debian.org>,
	<jpoimboe@kernel.org>, <rick.p.edgecombe@intel.com>,
	<kirill.shutemov@linux.intel.com>, <jithu.joseph@intel.com>,
	<kai.huang@intel.com>, <kan.liang@linux.intel.com>,
	<daniel.sneddon@linux.intel.com>, <pbonzini@redhat.com>,
	<sandipan.das@amd.com>, <ilpo.jarvinen@linux.intel.com>,
	<peternewman@google.com>, <maciej.wieczor-retman@intel.com>,
	<linux-doc@vger.kernel.org>, <linux-kernel@vger.kernel.org>,
	<eranian@google.com>, <james.morse@arm.com>
References: <cover.1716552602.git.babu.moger@amd.com>
 <0a73504f355a8b0b0b3d32f6c0e0b8909c552340.1716552602.git.babu.moger@amd.com>
Content-Language: en-US
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <0a73504f355a8b0b0b3d32f6c0e0b8909c552340.1716552602.git.babu.moger@amd.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?aXNCam1oem9YOGc2bGFpYlgwOHQ2TkxXbkFFRlRwWmVNQlZiSy9kRDlBcFN1?=
 =?utf-8?B?ZFdTRGl5T2pMWENZMVFPWjRFVmo4TlJSVHovU0Vya0M3ekRoQ28zNVhjTGVH?=
 =?utf-8?B?TFlKMk1vZzcwWk9zSEdJQWduN05oQWpmYmpPcHUwK0JFdytHUkc0c2pEM3l6?=
 =?utf-8?B?dnJXSkZyRFd3NW5LT01LRExaR3o2ZVJnVEg2a0E3V29hd1J5WmwrQURYQWpl?=
 =?utf-8?B?ODFvcjd6alI3TkpVSmFCNndJbEk0WVN4cWNzRERxV2RSVEUxS0Z3aENmbkUv?=
 =?utf-8?B?L2t4MXEwNERnYURTZE5TbUtMcVhmSVdJTEJObmMwaDJESUdwUVErV2tQOFFw?=
 =?utf-8?B?ZVRreTRmUjlGVzdKcTR2OTVXdXFaSFBxWVdXL3VkcjVCd29nZWZleDMwVURF?=
 =?utf-8?B?V091aGZ4VU44Ri9wVVBBUFN6SnhBbFhvNVltYnBxK3g0NlNXMHFJMlNpRDV4?=
 =?utf-8?B?Ti9jZDJmenJNNEdjV3BCWnVhaW9tbGhiY2ZpNEVSZUk5U0xiL21xYnlTQ0J6?=
 =?utf-8?B?TFhRL2xxRm5IU21kM0ErVHhrcDN1clY2aHU1cTZlN2h0NHNHeE9sNExhbkVx?=
 =?utf-8?B?TEQvWTdraHRSZ25xd3VSeVdFeTFrU0VMcUM3RDJuT1VJNnp6b201R0ZBdlZw?=
 =?utf-8?B?a3BvbzZmSE5aYnZTTllDRDRuTEZpMVQ2Nit0c0ZXSGVPd3RHamZzM0hXRWVK?=
 =?utf-8?B?MGF5ZUU1VWZpOFUzcmw2dWJGamJ1aHhQbFpSUUp1aDJkOUdqQkVKWC9FWTdq?=
 =?utf-8?B?TWwraDFKR0h6S1c2OEdYUUtKaFBkUmpzOEpzd2w2cW9TcGVLSEkwNUR0NnFE?=
 =?utf-8?B?aVlEeFZETk01T2Q1Yzh2MEUrOUJYTW91ZzhZcXFPOUczT0xja2Q0akk0RDB0?=
 =?utf-8?B?T09uL2dvMzIveHJwU0ZTUjBBV2pZRU0zNW8rcE1jeVdHYTlkK2Z6R1FvZU9h?=
 =?utf-8?B?MnEwdkJnQWNxRUNwUU1YblFnWDFVN2lFbmhSUzhXSkUvVWZNamVwK1ZoNlVr?=
 =?utf-8?B?RzhTYU1XYVlwdjQ0VlVPNnNKSXphYmgzNENUYjZPVkUrMnQ4NEx3eGhwWUpl?=
 =?utf-8?B?UUFYeElLbFBEeWpFS2tKUTBBOGRSbjR5NVp2ZWlTY1lPeTJGdlU2NUdCVmR6?=
 =?utf-8?B?QUxNY0ozOUZ6QjJ3RU5FekdNRnpLbW1KRmNjYmhsVk1Wa0FZMUo0YTVwaXRx?=
 =?utf-8?B?NEZxVm1vNFlPUjdqbG1uYXcwQzJ5S0dmaFJzT3BhMEduSStjS0dzc2ZHREtC?=
 =?utf-8?B?T1JYaWE3d1RTeXBEY0xQWENhTE9TcDNUSDRXa2ZmNzR4NEFUZDhkTVpUMzVK?=
 =?utf-8?B?Q0lpSjNhUGtseDdQeEZjNlU3OTZaS3NCcytIQmdIRHJiM2ZkQUtNbEsrL0Ir?=
 =?utf-8?B?MEZPWFdMQnhGbnV6c21kRTdEVlFxa2d4dnRkbSthbVhRdm8wNVpOOVBZUEJY?=
 =?utf-8?B?QzlsNDNBekZJSmkrUzc0ejdKUlJLdmxWeHFwZ0MwQmNBQ1luKytDU1dzQTNq?=
 =?utf-8?B?LzVYRVk3eHlXM1c0ZGpGNERCVEJJWXBZRGRuelEyRStybloyTVN0OTNmSFVj?=
 =?utf-8?B?WElzeFp0WVh3R1JXQnMxc2ZvQ0pYZWlZMXlmWEVhVHA0YnVpNGdDRm13ODVn?=
 =?utf-8?B?aU9QNHdHOVVjNG1ZRTRVZ3FhRDA5M3UrTDE3c3lRZSthOFBVOTdJUk1lYTFa?=
 =?utf-8?B?cWhnblRwa1F0c21lcHYrNUo2N2M3ZEZtM1RXd2U4dmNsTHl2UkxlaXpYMkZr?=
 =?utf-8?B?allxYnhEMlRoYVBDQTd0Tk5TOEhIeDlvTmFFcExjRDM1dGQraDFrOEl5Vkdl?=
 =?utf-8?B?UGh6TUtEcUlzNnludDBIckt6VW9zeVNuUmFyanhmMXdxcjBOMXppZTVIcGo2?=
 =?utf-8?B?YXhSWlhpZmJLeWxyR04rYU5KYitSbWxCaXNiUzZraGRmN1ZoSmJYTlBnOXJV?=
 =?utf-8?B?MkV0aWI3OWFTMkVGTUVhRGdXbUxIZE5NTFhHejg5OVVjeFc0L25XY3J2QXA3?=
 =?utf-8?B?b0UzTGFkbUZZdE5vRGxSNjJBUVd0MnE0NFF1czE0K0xZTldBaHcrRjlVK1Rh?=
 =?utf-8?B?TjV0ejlGNmU2UWgvQlRJajNnNEQwWGpwTWFWY3VDZFB3UitFeGZDU28yLzBE?=
 =?utf-8?B?clJzWkkwT0QraUtvakJMVEJjcmlOenhhbUczL0RnejBVV2ozMGdMUTRaZjUx?=
 =?utf-8?B?MlE9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: e1b7ff26-60fa-4be3-2310-08dc8c0ce16a
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Jun 2024 00:56:53.0007
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: Xw7W1Ju7Q4BaLMFZ4ouaK15cLKcGb3GuwmqEqao7PxpobYTGxamjFhTEajtdjzwGWM1eyXQ2bqeD7LbhXtgBJtVTikdM8lD1TGWCK5VL+v0=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR11MB6861
X-OriginatorOrg: intel.com

Hi Babu,

On 5/24/24 5:23 AM, Babu Moger wrote:
> ABMC feature details are reported via CPUID Fn8000_0020_EBX_x5.
> Bits Description
> 15:0 MAX_ABMC Maximum Supported Assignable Bandwidth
>       Monitoring Counter ID + 1
> 
> The feature details are documented in APM listed below [1].
> [1] AMD64 Architecture Programmer's Manual Volume 2: System Programming
> Publication # 24593 Revision 3.41 section 19.3.3.3 Assignable Bandwidth
> Monitoring (ABMC).
> 
> Link: https://bugzilla.kernel.org/show_bug.cgi?id=206537
> Signed-off-by: Babu Moger <babu.moger@amd.com>
> ---
> v4: Removed resctrl_arch_has_abmc(). Added all the code inline. We dont
>      need to separate this as arch code.
> 
> v3: Removed changes related to mon_features.
>      Moved rdt_cpu_has to core.c and added new function resctrl_arch_has_abmc.
>      Also moved the fields mbm_assign_capable and mbm_assign_cntrs to
>      rdt_resource. (James)
> 
> v2: Changed the field name to mbm_assign_capable from abmc_capable.
> ---
>   arch/x86/kernel/cpu/resctrl/monitor.c | 14 ++++++++++++++
>   include/linux/resctrl.h               |  4 ++++
>   2 files changed, 18 insertions(+)
> 
> diff --git a/arch/x86/kernel/cpu/resctrl/monitor.c b/arch/x86/kernel/cpu/resctrl/monitor.c
> index b35d04fc761b..1602b58ba23d 100644
> --- a/arch/x86/kernel/cpu/resctrl/monitor.c
> +++ b/arch/x86/kernel/cpu/resctrl/monitor.c
> @@ -1066,6 +1066,20 @@ int __init rdt_get_mon_l3_config(struct rdt_resource *r)
>   			mbm_local_event.configurable = true;
>   			mbm_config_rftype_init("mbm_local_bytes_config");
>   		}
> +
> +		if (rdt_cpu_has(X86_FEATURE_ABMC)) {
> +			r->abmc_capable = true;
> +			/*
> +			 * Query CPUID_Fn80000020_EBX_x05 for number of
> +			 * ABMC counters
> +			 */
> +			cpuid_count(0x80000020, 5, &eax, &ebx, &ecx, &edx);
> +			r->mon.num_cntrs = (ebx & 0xFFFF) + 1;
> +			if (r->mon.num_cntrs > 64) {
> +				WARN(1, "Cannot support more than 64 ABMC counters\n");

if (WARN_ON(...))

> +				r->mon.num_cntrs = 64;
> +			}
> +		}
>   	}
>   
>   	l3_mon_evt_init(r);
> diff --git a/include/linux/resctrl.h b/include/linux/resctrl.h
> index bf99eb9c6ce4..24087e6efbb6 100644
> --- a/include/linux/resctrl.h
> +++ b/include/linux/resctrl.h
> @@ -153,10 +153,12 @@ struct resctrl_schema;
>   /**
>    * struct resctrl_mon - Monitoring related data
>    * @num_rmid:		Number of RMIDs available
> + * @num_cntrs:		Maximum number of abmc counters

Maximum implies some limit and it is not clear what limit this applies to.
Can this just be "Number of monitoring counters".

Thinking ahead ... when switching between different "MBM modes" it
may be that one mode has a different number of counters than the other.
Since "ABMC" is just one mode it does not seem appropriate to
connect the "num_cntrs" property to ABMC.


>    * @evt_list:		List of monitoring events
>    */
>   struct resctrl_mon {
>   	int			num_rmid;
> +	int			num_cntrs;
>   	struct list_head	evt_list;
>   };
>   
> @@ -177,6 +179,7 @@ struct resctrl_mon {
>    * @parse_ctrlval:	Per resource function pointer to parse control values
>    * @fflags:		flags to choose base and info files
>    * @cdp_capable:	Is the CDP feature available on this resource
> + * @abmc_capable:	Is system capable of supporting monitor assignment?
>    */
>   struct rdt_resource {
>   	int			rid;
> @@ -196,6 +199,7 @@ struct rdt_resource {
>   						 struct rdt_domain *d);
>   	unsigned long		fflags;
>   	bool			cdp_capable;
> +	bool			abmc_capable;

Shouldn't abmc_capable be a property of the new struct resctrl_mon?

>   };
>   
>   /**

Reinette