Received-SPF: pass (google.com: domain of linux-kernel+bounces-214186-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1;
Message-ID: <a453b19b-a909-49a5-9512-ae69c48db6c2@intel.com>
Date: Thu, 13 Jun 2024 18:40:49 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v4 08/19] x86/resctrl: Introduce the interface to display
 monitor mode
To: Babu Moger <babu.moger@amd.com>, <corbet@lwn.net>, <fenghua.yu@intel.com>,
	<tglx@linutronix.de>, <mingo@redhat.com>, <bp@alien8.de>,
	<dave.hansen@linux.intel.com>
CC: <x86@kernel.org>, <hpa@zytor.com>, <paulmck@kernel.org>,
	<rdunlap@infradead.org>, <tj@kernel.org>, <peterz@infradead.org>,
	<yanjiewtw@gmail.com>, <kim.phillips@amd.com>, <lukas.bulwahn@gmail.com>,
	<seanjc@google.com>, <jmattson@google.com>, <leitao@debian.org>,
	<jpoimboe@kernel.org>, <rick.p.edgecombe@intel.com>,
	<kirill.shutemov@linux.intel.com>, <jithu.joseph@intel.com>,
	<kai.huang@intel.com>, <kan.liang@linux.intel.com>,
	<daniel.sneddon@linux.intel.com>, <pbonzini@redhat.com>,
	<sandipan.das@amd.com>, <ilpo.jarvinen@linux.intel.com>,
	<peternewman@google.com>, <maciej.wieczor-retman@intel.com>,
	<linux-doc@vger.kernel.org>, <linux-kernel@vger.kernel.org>,
	<eranian@google.com>, <james.morse@arm.com>
References: <cover.1716552602.git.babu.moger@amd.com>
 <3b9ef8bc03c1004794a087537c6f2f051760402d.1716552602.git.babu.moger@amd.com>
From: Reinette Chatre <reinette.chatre@intel.com>
Content-Language: en-US
In-Reply-To: <3b9ef8bc03c1004794a087537c6f2f051760402d.1716552602.git.babu.moger@amd.com>
Content-Type: text/plain; charset="UTF-8"; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?eWNuUnF4WEh6c0VTZ0RXUEQwcU9qczYzb0RjbGNlQnQxQnRoZk5DQXpFbTBN?=
 =?utf-8?B?QmtFajdyckMzOFFQTzBZd1RuWXpnVnpBT2JDdHVvd1l0YVhTaGlNU1ZCUHN3?=
 =?utf-8?B?aFExWjh6c2k3VTlHM05jYU5oVFFUMHRkcWI4dGk2RE1OU3czNGVBdStLeHdS?=
 =?utf-8?B?UzQ1L1g0alRlVmlhVzlFU3oyYWhsaEJzclJ2TGlJTUt0dDAwc1hTQUNrZlZw?=
 =?utf-8?B?RDZCS0ZvODNmK1dIZFpHam41bm0wSXpCYklDN0tMMGRQTmh0UXg1ZXErTXJ1?=
 =?utf-8?B?bnFEM2R0ellqVlRaNVA2MXQ2U3hjUmNJUnBSZ0x4VWpNUWhyUC9VQ05rNXVz?=
 =?utf-8?B?dnk3K0NaemV3eTZaWkdGZ1hRWnE5dFpuTzhpZ0xFVnBMNDhtT1haVC9Xckkv?=
 =?utf-8?B?R1h1Q2RLcWVkOFp1OUV0VFRGY3EyVjlyU1lKV1Q1d3BEQ3Y5MUthU2Q5UTFi?=
 =?utf-8?B?OHRRam82amxScFk4WUJKaE9qbXA5ODUvMlIyQURLc2pCZW53U3JmNFIydy9P?=
 =?utf-8?B?MHdSTEwvcXovN1lpZ3VENCtxSmpRMEo0OU1pdDJSdnAwQjFlOUNwODN1WHd0?=
 =?utf-8?B?VjgvOSs5Nk1oODJqZDdpLzZPdk5zc01RUVV2YUtLdDc2R3JnQytmV3Rsa0pF?=
 =?utf-8?B?b3FmQlhxa21xNWxYRk0vOE5oMVU5TUxvRWtWRXpNT0Q1R0NTcDluS2JZNjZo?=
 =?utf-8?B?Zm5IbEY1bG5IWm9tVG53eE05SS9Ddm12aE1LRDRET201aFFaTXcvWEpSaHVy?=
 =?utf-8?B?ajVQMnVyOGNlS2lQRnZYdC94WlEyNWgreGdFb2IxUmhaeFJVSWtaTng3b2No?=
 =?utf-8?B?OFgza0hkMFN3bm55bzJ6YXRXeXhqUVNWYTdJWkhqendpZ3hSbThpT3I0S3Mv?=
 =?utf-8?B?K2N6SG5LSjREU2dCTGRHbDdXamlLZGlvMTRraWJteWVtVHAzYWZTYjc1S0tv?=
 =?utf-8?B?L3doT2N6cWlLV1hvdXRrNTJTVmJHVmpwZVRJbXFNNWc5T1paWXRjeHFuSHYy?=
 =?utf-8?B?OXFhL3oxMUFqbTVJZE11NHJDclBsL3paL2k5V0pUZ1lwRnNZTEVjdVc5Skhi?=
 =?utf-8?B?ZjgwN3NMMEt3eHFXRFRPdkNFZ0pGbFJRaVpYT3JWRllHamxJei9Vakw3L2VJ?=
 =?utf-8?B?ckwrOS9CYnYwZ2cza0xOd0ZESWN4S1I2eXRxRFc0blNTM0RoR2x3aWtuc1Y5?=
 =?utf-8?B?cHZ0alJhRzJ4V25tR2svOUNQWm0yMjFHT2kzYzUvcXJxUEtlcHp1ZjBGckJ6?=
 =?utf-8?B?U0JwN3R6K1dhOHhGZmhsYlJwN3I4bWhWVTYyYXE1ZjkzdGZ2Mmx6WjViWFFS?=
 =?utf-8?B?WkIxYW1HaUJ2SGZoRFZKK2RQNzJCa1ZEeHdKZkVZWmx1SU41R1J1Y3JVQ1NI?=
 =?utf-8?B?TDFqaFByZXN0bnlrYWx1ckpDZ01XZE1QV0tjbjMydGhZOHpBdWJUSVc3RTgx?=
 =?utf-8?B?OUM2SGlHRUF1UkRrbzFiYXdHa3cyMThwdjE2SGdWN3ZSbCtqdndITVBuSmNH?=
 =?utf-8?B?czJjMEdoSjNuTk9GSG5mU2NvWWpvblZSRFlzZVpjY1Q1RXJwVEdLYWpVK2Zi?=
 =?utf-8?B?bnYyMEx6SFd1MkdNempHaVB4Z1pHTkhWSTllUFlpdHRQU3VnWVQvaExRRUd1?=
 =?utf-8?B?WEdMV1hmSEVaZlZLZi80Vjc1S25FUmNkbnc1cVlmSS80empzS08wanJnRzl0?=
 =?utf-8?B?OHFhRDczVEswaG02NkE5ZEVKSmM3NUkwM1M4ZEQ4YjFNVjluOTZ5TXB0elZX?=
 =?utf-8?B?Ukd6YlFZVzVtbGMxbHQ0WWN6c1R0djkwRWtVaXJ6ZndDZXRWR1J4WlVjSVVM?=
 =?utf-8?B?Vis0ZVNpUVdQNlppS1Bka1RpbnFkUlJyMWhzNVJhWlcyS0JJeG5CZDNZZ0E1?=
 =?utf-8?B?Snd3S2szYWRoSGFLK3dVMElhUkFQa3J6SEh5WjN1VFBtOWdLVjl2Sll3MDgv?=
 =?utf-8?B?R2Z0ODd5a3Z0MGY2eTc0VEJLWlVrbFpwTkIyWFU5S0pBeXB0K2ZmSjg2OUZ5?=
 =?utf-8?B?d2ZaTlZzVVNPN0o3eU95UnNDN0tqeUV1dGhRSjhrVHExNnVaS0crN0I4Nnhk?=
 =?utf-8?B?R3BodzlIYnVFY0lCdDcyellNRnpPSTJPVDN3Z0lGaDhoMEZraG9wUHJ0WE1k?=
 =?utf-8?B?cTBsSXR0VWtxMDlWaTZKQjNTVWxIV0piaFdkNjkvY1R2a3pqdXV6U1psM05W?=
 =?utf-8?B?M0E9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 4471b0e9-252d-47fa-a594-08dc8c130b00
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Jun 2024 01:40:59.8001
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: qAvDUBuAyjKLAfju8hJLF0zulku3AH5mbygSOfWm8UJ86i4VMCVDr7yaLIoA9aiGRazzH3jvBsOzzPpMkcizjusPUePArbdjzprynaCYYJw=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR11MB6885
X-OriginatorOrg: intel.com

Hi Babu,

On 5/24/24 5:23 AM, Babu Moger wrote:
> The ABMC feature provides an option to the user to assign a hardware
> counter to an RMID and monitor the bandwidth as long as it is assigned.
> ABMC mode is enabled by default when supported. System can be one mode
> at a time (Legacy monitor mode or ABMC mode).
> 
> Provide an interface to display the monitor mode on the system.
>      $cat /sys/fs/resctrl/info/L3_MON/mbm_assign
>      [abmc]
>      legacy

Output is different from cover letter and what this patch implements.

> 
> Signed-off-by: Babu Moger <babu.moger@amd.com>
> ---
> v4: Fixed the checks for legacy and abmc mode. Default it ABMC.
> 
> v3: New patch to display ABMC capability.
> ---
>   Documentation/arch/x86/resctrl.rst     | 10 ++++++++++
>   arch/x86/kernel/cpu/resctrl/monitor.c  |  1 +
>   arch/x86/kernel/cpu/resctrl/rdtgroup.c | 23 +++++++++++++++++++++++
>   3 files changed, 34 insertions(+)
> 
> diff --git a/Documentation/arch/x86/resctrl.rst b/Documentation/arch/x86/resctrl.rst
> index 7ab8172ef208..ab3cde61a124 100644
> --- a/Documentation/arch/x86/resctrl.rst
> +++ b/Documentation/arch/x86/resctrl.rst
> @@ -261,6 +261,16 @@ with the following files:
>   	Available when ABMC feature is supported. The number of ABMC counters
>   	available for configuration.
>   
> +"mbm_assign":

This name is not ideal but I am having trouble finding a better one ... I have
seen you use "monitor mode" a couple of times (even in shortlog), so maybe that
could be the start of a more generic name? "mbm_mode"?

> +	Available when ABMC feature is supported. Reports the list of assignable

Why not always make this file available? At least it will display that
legacy mode is supported and it gives user space an always present file to query to
determine support.

> +	monitoring features supported. The enclosed brackets indicate which
> +	feature is enabled.
> +	::
> +
> +	  cat /sys/fs/resctrl/info/L3_MON/mbm_assign
> +	  [abmc]
> +	  mbm_legacy
> +
>   "max_threshold_occupancy":
>   		Read/write file provides the largest value (in
>   		bytes) at which a previously used LLC_occupancy
> diff --git a/arch/x86/kernel/cpu/resctrl/monitor.c b/arch/x86/kernel/cpu/resctrl/monitor.c
> index e75a6146068b..b1d002e5e93d 100644
> --- a/arch/x86/kernel/cpu/resctrl/monitor.c
> +++ b/arch/x86/kernel/cpu/resctrl/monitor.c
> @@ -1071,6 +1071,7 @@ int __init rdt_get_mon_l3_config(struct rdt_resource *r)
>   
>   		if (rdt_cpu_has(X86_FEATURE_ABMC)) {
>   			r->abmc_capable = true;
> +			resctrl_file_fflags_init("mbm_assign", RFTYPE_MON_INFO);
>   			/*
>   			 * Query CPUID_Fn80000020_EBX_x05 for number of
>   			 * ABMC counters
> diff --git a/arch/x86/kernel/cpu/resctrl/rdtgroup.c b/arch/x86/kernel/cpu/resctrl/rdtgroup.c
> index 9148d1234ede..3071bbb7a15e 100644
> --- a/arch/x86/kernel/cpu/resctrl/rdtgroup.c
> +++ b/arch/x86/kernel/cpu/resctrl/rdtgroup.c
> @@ -856,6 +856,23 @@ static int rdtgroup_num_cntrs_show(struct kernfs_open_file *of,
>   	return 0;
>   }
>   
> +static int rdtgroup_mbm_assign_show(struct kernfs_open_file *of,
> +				    struct seq_file *s, void *v)
> +{
> +	struct rdt_resource *r = of->kn->parent->priv;
> +	struct rdt_hw_resource *hw_res = resctrl_to_arch_res(r);

Please use arch helper to just get abmc state instead of fs code
digging into arch structures.

> +
> +	if (hw_res->abmc_enabled) {
> +		seq_puts(s, "[abmc]\n");
> +		seq_puts(s, "mbm_legacy\n");
> +	} else {
> +		seq_puts(s, "abmc\n");
> +		seq_puts(s, "[mbm_legacy]\n");
> +	}
> +
> +	return 0;
> +}
> +
>   #ifdef CONFIG_PROC_CPU_RESCTRL
>   
>   /*
> @@ -1913,6 +1930,12 @@ static struct rftype res_common_files[] = {
>   		.seq_show	= mbm_local_bytes_config_show,
>   		.write		= mbm_local_bytes_config_write,
>   	},
> +	{
> +		.name		= "mbm_assign",
> +		.mode		= 0444,
> +		.kf_ops		= &rdtgroup_kf_single_ops,
> +		.seq_show	= rdtgroup_mbm_assign_show,
> +	},
>   	{
>   		.name		= "cpus",
>   		.mode		= 0644,

Reinette