Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <1cec24f4-e4b1-682a-3ada-b51d2a7c83a4@intel.com>
Date:   Thu, 4 May 2023 12:04:32 -0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Firefox/102.0 Thunderbird/102.10.1
Subject: Re: [PATCH v4 6/7] x86/resctrl: Display CLOSID and RMID for the
 resctrl groups
Content-Language: en-US
To:     Babu Moger <babu.moger@amd.com>, <corbet@lwn.net>,
        <tglx@linutronix.de>, <mingo@redhat.com>, <bp@alien8.de>
CC:     <fenghua.yu@intel.com>, <dave.hansen@linux.intel.com>,
        <x86@kernel.org>, <hpa@zytor.com>, <paulmck@kernel.org>,
        <akpm@linux-foundation.org>, <quic_neeraju@quicinc.com>,
        <rdunlap@infradead.org>, <damien.lemoal@opensource.wdc.com>,
        <songmuchun@bytedance.com>, <peterz@infradead.org>,
        <jpoimboe@kernel.org>, <pbonzini@redhat.com>,
        <chang.seok.bae@intel.com>, <pawan.kumar.gupta@linux.intel.com>,
        <jmattson@google.com>, <daniel.sneddon@linux.intel.com>,
        <sandipan.das@amd.com>, <tony.luck@intel.com>,
        <james.morse@arm.com>, <linux-doc@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>, <bagasdotme@gmail.com>,
        <eranian@google.com>, <christophe.leroy@csgroup.eu>,
        <jarkko@kernel.org>, <adrian.hunter@intel.com>,
        <quic_jiles@quicinc.com>, <peternewman@google.com>
References: <168177435378.1758847.8317743523931859131.stgit@bmoger-ubuntu>
 <168177449635.1758847.13040588638888054027.stgit@bmoger-ubuntu>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <168177449635.1758847.13040588638888054027.stgit@bmoger-ubuntu>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?c3lwYlFxanpGZHlaT0ZVS3M5MEg2YXdkVlNDQk9zaTBkRllDbjl3OUo5dUZR?=
 =?utf-8?B?aEpUeitnVXRZTlR5U0RyODVZenFoZmE5Q1RkMk1ldUpob2VHdzlrL01VRERa?=
 =?utf-8?B?SkhubFVIWmV6YXpsdXVJV2xqRE9CR2ExeDBjTUlBMVlUYm5sYngvS2w1NXZy?=
 =?utf-8?B?K082S3FsbUpZNHVXM2t1VWorSG9weTlFN1Vtckgvb2NwaUptNHl3WW5xR2hW?=
 =?utf-8?B?V3hvUUQ5TnhGbE5VQndXYjQzb20zSld0bzFweVI1cDBxRTNRb3RqUzFCcjRO?=
 =?utf-8?B?T2UyTDNSZ3dhbVRTN2ZkUTlHVXFxUkZSUGM0WEo1aTJEZkp5NzVvbUhKTHNM?=
 =?utf-8?B?VXljeVk3emM4UTNzTk4wUEVROWExOUJNdHdRWmFhanRScU0rVTYvVGhYZWN0?=
 =?utf-8?B?UnYxRzlGd1NkZXFzOVRyQWxZdjhuNFFBSG1sTm5YeTlUNkY5MlUrNUhLTHEv?=
 =?utf-8?B?aXpZYVFCakFweWxvOEVsQUJNOWs1OUxyRC9jckhqcWo5ZXh1MEFVQjMyV21Q?=
 =?utf-8?B?SUlZbUhEcXVNT2F1WVJ5NVNXRk02LzFIRHZhTnBKVFB2bEVvcXFiMlViM2RX?=
 =?utf-8?B?MnQxbWR3aHp6NmFQYWhtdkYxUTYrQWdQaURHU3FDazFjZThONUg5VGZXRWtk?=
 =?utf-8?B?RDNBQnNuRC9EUSt0Zkh2OEI4V0RCVkpqUEVzQ0tRU2NZbXpIWlRBUExEb2tr?=
 =?utf-8?B?OHM2dTJXZjZIcGVoSCtlV0o4enRpcEthYXpYbU1ZOUZEeGpVd3d1eHVSSzU5?=
 =?utf-8?B?ZGxEbHBBQ2FjalhmQ2t3NUhIM056VzFzRng5QlJxS1lVOFZ0c1JPRlNaSUJs?=
 =?utf-8?B?V1dyTU9Wa01PTmNSVXZHTyt0Wk1Gd09JVTY1VW5YNjNtdGpwaFU3WFgvU2NO?=
 =?utf-8?B?NDdIdElTQkprVFJoVXRTbllBNHUvNzZLRERJcmZIdU9Ea09RSGovQmlvQkxu?=
 =?utf-8?B?MGp4R2VwSDA4SUZCZzJHTTNOR29UaGoyTTN2MWV3VzNCMmcxdjdJWWdDUkFK?=
 =?utf-8?B?Qi85dHliOVFFWlhkRmJETXZJVnE3QjAxK3NHbHBSaXZtVmFhVnB5SFNCUk9D?=
 =?utf-8?B?eTFoQ1JLU2lqcmVvbVpnYWZISHFlYlFwalhnVURLMzFIcmtPajVOU0RYbGcv?=
 =?utf-8?B?OXhTZ081SDJxd0tWNTRFWFpuQXc1KzNsZUZVb1BqRzIwakhJSEJXQitGUXg5?=
 =?utf-8?B?MURqb3gwYjQ2cU1mL2RCN3p0VnBMOTZSdXVlNER6bWhsb2hMSjlzUG5DL041?=
 =?utf-8?B?TVVKQjhNS2pvc0RlWXdXR0lncWlESWZhL3c1ZDhsUGgxUlVhK0FVWHpDSXc1?=
 =?utf-8?B?Q2tWcmt3dndJZ2NWdlNFR0pZVXFDdy9uUFdXWXhoSXZTd1FFTXZEaGVyaS9r?=
 =?utf-8?B?RkNtRmx5M3VTNC8zRWQ1Zmxkd3RJVys3ZTJCZHB5ZmJOMUtzT2FRbXhEZUlp?=
 =?utf-8?B?S3ZpTG13UXc3bHBqSGNUMWFaV0NkOXlUU2lyVHoxTURlTkZ0bVRObi8wRkNR?=
 =?utf-8?B?V2FVaVNwYzgyeEc3VXFkU2E3dWJwZ3lvZ1pwZWFEbmo0K1F0UXJYL2VXTTZx?=
 =?utf-8?B?UHN2NnFJN0NFOFl6Z0hkOEVCMHJqdmsrOXJvNVZkblYyLzM5TGpQMlFuRCto?=
 =?utf-8?B?cFprYTdZU1BnUklOWldFbVEydG1DZ1J0WFI3bzhDczA1R21hTktyUEp5dmVX?=
 =?utf-8?B?bU1UYXF4NzZlUUpkYmZlakptb0pvYXFYZDVZUmlONnE0RE5kc2Mvd1JlTXNW?=
 =?utf-8?B?Szdya3ZWWE1yaWU5RisxYmpwelFhNERwUmE3TGZhRWNWanN6OEVFbmtsVFMr?=
 =?utf-8?B?TkhIem16N01JYXlzU1duVnhKUVhFSDJTcUg4QzFrWXNMSldnNk1lYjNUd3FJ?=
 =?utf-8?B?VFlXZU93dDdZUmJyM0NaUUNTWUVvd1ljMXAyUFJ5U0UydjRmTDBkc1lYY1dD?=
 =?utf-8?B?SThCYVZoVW11VUgwdWJiZHZNMVV3UjhBU1V5eWV0NGMwTDQzWGhOT3VDWXNu?=
 =?utf-8?B?bWFmbmdWelU2MHJ4TFBnSjNIZlFsMXNMUlJLRmVPL1h5UU4wdXVOTUIvNHJh?=
 =?utf-8?B?cFFNaFVyT1Z2T2NPL0YrZEpqWDhOTmNZZE82RkNOVm5WT1I5M3pSZ29PdXVJ?=
 =?utf-8?B?WEZPY0xoNkdHTDBNblMyQ2hyZzNGVmNjUFdBa2krenpaVjhQVWVwalVhYlNh?=
 =?utf-8?B?UXc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 6c452a7b-a42c-4d61-4f2b-08db4cd266bc
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 May 2023 19:04:35.4979
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: JQQoiljsI5DEfhfh+26yCF8SV7UnMhC768nE6MMlOPVL7RAf89ZUTBqfbOHWdD79EhekPBZ/qtRW6W8OGRz8kTZnotgDFYuYmdyZqpDqCLQ=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA3PR11MB8004
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-8.8 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,
        RCVD_IN_DNSWL_MED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,
        SPF_NONE,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Babu,

On 4/17/2023 4:34 PM, Babu Moger wrote:
> When a user creates a control or monitor group, the CLOSID or RMID
> are not visible to the user. It can help to debug the issues in some
> cases. There are only available with "-o debug" option.

Please see: Documentation/process/maintainer-tip.rst

"It's also useful to structure the changelog into several paragraphs and not
lump everything together into a single one. A good structure is to explain
the context, the problem and the solution in separate paragraphs and this
order."

> 
> Add CLOSID(ctrl_hw_id) and RMID(mon_hw_id) to the control/monitor groups

Please highlight that CLOSID and RMID are x86 concepts.

> display in resctrl interface.
> $cat /sys/fs/resctrl/clos1/clos_hw_id
> 1

This example does not match what the patch does (clos_hw_id -> ctrl_hw_id).
I also think this change would be more palatable (to non x86 audience) if
the example resource group has a generic (non-x86 concept) name.

> $cat /sys/fs/resctrl/mon_groups/mon1/mon_hw_id
> 3
> 
> Signed-off-by: Babu Moger <babu.moger@amd.com>
> ---
>  Documentation/x86/resctrl.rst          |   17 ++++++++++++
>  arch/x86/kernel/cpu/resctrl/rdtgroup.c |   44 ++++++++++++++++++++++++++++++++
>  2 files changed, 61 insertions(+)
> 
> diff --git a/Documentation/x86/resctrl.rst b/Documentation/x86/resctrl.rst
> index be443251b484..5aff8c2beb08 100644
> --- a/Documentation/x86/resctrl.rst
> +++ b/Documentation/x86/resctrl.rst
> @@ -345,6 +345,14 @@ When control is enabled all CTRL_MON groups will also contain:
>  	file. On successful pseudo-locked region creation the mode will
>  	automatically change to "pseudo-locked".
>  
> +"ctrl_hw_id":
> +	Available only with debug option. On x86, reading this file shows
> +	the Class of Service (CLOS) id which acts as a resource control
> +	tag on which the resources can be throttled. Kernel assigns a new
> +	CLOSID a control group is created depending on the available
> +	CLOSIDs. Multiple cores(or threads) or processes can share a
> +	same CLOSID in a resctrl group.

Please keep other content from the documentation in mind when making
this change. CLOSID is already documented, including the fact that it
is a limited resource. Please see content under: "Notes on cache occupancy
monitoring and control" where it, for example, states that "The number
of CLOSid and RMID are limited by the hardware."

Considering this the above could just read:
"Available only with debug option. The identifier used by hardware 
 for the control group. On x86 this is the CLOSID."

Similar feedback to the "mon_hw_id" portion.

Reinette