Received-SPF: pass (google.com: domain of linux-kernel+bounces-106760-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <7f15a700-f23a-48f9-b335-13ea1735ad84@intel.com>
Date: Mon, 18 Mar 2024 15:43:28 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 4/4] selftests/resctrl: Adjust SNC support messages
Content-Language: en-US
To: "Luck, Tony" <tony.luck@intel.com>, James Morse <james.morse@arm.com>
CC: "Wieczor-Retman, Maciej" <maciej.wieczor-retman@intel.com>, "Yu, Fenghua"
	<fenghua.yu@intel.com>, Shuah Khan <shuah@kernel.org>,
	"ilpo.jarvinen@linux.intel.com" <ilpo.jarvinen@linux.intel.com>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"linux-kselftest@vger.kernel.org" <linux-kselftest@vger.kernel.org>
References: <SJ1PR11MB608310C72D7189C139EA6302FC212@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <SJ1PR11MB60832DAD58E864F99A16FCC4FC202@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <0393c4ce-7e41-4dcc-940a-a6bea9437970@intel.com>
 <SJ1PR11MB6083AACB10645E41DD3F9639FC202@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <55a55960-8bb1-4ce2-a2c7-68e167da8bcc@intel.com>
 <ZepK4mtoV_J8-UbE@agluck-desk3>
 <eacdc287-24bd-4137-85c8-df055cfd78b1@arm.com>
 <ZetcM9GO2PH6SC0j@agluck-desk3>
 <88430722-67b3-4f7d-8db2-95ee52b6f0b0@arm.com>
 <47c28b3d-3b90-4b33-ba71-1e359d43238e@intel.com>
 <SJ1PR11MB60832422CBDCCDA580010769FC2D2@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <6948784d-6a20-435a-8781-30f324bed472@intel.com>
 <SJ1PR11MB608303C5E0BEB42CAC5B02BAFC2D2@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <SJ1PR11MB6083FAA69AF7F712B34CA292FC2D2@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <176e6031-c95f-4c75-9857-5f8fe6c4e67a@intel.com>
 <SJ1PR11MB608309F47C00F964E16205D6FC2D2@SJ1PR11MB6083.namprd11.prod.outlook.com>
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <SJ1PR11MB608309F47C00F964E16205D6FC2D2@SJ1PR11MB6083.namprd11.prod.outlook.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?MzF4M3dseU9hTStzN0dTZEZZc2cyN1g1aUd1U2t6NE1qUG5uUy9mdHgwWThV?=
 =?utf-8?B?Q1J5YlJUYkdXOFVxUE9tM3JvcXg0VGxmV2xoUWlCQmYyVU1lQmxiWnRYZ0lh?=
 =?utf-8?B?ZDRldzdBUFpzWVExYVJKM040eG5QcUl6TTV5K1BpL0NUSHlHdEJRR2pGK0JO?=
 =?utf-8?B?SFV6Q0RJZ0lYV09UeUdIWk5vWE1RcEtuY29oK3pNTTdudlg1Mi9EY3JXL0p6?=
 =?utf-8?B?MlducGVCS21HUkh1SVNhUUxYR1kwcXhtNlptdnMvNCtFTDI1T21XQStvZllp?=
 =?utf-8?B?TDFma1VSTWJxc00xWXQ2blJhbkpsTmNUa0orYkdsbWZSU1N4MUw4cHA4dFc1?=
 =?utf-8?B?cnJYNlNtVktxdE9BYzViYVU2MkVwSEVmVjBKYjhBRlpQVFBOVTFEZVl0MWFW?=
 =?utf-8?B?ZHZjUC9FQlpvUDNaOFVYN3hXT3MwUkVzMlZEMlhNOUFkM21vWmJGK3RjVVJS?=
 =?utf-8?B?Z2VqUTlJUi9pREg3WHUza2FBdGF6U2k5N3U4TXdDQkJsTDBTZnY1c2hDNk9C?=
 =?utf-8?B?emJuQVRrT3o2UDdYVFVvdGRicUZzTlllVDBTODAyWnRWRkVMWmkra0J6TVUy?=
 =?utf-8?B?ZEtxREpzMFVxV1lBdnppQ3FTcyt2ajFnWVBRMExXcW5yOU1VNGNSRWpQeEhV?=
 =?utf-8?B?SEptak5mN2tMaHRCSTYyQXpPOXQ3SXp1d0xhNFFMRm5TcXRxY2w2R3NmRFl2?=
 =?utf-8?B?WXFsZWFtbFpOdHhyME55Y0FuLy9WNU5HMXVzRGFXZnFRc1pHekVJOWxSTmxa?=
 =?utf-8?B?bU41aGRJZC9EQWE0TkgrYTVFb2ZTYlppZ2N6WWE1L3ZyZm5ZTFEwa2lsQm1W?=
 =?utf-8?B?NERzL1p2d01HMHMvOGlPdHhoZUc2SFN4ZzdEQWpLWjUwbEtCS0ZEZmxuMStt?=
 =?utf-8?B?M2pWZHdpNUFsL3ZFeU5EN3BZM0lxeFR4ZXpIU2Zzc1BQbzVBdUl0NTZiSlVo?=
 =?utf-8?B?Qm1OTXlSeVpJWUxhOG55ZTlLY1NnZlJ5Q2sxMXRQSkdld0c0NHZwVE1nRkdU?=
 =?utf-8?B?ckJRQnRiRVJZYmpBZWxieDhBUmMvMnlmNmpjbkZiRStXbzBDVUxXVGc4QjBy?=
 =?utf-8?B?Y3pIWEZjN214ZTY5ZWdSbDlSTFMxbjF0b0JHMWRvcFJEMzdBY0NvNWlrMTlF?=
 =?utf-8?B?Ry9VTVpwWmg2SXU1L1R0VW9xQXJzaWhxbFdKeVRhOWpGWlNIS2ZQVThqV0RG?=
 =?utf-8?B?VVp4WXFwZFRwR1BCWlhOd0dGWVEyZjAzWVVpaFBiMUpOV0ZyNXpqTGJtaXBO?=
 =?utf-8?B?ZzJ0MHU0V2dlMUxUejBabHRmRC9JSWJ3V2dtWVF6YVFVa2RmYW5tTm1OTFNl?=
 =?utf-8?B?d05HS0tCNlF4cUt2cTJMR1dIcHMrZ2FTU3V3NU1pZU03Yi9SbndLQURySFZv?=
 =?utf-8?B?STV0SytoUjBFaWRJZFBrVkUzbkovaUs5VDFFTkhyd09jOEx3dllzdlVkZUJF?=
 =?utf-8?B?Y0o1RFpmMFM3MlA1dFdOM0NpQ1pvb0k3YVNNNVRuYSswMnV0b2lBOS91QXhy?=
 =?utf-8?B?UTJRekV0RGhGdHVCaDBPRmpzTG1lV0s4ZUJEQ0JoQ3BRV2JLQUQvK3hNdmNt?=
 =?utf-8?B?WUZMeFZ0Z0VlZHBiODM3ZEdXV0VycGFNZnpFVW9XOUMxeDYra0xoS1E0bnZV?=
 =?utf-8?B?M1gvajNMak9oS1pOVGQzTy9YQ3Z5c3hiaE91ZytZd1I3c2pWcDc4andzODlI?=
 =?utf-8?B?MENobElWUzJmQlVsb0p5SnhpUlhMaGFhblY0OGQ3Ukd3QkJkUDZYM05LeUJZ?=
 =?utf-8?B?RlhYaUFIVlpJU1J5MVlXcUcvMllOaWNLaTM5UE1qRXdBeU5CNjQ2RThuaGtu?=
 =?utf-8?B?ZExwMmlOQkhXbE41aXl1eXE2cTJvTFJFZmxaYmFvWnNhd0tlcU9DQ2dCVzhW?=
 =?utf-8?B?S3NzNERmSVY3OTBURmR6cGV0SDJVTFdXaGxGVmJYNnczaDhzd2xLNlJJRVd4?=
 =?utf-8?B?RUxsNlpFTWVlV2lRcTY1Y2VIeXRLclNqUmlReDNIcW5mTEQ3OE9WaXhWZ1Zm?=
 =?utf-8?B?WElWL2wvREdhaGdlbHMwMjZrcE5YditSSEV4N2Ixb1YvbXprQld1cXpqUEVn?=
 =?utf-8?B?bnc1ckFiVFUxYTJXY0xNVVpGSUQrSGgzRUpiSHhIdnJzQ1BvdWhMMStDSzFQ?=
 =?utf-8?B?ZzgxVllRdXVXcU1sNjRoU0h0eXg4NmVwZ0wvVnByUVdxdnBSOCtUZkxvV0J1?=
 =?utf-8?B?MUE9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 5aee8b4e-13c3-4222-ee11-08dc479cd558
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 18 Mar 2024 22:43:30.0831
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 48m+tMt+NukLjuTycdyHX/86SxuT7N7rDMsQWThjLejkDYBFlccxWrynuwINo2phxMLZ3/aw8iyD75cHE7WdfSZ3k2jXxz4cveWu6v1oKSI=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY8PR11MB7745
X-OriginatorOrg: intel.com

Hi Tony,

On 3/18/2024 3:00 PM, Luck, Tony wrote:
>> Perhaps ... in this case it may make things easier to understand if
>> those "mon_NODE_*" directories are sub-directories of the appropriate
>> "mon_L3_*" directories. 
> 
> Reinette,
> 
> Like this?
> 
> $ tree mon_data/
> mon_data/
> ├── mon_L3_00
> │   ├── llc_occupancy
> │   ├── mbm_local_bytes
> │   ├── mbm_total_bytes
> │   ├── mon_NODE_00
> │   │   ├── llc_occupancy
> │   │   ├── mbm_local_bytes
> │   │   └── mbm_total_bytes
> │   └── mon_NODE_01
> │       ├── llc_occupancy
> │       ├── mbm_local_bytes
> │       └── mbm_total_bytes
> └── mon_L3_01
>     ├── llc_occupancy
>     ├── mbm_local_bytes
>     ├── mbm_total_bytes
>     ├── mon_NODE_02
>     │   ├── llc_occupancy
>     │   ├── mbm_local_bytes
>     │   └── mbm_total_bytes
>     └── mon_NODE_03
>         ├── llc_occupancy
>         ├── mbm_local_bytes
>         └── mbm_total_bytes
> 

Yes.

Pro:
* This is familiar to users when compared to existing
  CTRL_MON group counts that are the sum of the MON groups within it.

* Users continue to see the clear connection between files listed in
  /sys/fs/resctrl/info/L3_MON/mon_features found in "mon_L3*" directories.

* If I understand correctly it also would continue to be useful to
  Arm [1] while not breaking existing user space since the
  mon_L3* counts continue to reflect the entire L3 resource.

* This addresses your comment of maintaining the detailed information
  from each SNC node.

* I do assume that if there is only one SNC node per L3 cache then those
  mon_NODE_* directories will not be present and, to address the issue
  that triggered this thread, user space can use presence of
  multiple "mon_NODE_*" directories per cache instance to know if
  SNC is enabled.

Con:
* Unclear how this may need to change if/when SNC becomes architectural.

* Continues to "muddy" the naming of the directories: mon_<resource>_<id>
  vs mon_<scope>_<id>. This cannot be turned into agreement with user space
  where first directory is mon_<resource>_<id> and second directory is
  mon_<scope>_<id> because then we would need to have, for example,
  mon_L3_00/mon_L3_00 where the first directory is for the resource and the
  second is for the scope, which appears redundant.

* Things may get confusing if there is ever a "node" resource.

This is starting to look like an interface that "checks" all the
requirements I've seen so far. Looking at the "con" it is difficult for me
to see how doing something like this now may cause frustrations later.

Reinette

[1] https://lore.kernel.org/lkml/88430722-67b3-4f7d-8db2-95ee52b6f0b0@arm.com/