Received-SPF: pass (google.com: domain of linux-kernel+bounces-96367-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:45d1:ec00::1 as permitted sender) client-ip=2604:1380:45d1:ec00::1;
Message-ID: <83b12a33-6841-40dd-a825-b4db7dbf22db@intel.com>
Date: Thu, 7 Mar 2024 15:41:00 -0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 4/4] selftests/resctrl: Adjust SNC support messages
Content-Language: en-US
To: Tony Luck <tony.luck@intel.com>
CC: "Wieczor-Retman, Maciej" <maciej.wieczor-retman@intel.com>, "Yu, Fenghua"
	<fenghua.yu@intel.com>, Shuah Khan <shuah@kernel.org>, "james.morse@arm.com"
	<james.morse@arm.com>, "ilpo.jarvinen@linux.intel.com"
	<ilpo.jarvinen@linux.intel.com>, "linux-kernel@vger.kernel.org"
	<linux-kernel@vger.kernel.org>, "linux-kselftest@vger.kernel.org"
	<linux-kselftest@vger.kernel.org>
References: <cover.1709721159.git.maciej.wieczor-retman@intel.com>
 <8a158ada92f06b97a4679721e84e787e94b94647.1709721159.git.maciej.wieczor-retman@intel.com>
 <SJ1PR11MB608310C72D7189C139EA6302FC212@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <o6va7b7rc3q46olsbscav7pla4hxot2g6xhctflhmf64pj5hpx@56vtbg3yyquy>
 <SJ1PR11MB60830E546B3D575B01D37104FC202@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <159474e6-ef11-4769-a182-86483efcf2a6@intel.com>
 <SJ1PR11MB60832DAD58E864F99A16FCC4FC202@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <0393c4ce-7e41-4dcc-940a-a6bea9437970@intel.com>
 <SJ1PR11MB6083AACB10645E41DD3F9639FC202@SJ1PR11MB6083.namprd11.prod.outlook.com>
 <55a55960-8bb1-4ce2-a2c7-68e167da8bcc@intel.com>
 <ZepK4mtoV_J8-UbE@agluck-desk3>
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <ZepK4mtoV_J8-UbE@agluck-desk3>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ekwxOVg2UnVPQzVXVk9qdnpEMURsVEV1VUgxS2YvdGlPK1Z4YVFkV3NWUXUy?=
 =?utf-8?B?Z0pmT1duZ1MwOFRvQ1ZvamdLSTJ5OUNIL25xbkNWci90R24vWGw3ZlZOVjJG?=
 =?utf-8?B?eE01MnJYZUZGeEZnSFBqMUcrcmV3ZWNVRzBVdFplNGhIS2t5MWZFNWxYOHE4?=
 =?utf-8?B?Z2FmQmhRYnUzeWI5U0V5TWtmcE1Jbm1XeVdHTWtwWng5UnF2WUx2N1E4QVE1?=
 =?utf-8?B?ME1MZGVQQ2FvUTdLTDRUZkdZY0pYVG9QUmpxR1VGdklKQnRFM1JoMDhlTktY?=
 =?utf-8?B?VE44Y2lTdDVrTEk3WjFJTHppeG11VnNGZXd1S0pVNmVpOUY0TGVRT1dMd1dl?=
 =?utf-8?B?dVZGUVdMaUw4TmIyTk1uZ3c4NUZrMytuWUpMZXVocldDSlBGNVM3OVdYZDc5?=
 =?utf-8?B?VVZ0UXVwdkVnWjY5MmZteXZDeVppcWJrV2hpdzA0VDJOTTlEVWVpQmRqK1B5?=
 =?utf-8?B?bVVIZlU1RU1zMzdrQ3hpaG54di9vc2dwYTlxK0FMMGx5Q2JWZ3IxVlllcEx1?=
 =?utf-8?B?YkpUSkFyb0p4cG1OZXVDRldXSFdyNFl1STJwT0xTcHpnaFNkUXlmNHp2Vkp6?=
 =?utf-8?B?eTVMR1hSeVVoZnNxLzNWeGxYaXc5elREMytOTWVCQVUyOW1TTW1Od2hWU2FQ?=
 =?utf-8?B?aVNTM2ZpOE5oek9RVkdkVTc5anMrRkhWaGdEeCtDR2FhbU9jcDJ2eEMxTWd1?=
 =?utf-8?B?b2NJejRkUFY2azBzTWFSaXc3TXp6bS9jWERDZmpFYmUxUHliZ2ZSZzh2Ympk?=
 =?utf-8?B?WDdkZjgzTWsxRmw2c1JjZk1hRE9vSmNUajdlUzVsUTBXZDFoUmtKSEV4aHgz?=
 =?utf-8?B?cDNONURDYVJlZWowU2RGbzhTTXBWRG53YzdUNFdyWm1VSHdkUThNVkhrMFZY?=
 =?utf-8?B?ejlzQlFwc1lNQ1Z2aklsUVpFUUl1NE1jQUlBeFVZNVN1V2JYUVl2YjY3alkv?=
 =?utf-8?B?WjJ3eURvNmU0NkdmcjdnV3l6RUhZUktpbHd0Z2hVR2d3NkJXaTBHb1FLTldK?=
 =?utf-8?B?OU9KRW5lbGdmdCtoQWlON0dnbzNjSE9DSTZtQWtDbGR2ckF3N0EzZThNd2dO?=
 =?utf-8?B?NDVnNVZhdnRRbTJrNFpEUllMbERuK0lwQmJjd0hhT2R5d0R3dERXSm5oaFhs?=
 =?utf-8?B?eGdxOVo1ZDRqSEZwQ2liRC9tTlJrTTFZT2J6SHplQlBNbEtJNUMxMjJHZk81?=
 =?utf-8?B?aWJWbzF4eXIzZzFHT3ZsVVFEZk04SzB6NkJ6b3djZk4zSzFLWVd3K2lXWTBj?=
 =?utf-8?B?eWxFd3djL2M0SjZDMm5uVjZYMFByVTZMN0sxMzhiK1ltb01UcDdscHhqMjdF?=
 =?utf-8?B?Q3FsWU1LK2RNWElrWHoxSmU0RTVPTXNWd3Y4ek1LVDJUVUFCbG94OGcyMUdD?=
 =?utf-8?B?NExqd2k0S1cwNDY5UzFBQ0w3ZElNbUhNZ2wzeEdKLzR5RnNEZXl1bjRmTEpp?=
 =?utf-8?B?UG5DYkt0WUc4M2hMU0tCelhQWHo0SXc2aSt5cHBndFJvYzQ3Uk9HQkV4ZkdQ?=
 =?utf-8?B?TjlkMTArWWdpYzlsN016RW9ndmpXVEZtanhEWFdQSFBTSG1BdlZ2ekRSMGNU?=
 =?utf-8?B?SDlvM1JjSStkWDJpZWtoMVlXTFdUSnN4Q1ozWllvYmIzemN1TDVoNGhlaGNT?=
 =?utf-8?B?YnMzMUhJa2ltckpyY1k1eXJvVlMyNWtsOG5pbjQ0RXY0SVF5ZlYzN1dINUZh?=
 =?utf-8?B?MFJ5QVRIaVc1ZXozdDZQVlJsa01QUnZaNFNOaEhQWHRmSmZsc1c5eTVvQlhN?=
 =?utf-8?B?dzVPYkpZSkR3alM2ejkwR3VsNHZJa2d2aDFiMGxYNnZLNURsRnhHQ0FEb3Fs?=
 =?utf-8?B?Vk45UFZIaHUvcW9QbmVtR1BKQkJqNmJmMG9nR014MG0zVlRXWHVYSlgzWjdM?=
 =?utf-8?B?OWdnRFRUR3NEb2JWOHU2eEJxcnAxSkFnTE5kSTBod0ZOR2VPVWkzRTlsdko0?=
 =?utf-8?B?Ym5kSG5QNm5JdnoySlhuNnVhaGVoQmFORXUwOGRlWFlibmpyTVhML3VsaDR0?=
 =?utf-8?B?TnlYei9vejYwUDlmMmRiUWIzREpFOVk5ZTNBSG0zY3ArcWNMSXQ0ZDdHMFhw?=
 =?utf-8?B?anRYeGYrRXpKaGMwYktRS1JlSkZhMUNVSU9YQVp0di8zR1A4Q3FoZzEvU2Vy?=
 =?utf-8?B?SlhpMzkrUFg5SGtZMHkyTEY0QnVTMVBXcndEeHJVWENzbThKMkVZT2JPOTY0?=
 =?utf-8?B?cHc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 6f85f3a5-af45-4024-e4ed-08dc3f000d05
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Mar 2024 23:41:03.1951
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 2u75YCsbduAABO63RnpBDYxT1IMTOPDJDUsLJ85Y/TP7d3sRiMERuRMaEBFfi4cGMpy+1SDbydKZ4Zj2YrCWmPbB6mrFs74mk6jxg19cb98=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR11MB8724
X-OriginatorOrg: intel.com

Hi Tony,

On 3/7/2024 3:16 PM, Tony Luck wrote:
> On Thu, Mar 07, 2024 at 02:39:08PM -0800, Reinette Chatre wrote:
>> Thank you for the example. I find that significantly easier to
>> understand than a single number in a generic "nodes_per_l3_cache".
>> Especially with potential confusion surrounding inconsistent "nodes"
>> between allocation and monitoring. 
>>
>> How about domain_cpu_list and domain_cpu_map ?
> 
> Reinette,
> 
> Like this (my test system doesn't have SNC, so all domains are the same):
> 
> $ cd /sys/fs/resctrl/info/
> $ grep . */domain*
> L3/domain_cpu_list:0: 0-35,72-107
> L3/domain_cpu_list:1: 36-71,108-143
> L3/domain_cpu_map:0: 0000,00000fff,ffffff00,0000000f,ffffffff
> L3/domain_cpu_map:1: ffff,fffff000,000000ff,fffffff0,00000000
> L3_MON/domain_cpu_list:0: 0-35,72-107
> L3_MON/domain_cpu_list:1: 36-71,108-143
> L3_MON/domain_cpu_map:0: 0000,00000fff,ffffff00,0000000f,ffffffff
> L3_MON/domain_cpu_map:1: ffff,fffff000,000000ff,fffffff0,00000000
> MB/domain_cpu_list:0: 0-35,72-107
> MB/domain_cpu_list:1: 36-71,108-143
> MB/domain_cpu_map:0: 0000,00000fff,ffffff00,0000000f,ffffffff
> MB/domain_cpu_map:1: ffff,fffff000,000000ff,fffffff0,00000000
> 
> 
> The patch to do this is pretty straightforward.
> 

Thank you for looking into this. This looks like valuable information
for user space. Back to what started this discussion ... I expect user
space can compare CPUs associated with control and monitoring domains
to learn if SNC is enabled? (And now existence of domain_cpu_list and/or
domain_cpu_map can also be used to determine if kernel supports SNC).

Reinette