Received-SPF: pass (google.com: domain of linux-kernel+bounces-109123-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:40f1:3f00::1 as permitted sender) client-ip=2604:1380:40f1:3f00::1;
Message-ID: <7656a3fe-56d2-4a9f-9dfd-6f2666f38110@intel.com>
Date: Wed, 20 Mar 2024 08:50:51 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v16 0/9] Add support for Sub-NUMA cluster (SNC) systems
Content-Language: en-US
To: Maciej Wieczor-Retman <maciej.wieczor-retman@intel.com>
CC: Tony Luck <tony.luck@intel.com>, Fenghua Yu <fenghua.yu@intel.com>, "Peter
 Newman" <peternewman@google.com>, Jonathan Corbet <corbet@lwn.net>, "Shuah
 Khan" <skhan@linuxfoundation.org>, <x86@kernel.org>, Shaopeng Tan
	<tan.shaopeng@fujitsu.com>, James Morse <james.morse@arm.com>, Jamie Iles
	<quic_jiles@quicinc.com>, Babu Moger <babu.moger@amd.com>, Randy Dunlap
	<rdunlap@infradead.org>, Drew Fustini <dfustini@baylibre.com>,
	<linux-kernel@vger.kernel.org>, <linux-doc@vger.kernel.org>,
	<patches@lists.linux.dev>
References: <20240312214247.91772-1-tony.luck@intel.com>
 <8ee6f553-16c0-4097-b5d8-af1598d1b85a@intel.com>
 <5vnrboxpkrriiqcbwrxtbextu6pduqjfchlvsdn5nwe7lr7vou@dngffvu7a5fh>
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <5vnrboxpkrriiqcbwrxtbextu6pduqjfchlvsdn5nwe7lr7vou@dngffvu7a5fh>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?L05uOHFmWU00UmpKK0w5eWxqY05zSjFwK1BYYlFPa1dTK1VBZzdiWGk0OU5r?=
 =?utf-8?B?WmYzejNQaHN0YS9aaWVxTVlSWTBOcjRIT05DVkFWWUN6LzBSb3crdmJ4aytR?=
 =?utf-8?B?eHVDWFBkT0NON0p4VFZpZmFOR3hWT1AwUmFXTnpBNXlLNGpoMVkzSU9MQU9Y?=
 =?utf-8?B?Rlh6Q00rMWVJMVZpelVUY0VmYWdBblVrUW1FQ2FSbWE4YzNsdzJtaXpYaEFv?=
 =?utf-8?B?ZG9JTm9PK3BYR0VyL0ZHWXBDMHcvWG4veHVMRERyc01OOVFPNFd4REFLcE8z?=
 =?utf-8?B?dWR6ek12c3hLVzJZRHArWXFMTnlnajh6a1ovaVVVdnZRMWZDcFhWS3g4cXFj?=
 =?utf-8?B?cmREc2VBbEphejQvSHAxa04xdktPeVhGOC85Y1NXTERpcVNVUVVIQ3N0ZUNO?=
 =?utf-8?B?cy9PSEhTbnFpSDdRbFB6cXcxQWFtTGE1bEFYb0VsaTdXN0FtRzBBVE9vM3VL?=
 =?utf-8?B?MENoZU9waGZrQkZXcHNtUDhCcTdzdEdESWhxZGZkVVRHbTRUTlZUOEdBVGpn?=
 =?utf-8?B?VzJEWllmbWRlbHpRZzRYSlJuVVFUWi9xZ0w4VVZmdWlzSVdYS251OFBsQnh0?=
 =?utf-8?B?dG9sZmdlV28xNG83OFlVaytjOGpULzhacmZtQnlXa3h5N2d3L3JreXhDazFo?=
 =?utf-8?B?aU5TVUdtTkg5Y0xuWlRjbEtnQitsd2JJSGh6YUxrYTJnN3dMT09jTzZISmpr?=
 =?utf-8?B?aDBKdmpEaHRkZWZTbU95M3RMcnBzWXh1Nyt2TW90M0RpK3hacm9KSnFOL3BD?=
 =?utf-8?B?ZjNwZUI1UEMzRjNPSUIraXR5SUJZTnI1dEdJcUhvbFJDVVRqdDY3Mi9Ya1NO?=
 =?utf-8?B?YXJHZGFZeVNrQlZBbmV1azBwVEp1ZElBRGhrN2F4UnJlcU5lWS85MDNLV1lS?=
 =?utf-8?B?aTZpTGNQeTNUM3ZLMll2Tm5yYXgzdmFuZFdYS29hRFpyLy9raHltbVFJSTQ4?=
 =?utf-8?B?OURLVzAwUlNuZkRpVXFQaXNhWE5lQXNjREFRRlFGU0M3bDJFOXFmcmtsNVQ2?=
 =?utf-8?B?KzJla2RXWlpjMTMxN1VrbHFtbHFHZGtkYW11TFNHbVNqV1p5SDZ6OW91UlRT?=
 =?utf-8?B?dVNUdXFzQ0doRi8reFdFUzlRY3d6dHQ5MWJkTk9LTm5jbnVjRUVRS2ZuRjQw?=
 =?utf-8?B?emhSZmlNVCs1NnppampwRGxOK2t3dW9LUGFJYU83c1ZUdzROUFdwekc5Y1Nm?=
 =?utf-8?B?R0RXbkRLUXhGRnpCYkxkK05QRWJoay80MTZpZ1dHM3QrOThGcjlsYXFxY3pt?=
 =?utf-8?B?bVYwdVhPY2RBZ0JmUHVBTkpVOUVpeU5JS1N2dzZQelpZZXhETUgvbnZnQ0d2?=
 =?utf-8?B?SzJUVm9FaEZTOFVjLzZMZmRRcUc0QmlsVjJqWkd3WTVnZkpyRGlkVGJ6L3gr?=
 =?utf-8?B?T0NzYnlmWkdDMEU4ODJOZTJpbkpMWjhaRDVzdUh6ZUNCeUgwNmxhTkN2bmFG?=
 =?utf-8?B?MVJjdW5TQ1NBSVBrakN6N045ZG9UOVdWTlJmQllxVkFmcmZOUEV2OU9ydVhF?=
 =?utf-8?B?U1cvbWZDV0M5UjhCZHg3LzgyVW42VXQzYkx3blY4eE94MHVKOXRlTHRvbzM0?=
 =?utf-8?B?bnU0cjVjR082VzloVlltOWFtOUxKbXVXQk9QRXpvNlJQUlNMUy9TM2hBeXJF?=
 =?utf-8?B?ekwvN05OWEhJMlJoRG1UcXc4ZVVvT3pvNWVIQjhNa2ZyMFh4RkRVMU9yZWZj?=
 =?utf-8?B?NUpLRTdQNGhrL3lzckxPa0QrQ3JNOFhXbWtPNEZRTndQWGhtdE0yVFNaSUpY?=
 =?utf-8?B?UkdJa21WRm5SY0lxZjFuZnhNbklBbnNRZ2x5ODR1bjR5M21JOWhzN0R1MGxF?=
 =?utf-8?B?M25OVVlFK1I0MjV3WWZuOVhLMy9qczNKM04yOEw3cGNmb3VUd1F2OFpvV3dy?=
 =?utf-8?B?UWN1VG9YQ2xoSUx6S2JDQnkzNnJYQ1ZxMXg0UFNXenpubUlxWEZPQWtiYmlB?=
 =?utf-8?B?dE82N21VQ3FISHNGdzZQWnVWdkxZNmJFd0lLTy9sY3lhdlpHM3pPSzVka3VD?=
 =?utf-8?B?cFdGYU9YRTVLblpjWjNuSll5TkFWdzA4dzZMajgzYno3cGhGRFVuLzlHZzJP?=
 =?utf-8?B?T3Bvc0oxRGVVRytsak9wMUFlV2NRV1JnaDVWWS9kMWhML1A2SmFSWkNSY3Iw?=
 =?utf-8?B?NFFYT3RLeXZsYzVqdHpkOFJ4M0dsUFpQa2xzdGtxWnhGYUNwaGFDSUx2VHRs?=
 =?utf-8?B?TWc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: c88a8c9d-8bc7-42c6-0101-08dc48f58659
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Mar 2024 15:50:53.9223
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: Jv7ajCydS5XiEgoGxy5dm9wejGOv1aQ7EG0wj8WpaMsfqx3Mf9ITbX4aiBj7UCQXApmI2T3Y0Xtf5P3D8kT6iq52Tp4GlIJ6TKmtCaL3AxY=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR11MB7593
X-OriginatorOrg: intel.com

Hi Maciej,

On 3/20/2024 8:21 AM, Maciej Wieczor-Retman wrote:
> Hi Reinette,
> 
> On 2024-03-19 at 10:51:14 -0700, Reinette Chatre wrote:
>> What remains is the user interface that continues to gather opinions [3]. These new
>> discussions were prompted by user space needing a way to determine if resctrl supports
>> SNC. This started by using the "size" file but thinking about it more user space could
>> also look at whether the number of L3 control domains are different from the number
>> of L3 monitoring domains? I am adding Maciej for his opinion (please also include him
>> in future versions of this series). 
> 
> By this do you mean comparing the contents of main "schemata" file with the
> number of mon_L3_* files?

(assuming you mean mon_L3_* directories)

Yes, the "schemata" file can be used. There is also the "bit_usage" file in
the info directory that indicates how many control domains there are.
Do you think doing so also falls into the "not obvious text parsing and size
comparison" category?

> 
>> Apart from the user space requirement to know if SNC is supported by resctrl there
>> is also the interface with which user space obtains the monitoring data.
>> James highlighted [1] that the interface used in this series uses existing files to
>> represent different content, and can thus be considered as "broken". It is not obvious
>> to me how to "fix" this. Should we continue to explore interfaces like [2] that
>> attempts to add SNC support into resctrl or should the message continue to be
>> that SNC "plays havoc with the RDT monitoring features" and users wanting to use
>> SNC and RDT at the same time are expected to adapt to the peculiar interface ...
>> or is the preference that after this series "SNC and RDT are compatible" and
>> thus presented with an intuitive interface?
> 
> I kind of liked this idea [1]. Hiding SNC related information behind some not
> obvious text parsing and size comparisons might eliminate any ease of use for
> userspace applications. But I agree with you [2] that it's hard to predict the
> future for this interface and any potential problems with setting up this
> file structure.

Thanks to you for trying this out from user space side and highlighting the
difficulty trying to do so.

Reinette

> 
> [1] https://lore.kernel.org/all/SJ1PR11MB608309F47C00F964E16205D6FC2D2@SJ1PR11MB6083.namprd11.prod.outlook.com/
> [2] https://lore.kernel.org/all/7f15a700-f23a-48f9-b335-13ea1735ad84@intel.com/
>