Received-SPF: pass (google.com: domain of linux-kernel+bounces-145675-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249;
Message-ID: <9daa5c12-c43d-4069-b2a6-c505217e2387@intel.com>
Date: Mon, 15 Apr 2024 10:44:34 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v1 03/31] x86/resctrl: Move ctrlval string parsing policy
 away from the arch code
To: Dave Martin <Dave.Martin@arm.com>
CC: James Morse <james.morse@arm.com>, <x86@kernel.org>,
	<linux-kernel@vger.kernel.org>, Fenghua Yu <fenghua.yu@intel.com>, "Thomas
 Gleixner" <tglx@linutronix.de>, Ingo Molnar <mingo@redhat.com>, "Borislav
 Petkov" <bp@alien8.de>, H Peter Anvin <hpa@zytor.com>, Babu Moger
	<Babu.Moger@amd.com>, <shameerali.kolothum.thodi@huawei.com>, "D Scott
 Phillips OS" <scott@os.amperecomputing.com>, <carl@os.amperecomputing.com>,
	<lcherian@marvell.com>, <bobo.shaobowang@huawei.com>,
	<tan.shaopeng@fujitsu.com>, <baolin.wang@linux.alibaba.com>, Jamie Iles
	<quic_jiles@quicinc.com>, Xin Hao <xhao@linux.alibaba.com>,
	<peternewman@google.com>, <dfustini@baylibre.com>, <amitsinght@marvell.com>,
	David Hildenbrand <david@redhat.com>, Rex Nie <rex.nie@jaguarmicro.com>
References: <20240321165106.31602-1-james.morse@arm.com>
 <20240321165106.31602-4-james.morse@arm.com>
 <e85e7786-7995-42d5-a5ac-1e08a84492fe@intel.com>
 <ZhleZ2q60ysIRapv@e133380.arm.com>
Content-Language: en-US
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <ZhleZ2q60ysIRapv@e133380.arm.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?czdpbTVuQ2R2a1BNeGhQUTlUNmNpa0RYZlVjQ0hjTGdQT2lpOTJGNzFwZXFF?=
 =?utf-8?B?VW5zN1ZaVE10Z1ZFN1hzd2ZHM2lNc1dEakt4T2NaOWhUNXNmSWxSeEhuNUZY?=
 =?utf-8?B?S3ZnY2lJTXZILzI2bEc3c005R29qZzVMZ3V4QnpHSlV0bFIzdUJqMlJWWEds?=
 =?utf-8?B?RHBLS1RDUzh2V2p0bVlSQjlyeWp5SjB3Z0k1bzl3QXh3c0ZxTElFZzV2MEli?=
 =?utf-8?B?ejAxUWNXWUVJQlZCb0Y3Yk9GTEhPa3NiakczRFFESHR5YWlhMTRnb0hNZjY0?=
 =?utf-8?B?UEFLQTB4Q21PeEV4ak9HcXdtMlJPQmRBanBwRzhMSEswRmwycUI3UCs0Y1RM?=
 =?utf-8?B?b1dqU1lqeit5RGcyZld5MHVoaGhuZFN3d0VwWW5GWm9DMHFsOXZXYXNjN01H?=
 =?utf-8?B?UkI1UGVZMnU3KzdxUWRpYUdENjlEVWRwaUF2ekZEU2FxaFZzNXJxTG14VlpJ?=
 =?utf-8?B?dFdpTzcwcnFKVEVxeVRUeHkzU2RiUmYrMnRVNWs3QWpSSjYrSzVzRndjVUc5?=
 =?utf-8?B?RG9NbjZ3UWoxeGZDQVJWekl0MjNkODhTS0tMMEV5Q1VkSDVRSytMQmtLM3E5?=
 =?utf-8?B?angwVjBVUHRMZnVnNS91TkZzeGVLQ2haZm51RXFnT2RiNEE3NUljYVN1UHE2?=
 =?utf-8?B?UFJSWHNuRll1Z2taU1RzM29RTUpCTS9mOGtJdnQvQzNCZkxDcFFEYThlTHVW?=
 =?utf-8?B?VWx1SlkxNE5RNEQyKzJDZTRJVnhMQjVlSVlEOW5oMEJwc2FVRlZ6bFVuSXRD?=
 =?utf-8?B?a1YzM0JtNENlZDQ2MnZvSGtVZG42OGdQbFpKbW56UHBaN044ZDBuSkZGalAz?=
 =?utf-8?B?a0Q4TlVhRW5DbG44R3pUcVVZT0kxbThMUkpseWhPNy9hWHlWbmRXVGYvNDND?=
 =?utf-8?B?WjlwamFrVUtVSXJzdzA1YmNxZnBIVUp1VUo2aGx2ajB4SlQrRDFTUm40ZVRo?=
 =?utf-8?B?QWpKRVRxQXNYQklxTjkxRlJSTnhFSENldU54cXRUUzhtTlpDdzdzTXpQUzJV?=
 =?utf-8?B?Y0E1NWRqeFJGUWhnSE9rSFVQUzZTZnZxWEVjVVJNeHhNYmt1K1ZlQktCdU5k?=
 =?utf-8?B?SkRKcnpXRzlWbGdSc0ZqaE9mRjJ3d0g3cVNxencybzJaS2xvMEJaSkJXcFJK?=
 =?utf-8?B?eU5Kc3dHbytmYTRUSTRHRzdSeFVhdUt4ZXF3Q0UxaVBnMDJJMmVPU1MvSmcv?=
 =?utf-8?B?bGpvS2R2MnFFSDQ4LzF0RnBCTk4vU2RTakFvRUZnNml3Zyt1R1JOMms4dFFH?=
 =?utf-8?B?aGtBV3NSSW1qbHhEMHU3Z240eGpISlJrRFI2UVZRU0ZOdnFPY3Vma3FFVnpx?=
 =?utf-8?B?WEM1ZktNYkRSYzUxZ3M1K3NvTjNoTFAycjZXNXlsUXVabFRGdkZCZHZFaGhx?=
 =?utf-8?B?cEpMWmlGaWNDYnpLcHZjcXArZHZYaW9XeWsvS2lNVWF1aCtSQk1TeEU0QTUv?=
 =?utf-8?B?QmdYVmJMMys4Zk91eDJxWGdtLzRZeHBYaWMyb0JSTlByN2FUL0Z1NDg0RFph?=
 =?utf-8?B?cU5OcmlNOEFkZVNMYkdkTGl1K0ZxaXB6M1ZMWlJGK1FEa0RKN1lwekE5d2dj?=
 =?utf-8?B?aCtXRFN3OHBJdWhCd2VPMk5XcUVhR0pvNk9XTHNzMHZWdHl2UWRLZU9Scjln?=
 =?utf-8?B?NXFDVHJIU1hFRWV0TmEwb09uMVhYVmJXdlZVSTZpL2NwRk0rbS80dGVGb3Y2?=
 =?utf-8?B?RCsyU3RvM1F1VHQ3WHNMWFJIRXFBMDVYT2NFNlYxVkJTcVh6QWxWVUVuSHNl?=
 =?utf-8?B?ejNsWFpnVHZDL0NYTmNuTkRxdFN1azdrM1VUUGJGdnJRWmFEZHRFVkk4aC92?=
 =?utf-8?B?TmVhNUFLMENGbFlIYXBacC9vR0FkKzNPdXRTQzNSdm9YeCs5OWxRdXh1OEVJ?=
 =?utf-8?B?WGU3ZjI3UmdjT1NOMkFxMXVoRDN0NmNMSWVtR0lXNkNvUEdISXNocjBjSFFI?=
 =?utf-8?B?bENva01wcEZuTjBIN2pxVzd1a0U1NFgvRDVJb2RCUnZaYWtnSmRPamNjSE5Y?=
 =?utf-8?B?RFUwV25lZlphQU15WmFFRWpOOHBCS3lqU0lFaEhXMlFLNTFqejdkRFlyb3NC?=
 =?utf-8?B?bWpTK2FGeFJ3OC93c09sQXlDVm4zL2E0V0ZsbVp1MnBmWXRKVHE2KzZDMmNY?=
 =?utf-8?B?a1VsMkJDRlNIZXdHTVRzK2lXUmVhTVRsY3JaU3IwVTJreGIwd25CMUFmYno4?=
 =?utf-8?B?VlE9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 4a2bba8b-d462-452b-180b-08dc5d73b82f
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Apr 2024 17:44:37.4315
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: BOldDOO9UFFcXv217bKxsBpwou6pvwSeAvy8IzN5RWFvbb58wIaaZQi40apEfz/gG8sxGwwRLHZaWy6zh3DwfSs8WdsJXe3iMinVwc73q94=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR11MB5296
X-OriginatorOrg: intel.com

Hi Dave,

On 4/12/2024 9:16 AM, Dave Martin wrote:
> On Mon, Apr 08, 2024 at 08:14:47PM -0700, Reinette Chatre wrote:
>> On 3/21/2024 9:50 AM, James Morse wrote:

>>> @@ -195,6 +204,14 @@ int parse_cbm(struct rdt_parse_data *data, struct resctrl_schema *s,
>>>  	return 0;
>>>  }
>>>  
>>> +static ctrlval_parser_t *get_parser(struct rdt_resource *res)
>>> +{
>>> +	if (res->fflags & RFTYPE_RES_CACHE)
>>> +		return &parse_cbm;
>>> +	else
>>> +		return &parse_bw;
>>> +}
>>
>> This is borderline ... at minimum it expands what fflags means and how it
>> is intended to be used and that needs to be documented because it reads:
>>
>> 	* @fflags:		flags to choose base and info files
>>
>> I am curious why you picked fflags instead of an explicit check against
>> rid?
>>
>> Reinette
> 
> Is fflags already somewhat overloaded?  There seem to be a mix of things
> that are independent Boolean flags, while other things seem mutually
> exclusive or enum-like.
> 
> Do we expect RFTYPE_RES_CACHE | RFTYPE_RES_MB ever to make sense,
> as David points out?
> 
> 
> With MPAM, we could in theory have cache population control and egress
> memory bandwidth controls on a single interconnect component.
> 
> If that would always be represented through resctrl as two components
> with the MB controls considered one level out from the CACHE controls,
> then I guess these control types remain mutually exclusive from
> resctrl's point of view.
> 
> Allowing a single rdt_resource to sprout multiple control types looks
> more invasive in the code, even if it logically makes sense in terms of
> the hardware.
> 
> (I'm guessing that may have already been ruled out?  Apologies if I
> seem to be questioning things that were decided already.  That's not
> my intention, and James will already have thought about this in any
> case...)
> 
> 
> Anyway, for this patch, there seem to be a couple of assumptions:
> 
> a) get_parser() doesn't get called except for rdt_resources that
> represent resource controls (so, fflags = RFTYPE_RES_foo for some "foo",
> with no other flags set), and
> 
> b) there are exactly two kinds of "foo", so whatever isn't a CACHE is
> a BW.
> 
> These assumptions seem to hold today (?)

(c) the parser for user provided data is based on the resource type.

As I understand (c) may not be true for MPAM that supports different
partitioning controls for a single resource. For example, for a cache
MPAM supports portion as well as maximum capacity controls that
I expect would need different parsers (perhaps mapping to different
schemata entries?) from user space but will be used to control the
same resource.

I do now know if the goal is to support this MPAM capability via
resctrl but do accomplish this I wonder if it may not be more appropriate
to associate the parser with the schema entry that is presented to user space.

> But the semantics of fflags already look a bit complicated, so I can
> see why it might be best to avoid anything that may add more
> complexity.

ack.

> If the main aim is to avoid silly copy-paste errors when coding up
> resources for a new arch, would it make sense to go for a more low-
> tech approach and just bundle up related fields in a macro?

I understand this as more than avoiding copy-paste errors. I understand
the goal is to prevent architectures from having architecture specific
parsers.

> 
> E.g., something like:
> 
> #define RDT_RESOURCE_MB_DEFAULTS		\
> 	.format_str	= "%d=%*u",		\
> 	.fflags		= RFTYPE_RES_MB,	\
> 	.parse_ctrlval	= parse_bw
> 
> #define RDT_RESOURCE_CACHE_DEFAULTS		\
> 	.format_str	= "%d=%0*x",		\
> 	.fflags		= RFTYPE_RES_CACHE,	\
> 	.parse_ctrlval	= parse_cbm
> 
> This isn't particularly pretty, but would at least help avoid accidents
> and reduce the amount of explicit boilerplate in the resource
> definitions.
> 
> Thoughts?

I understand the goal of this patch to make the parser something that
the fs code owns. This is done in support of a consistent user interface.
It is not clear how turning this into macros prevents arch code from
still overriding the parser.

You do highlight another point though, shouldn't the fs code own the
format_str also? I do not think we want arch code to control the
print format, this is also something that should be consistent between
all archs and owned by fs code, again perhaps more appropriate for
a schema entry.

Reinette