Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <e299ce70-ebca-a05f-a1f1-aed6386c379f@intel.com>
Date:   Wed, 26 Oct 2022 13:23:04 -0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Firefox/102.0 Thunderbird/102.4.0
Subject: Re: [PATCH v7 05/12] x86/resctrl: Detect and configure Slow Memory
 Bandwidth allocation
Content-Language: en-US
To:     <babu.moger@amd.com>, <corbet@lwn.net>, <tglx@linutronix.de>,
        <mingo@redhat.com>, <bp@alien8.de>
CC:     <fenghua.yu@intel.com>, <dave.hansen@linux.intel.com>,
        <x86@kernel.org>, <hpa@zytor.com>, <paulmck@kernel.org>,
        <akpm@linux-foundation.org>, <quic_neeraju@quicinc.com>,
        <rdunlap@infradead.org>, <damien.lemoal@opensource.wdc.com>,
        <songmuchun@bytedance.com>, <peterz@infradead.org>,
        <jpoimboe@kernel.org>, <pbonzini@redhat.com>,
        <chang.seok.bae@intel.com>, <pawan.kumar.gupta@linux.intel.com>,
        <jmattson@google.com>, <daniel.sneddon@linux.intel.com>,
        <sandipan.das@amd.com>, <tony.luck@intel.com>,
        <james.morse@arm.com>, <linux-doc@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>, <bagasdotme@gmail.com>,
        <eranian@google.com>
References: <166604543832.5345.9696970469830919982.stgit@bmoger-ubuntu>
 <166604559954.5345.14619487558472213422.stgit@bmoger-ubuntu>
 <c999a7f8-b083-72a6-ff07-201369339c92@intel.com>
 <ef734fc1-8a51-4c60-f73f-2d71fcc54b30@amd.com>
From:   Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <ef734fc1-8a51-4c60-f73f-2d71fcc54b30@amd.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Mk8zcW9xc2IxOGZWNDE0azhpTCswaEMzM1ZTV3JpejhSVHhiQ1ovRDFvUk4v?=
 =?utf-8?B?SWkvZnVWa0NaYjloVEsvRUdvNXhORnFuUmdzL2ZCOG1vV0hIQ0tuY2JVMy8y?=
 =?utf-8?B?ZFNKbWVxaDJqb2dHQnpDUUpOa1JKNzhKc3VBWGtXb3A5ZWw2bEM0SU9UblNn?=
 =?utf-8?B?dXNVLzI1WHo2SXUyV1VJL0VRcHh3QUZrdFVYU0tsQUNaMng4WlFiK3grZm0x?=
 =?utf-8?B?WDVTbVZzWlJWUUI1c3JKc0xrUmsyM1FZOHpQSjBqL2JiTDZWaURvWTNzVGZB?=
 =?utf-8?B?THdBSE1pY25rQkFHT09VbDVEaWdXUmpOQjJ5YU1HVG1MOGI4MmNMcHNxcjYz?=
 =?utf-8?B?ZElrR1dxYjhWSnVzNkt3SGJ2TUhGSXZZN1NOYks1S1h6MUwydFVveEZkdmMr?=
 =?utf-8?B?NzA4SVFVSUtNQzZCbm9oM3ZwYjVNYmNvWFJmT3JRb0pTYW1QbDBoRGdyZk4w?=
 =?utf-8?B?Q3RNWWJqZTRVK0hDM1Q2NmZCdjRvMVp5UmxiL1hHM2dSYkhpV0pnaTFlVEdO?=
 =?utf-8?B?ZHdoZElDdTVvL1FNSUlTQmhUSUNmb0tLTlc2MlZwZDF5RENvcTV5ZG9QSTU3?=
 =?utf-8?B?MGJ3eWgyWlE0MHNTMDN2QUdnQndlSmRyenRzd1pDN2tJTnVER1Q2akgwdTRw?=
 =?utf-8?B?cVBkZGtLVTNaOXA0anYvelNPL0ZSS2l1RzRQVkZPOVVDd2ZORlhGMDVJLzNT?=
 =?utf-8?B?b1NvNzBtYTJOMjV6UEVTa3R4QldRQVRuNExDRWFWajZBNWJuY3BvdHp4L1lz?=
 =?utf-8?B?TURteVgxTEZJTWlBOUZGVGhEZW1oQWV5NitKQU5VaUZhcU5FSDM4VnRRNG4z?=
 =?utf-8?B?U2tmMTJPVnZIZHNuanM5ZVBsQi9Ud21kMGsxREs1ZUNaREdVZ1VTdUJ6T1VF?=
 =?utf-8?B?bEc5aXdad2FJTlAzMTBuRFEzelBQT0c0T3hqN0hWaE0xcS9hdU43WXh3ZTUr?=
 =?utf-8?B?eFZNeW83NC82SXcwZTdqVE5Bcm9STW0xTU8rSkxsWXQ3eHJZL3Bwa2paMlo2?=
 =?utf-8?B?K1RCa3haNmY4M2o4UUJoU0h2ZmdUdEJHME4vNm5UcHEvTmNDb3ZQT0tYdi9Y?=
 =?utf-8?B?aXhaSVFFK0x3cGJtL2E5blJsOEh6bGRoSlZmWE9tOGxtZVpiQ1hQYWs5R0tk?=
 =?utf-8?B?c0VlL0t2eGNqSkFVNXBlSWFvaHVLOEl4SE50ZVM5RTZGOG5qV3g5ZkxUWitT?=
 =?utf-8?B?M0gvc0JEejR3VWtNVEhtNFp0MTY5ZjhGNUlaakdSeXlWeXdJeDRMaEpNTlBr?=
 =?utf-8?B?WGxocS9hcFFFWlFrRDZLMUxNOFAwZUZhaDIvRDEzVDRqNkpzRHpPdHl1OGlB?=
 =?utf-8?B?Ykd4ZWxoWnZsWWVpaUFUVWZlc2JGS1UvTlZvYm92YVc1STFLd1NmSGFrL2pH?=
 =?utf-8?B?cUVVOWR5ZUk0QmpadjBPdHlKRlZTSjByYmhsN0ViczNIcjJHSnRVcWo2S2pV?=
 =?utf-8?B?ZTVaR1Jic2VDUFQ0alR6YWRYcU1HZTB5SFdudmpLWHNYLzgySWxVYXFHVy9v?=
 =?utf-8?B?MjJ3Ui9RL1NYWktvVENNdmVGY2FzWGNsNThTM092NGRIWGxVK2t3TU1IQ2Rw?=
 =?utf-8?B?dG5vVlVPQStGUFhSTFAzVk1qNVJXbmUveE1ENVFYK2VGVS9pbTN5eFNBYW5K?=
 =?utf-8?B?bTNtNzFKbG5CQUhIMWJGTFdTZk1OQmI0cnNGSUdjT0ttcWlOTFN4Y2NJTlZN?=
 =?utf-8?B?R2R3aCtJQzRFSWlwOFlTZ0s4S2tzaUIxK2c4ellYV0Y4bFhVT0R0T1RpUWty?=
 =?utf-8?B?aXV6Qy9iZklOQ3h6bFVYcGhTOG9DZUgxNWZ1Z3V3WkhDbkE2SVp1UytkczIx?=
 =?utf-8?B?ZUVIdVNPeWdoS3RWUnoxUHB3K0s2dTQ4NE15eGtzMllSa1lBTVZJOWljSGJl?=
 =?utf-8?B?dnpOSHcwRzR2cGtDbVliVE5jMU5XUzVCWThsOUNSdGdnU1JZOEtOeFdwUFBx?=
 =?utf-8?B?WkZISysxQUpJeVMyVlhsekNpVENiVXJKd3pSb212dzRDSUtibUU3MmlqTFlI?=
 =?utf-8?B?dkdRWGdxNTV1UGVBb2tQbzEwVmlKVzJvd1FZbyt0ZFZjY1Y2VXlhTkNWdDRN?=
 =?utf-8?B?blZTUDJ5ZFBUdzd1SzdqWmdseERvejBKU24rTmNRcWlub0xZT0cyU1J3SE1N?=
 =?utf-8?B?MFBvaHJQd1NKRVB4TGVCbWJwUFc4b1NvZC95N0gyUHdhVW1DQUNDUjJXWWVa?=
 =?utf-8?B?WWc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 45e31fd4-acb2-407b-516f-08dab78fe55d
X-MS-Exchange-CrossTenant-AuthSource: CY4PR11MB1862.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Oct 2022 20:23:08.5307
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: C87E10GJmDj0r1/2/nLKnRTS2CnDMFThN4saAkENk7FjMJRLXwuiJBwlS2kBHqzIcpU9GuW0eYmS4urJvDec8R+kpNRKq5DMkhTRewJCyhM=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR11MB6189
X-OriginatorOrg: intel.com
X-Spam-Status: No, score=-7.6 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
        DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,
        RCVD_IN_DNSWL_HI,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,
        SPF_NONE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Babu,

On 10/26/2022 12:07 PM, Moger, Babu wrote:
> On 10/25/22 18:43, Reinette Chatre wrote:
>> On 10/17/2022 3:26 PM, Babu Moger wrote:
>>
>> ...
>>
>>> @@ -2845,7 +2846,8 @@ static int rdtgroup_init_alloc(struct rdtgroup *rdtgrp)
>>>  
>>>  	list_for_each_entry(s, &resctrl_schema_all, list) {
>>>  		r = s->res;
>>> -		if (r->rid == RDT_RESOURCE_MBA) {
>>> +		if (r->rid == RDT_RESOURCE_MBA ||
>>> +		    r->rid == RDT_RESOURCE_SMBA) {
>>>  			rdtgroup_init_mba(r, rdtgrp->closid);
>>>  			if (is_mba_sc(r))
>>>  				continue;
>> The above hunk and the ones that follow are unexpected.
> 
> I am thinking the above check is required, It is updating the
> staged_config with default values. Right now, the default value for SMBA
> is same as MBA default value. So, I used this code to initialize.
> 
> Did I miss something?

As I described in the following comments my concern is related to all the
software controller code still executing for SMBA. Yes, in the above hunk
SMBA would need (some of) rdtgroup_init_mba() ... but note that it contains
software controller checks and in the above hunk its call is also followed
by another software controller check.

The software controller is just applicable to MBA and these checks have been
isolated to the MBA resource. Using it for SMBA that does not support
software controller at all is making the code harder to follow and sets this
code up for future mistakes. I think it would make the code easier to understand
if this is made very clear that software controller is not applicable to SMBA at
all instead of repurposing these flows.

>> Note that the software controller, when resctrl is mounted with "mba_MBps", is 
>> only supported by RDT_RESOURCE_MBA. At this time this really is hard coded all
>> over the place, for example:
>>
>> static int set_mba_sc(bool mba_sc)
>> {
>> 	struct rdt_resource *r = &rdt_resources_all[RDT_RESOURCE_MBA].r_resctrl;
>> 	...
>>
>> }
>>
>> Since SMBA hardcodes "delay_linear = false" I do not expect it to support the software
>> controller ... but these hunks appear to treat SMBA as though it does. It is the "MBA software
>> controller", not "SMBA software controller". Why does it check above if the MBA software
>> controller is enabled on SMBA?
> 
> There is no plan to support SMBA software controller. Yes, I think below
> checks are not required.

Thank you for clarifying. Having the code reflect that clearly would make everything
easier to understand and maintain.

Reinette