Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:2 as permitted sender) client-ip=2620:137:e000::3:2;
Message-ID: <33bc1cee-c909-4d54-a9aa-2b4c0257959c@amd.com>
Date:   Fri, 8 Dec 2023 16:58:35 -0600
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 00/15] x86/resctrl : Support AMD QoS RMID Pinning feature
To:     Reinette Chatre <reinette.chatre@intel.com>,
        "corbet@lwn.net" <corbet@lwn.net>,
        "fenghua.yu@intel.com" <fenghua.yu@intel.com>,
        "tglx@linutronix.de" <tglx@linutronix.de>,
        "mingo@redhat.com" <mingo@redhat.com>,
        "bp@alien8.de" <bp@alien8.de>,
        "dave.hansen@linux.intel.com" <dave.hansen@linux.intel.com>,
        James Morse <james.morse@arm.com>
Cc:     "x86@kernel.org" <x86@kernel.org>, "hpa@zytor.com" <hpa@zytor.com>,
        "paulmck@kernel.org" <paulmck@kernel.org>,
        "rdunlap@infradead.org" <rdunlap@infradead.org>,
        "tj@kernel.org" <tj@kernel.org>,
        "peterz@infradead.org" <peterz@infradead.org>,
        "seanjc@google.com" <seanjc@google.com>,
        "Phillips, Kim" <kim.phillips@amd.com>,
        "jmattson@google.com" <jmattson@google.com>,
        "ilpo.jarvinen@linux.intel.com" <ilpo.jarvinen@linux.intel.com>,
        "jithu.joseph@intel.com" <jithu.joseph@intel.com>,
        "kan.liang@linux.intel.com" <kan.liang@linux.intel.com>,
        "Dadhania, Nikunj" <nikunj.dadhania@amd.com>,
        "daniel.sneddon@linux.intel.com" <daniel.sneddon@linux.intel.com>,
        "pbonzini@redhat.com" <pbonzini@redhat.com>,
        "rick.p.edgecombe@intel.com" <rick.p.edgecombe@intel.com>,
        "rppt@kernel.org" <rppt@kernel.org>,
        "maciej.wieczor-retman@intel.com" <maciej.wieczor-retman@intel.com>,
        "linux-doc@vger.kernel.org" <linux-doc@vger.kernel.org>,
        "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
        "eranian@google.com" <eranian@google.com>,
        "peternewman@google.com" <peternewman@google.com>,
        "Giani, Dhaval" <Dhaval.Giani@amd.com>
References: <20231201005720.235639-1-babu.moger@amd.com>
 <d97cbeba-af6d-4b64-b5c8-32dc437a67b6@intel.com>
 <71e85bf3-a451-4adf-ad5e-d39f7935efa0@amd.com>
 <e36699cf-c73e-401b-b770-63eba708df38@intel.com>
 <5ce67d8f-e207-4029-8fb3-0bc7deab1e9f@amd.com>
 <390bbb7b-e709-4290-9bef-eed373e469b2@intel.com>
Content-Language: en-US
From:   "Moger, Babu" <babu.moger@amd.com>
In-Reply-To: <390bbb7b-e709-4290-9bef-eed373e469b2@intel.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?MzYvdW9iV0RUQVBoL01NR2Z0WEhRMHZ2a1dHL0lUNDJXemMvakVGa1RKOHFN?=
 =?utf-8?B?YkVsdGhvMWI1UlBRZmtNSnpkOGtQQW8xWHpQUC9hT0ZSL25na282ZHVkS2N1?=
 =?utf-8?B?bTAzUVNpZlplSVU3Y2lhVU0yMmRXRkNEMnBpYncrRlE2NDBTY01NYkFrRDV3?=
 =?utf-8?B?QThhditIOGIxM0FJdVRvVFhMUWZQT0pyZkNJQ2FDcU8rU01IQ0hBaEVtYk8w?=
 =?utf-8?B?ZERPUFhFZFJIeU1WM2IwNTZVUWxXN1c4UEhuWEZlQnp2Tm1JVk1EMDVSS0pr?=
 =?utf-8?B?N1RzSTl5ZjdRejM3KzVocW50K1JEQVVZOHIzTFYyNVZWVnRaTTJlQTJIbDlz?=
 =?utf-8?B?UDJVQjFsNSt0bDJ4ZlNhelE2Ky8vb1hTZWhpMXFQbzliZTZvN214MS85aEpv?=
 =?utf-8?B?VVdSS2VkQ2ovOW9LV2diaDcydlRPSXJwdFhZYlRrZENNS2xoWUFYRDFhQWh1?=
 =?utf-8?B?WTlFakJLcnVyeE03NGZYbC9EYWc2YWMyL2V2RzdhV2NQRHlMSXlkWWh2TlRs?=
 =?utf-8?B?U2txSlo4akd6M3dUYUF4OTVHV0tQNnhhMFZudlhPZ0JnN2txVnVVajlYdG9D?=
 =?utf-8?B?Y0N3Q0Vic0lGalpRVVc4N283OUZVRkZMVytQZGRZNVZZMXRoRVdFMUd0NjBa?=
 =?utf-8?B?eHh3a3hsSlR2NWt5blNiQkR6bUN1Vk90bWNTOUJybDhGcHBCN3U5ZVNZdlp3?=
 =?utf-8?B?TEdQbnpQNEkvRndaQ1REaG8rUmRQcll5d0ZEMFNaVEZaMVVubTRVYzJicWZO?=
 =?utf-8?B?K3cyVEV5amhKblVTRWZMeHJwVTZsTFN1MFYzbURjMUY4NWdDT3VBdjBHQlJN?=
 =?utf-8?B?MThTM0YrYW1KRk9HR3RJazc0K1I4QkYwa2IzU3VBdWtYVXJoSDhPampUS2xC?=
 =?utf-8?B?aGFIUlNIYkRCeEp2VHY2ZnQxNFlpZnlYOWRTdzMxT3JvckI4bU1RUUVreFJG?=
 =?utf-8?B?RnZOL0NTS1VpOUdOVHh5SUNLdVZlbnBwUkdZWjRwN2dyVE9kaHkvODdhMVFZ?=
 =?utf-8?B?aXdaeEhxcUY0SXRWeGVZQjZZU1NmcklERHdYWGV0aGRRY2gvUkZjcFNHY2FH?=
 =?utf-8?B?dkhjZUs4WERPellOT3lZMVlxQXlxQzdZdWVtblQwQVB3Q2o3T0gvMkgvTTU3?=
 =?utf-8?B?SzBJTlo4TkZGeEhxVS9lcVE5bDRBZDdRSXZKcE9kYTVsYWdFZGhJa2owbmtq?=
 =?utf-8?B?aDROeU1uTVJQR2xkTUZibWpNZWR1SjR1U1hsSEFrME9PNDBhVm8wZFV6ellt?=
 =?utf-8?B?ZUZLdWZSc0lCMFFFM2hqUnhMdTNPd2dZOHVBeG5FOGlZdHJIdFZSMklCZmxC?=
 =?utf-8?B?cm9qQ0ZQMUYrLzlSV3ozU1pwUUVtUmttTks4ZWQ4YW40Q3VHQjBRMlNOYllh?=
 =?utf-8?B?dXRHbkxiR1hDdE9JT3BiZWswcmI2LzQrSlVPRHF5ak9jdGRmYkkwa2d5cUZJ?=
 =?utf-8?B?ZURYVTYveHF5cXJOVFdEczA1VUtiYnF3Z1g2eXA1dC9McHM1RVZhZi9KV1Nl?=
 =?utf-8?B?ZkdvalZldzZocVVubVUyV1NISllFbDZHODIyV2x1blRrWDBvTkZqRXVHTmpn?=
 =?utf-8?B?M1hSQ2cyTFdpcGZoa2R0bHFjWlVjZFdraWFVajc0eCt2cHBqaXhqeit1cDc1?=
 =?utf-8?B?RjgxTXpBamZBYThYbyt6Z3FmL29laU9nc0JaK0pNbFJMWjFtZE1ucEVQV1Jz?=
 =?utf-8?B?UWhTS0kxSUpRVEZRcjlDOXpremlOaGs2cURDV25zeko1K0lrNEo3bFJjQTRs?=
 =?utf-8?B?OVl3b0ZybmV3U2RMTmdCR1pVSU40aHRJRzZKOWNKOWowVDNQQXFyYXNrUno1?=
 =?utf-8?B?SlA2ekVpUy92UVhFK2p5VTdwMmN1eVE3MTBEMXBHbXZENzRFd3B1cmowaG5I?=
 =?utf-8?B?SlZHa0J1dXR4ZlJPNjFXZEpJb1pOQlR0M0pRTjJYWCsxcG45Tm1ZdlNhTDNi?=
 =?utf-8?B?ZjhGRnBKYnFpU2JVZmRMZzE2R01WRTlNcHkzSlEvd3NodDlvdTRjeERUSmdU?=
 =?utf-8?B?VnRQekYwemI2ZW9TRmFMUzExU2ZxOVREMW5FNjh1LzJvaWtMbjVVaGlaU2Zo?=
 =?utf-8?B?Ync2R1hMbW01cFR3T2t1d0x4SDRSZ296SkR2TkJqL1hRaU54RTk5RmU4VS9a?=
 =?utf-8?Q?spjk=3D?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: d35bcccf-66f5-45bf-b38e-08dbf84137dc
X-MS-Exchange-CrossTenant-AuthSource: MW3PR12MB4553.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Dec 2023 22:58:39.8471
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: tgYJDs/zlDfY+Y3eKBJphWVvn1mccLYvr/iGQmC3niNDtB2sg52Ke+BOuoeHDZdi
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4375
X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,
	MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE
	autolearn=unavailable autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on agentk.vger.email
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (agentk.vger.email [0.0.0.0]); Fri, 08 Dec 2023 14:58:57 -0800 (PST)

Hi Reinette/Peter,

> -----Original Message-----
> From: Reinette Chatre <reinette.chatre@intel.com>
> Sent: Thursday, December 7, 2023 1:29 PM
> To: Moger, Babu <Babu.Moger@amd.com>; corbet@lwn.net;
> fenghua.yu@intel.com; tglx@linutronix.de; mingo@redhat.com;
> bp@alien8.de; dave.hansen@linux.intel.com; James Morse
> <james.morse@arm.com>
> Cc: x86@kernel.org; hpa@zytor.com; paulmck@kernel.org;
> rdunlap@infradead.org; tj@kernel.org; peterz@infradead.org;
> seanjc@google.com; Phillips, Kim <kim.phillips@amd.com>;
> jmattson@google.com; ilpo.jarvinen@linux.intel.com;
> jithu.joseph@intel.com; kan.liang@linux.intel.com; Dadhania, Nikunj
> <nikunj.dadhania@amd.com>; daniel.sneddon@linux.intel.com;
> pbonzini@redhat.com; rick.p.edgecombe@intel.com; rppt@kernel.org;
> maciej.wieczor-retman@intel.com; linux-doc@vger.kernel.org; linux-
> kernel@vger.kernel.org; eranian@google.com; peternewman@google.com;
> Giani, Dhaval <Dhaval.Giani@amd.com>
> Subject: Re: [PATCH 00/15] x86/resctrl : Support AMD QoS RMID Pinning
> feature
> 
> Hi Babu,
> 
> On 12/7/2023 8:12 AM, Moger, Babu wrote:
> > On 12/6/23 12:49, Reinette Chatre wrote:
> >> On 12/6/2023 7:40 AM, Moger, Babu wrote:
> >>> On 12/5/23 17:17, Reinette Chatre wrote:
> >>>> On 11/30/2023 4:57 PM, Babu Moger wrote:
> 
> 
> >>>>> b. Mount with ABMC support
> >>>>> 	#umount /sys/fs/resctrl/
> >>>>> 	#mount  -o abmc -t resctrl resctrl /sys/fs/resctrl/
> >>>>>
> >>>>
> >>>> hmmm ... so this requires the user to mount resctrl, determine if
> >>>> the feature is supported, unmount resctrl, remount resctrl with feature
> enabled.
> >>>> Could you please elaborate what prevents this feature from being
> >>>> enabled without needing to remount resctrl?
> >>>
> >>> Spec says
> >>> "Enabling ABMC: ABMC is enabled by setting
> L3_QOS_EXT_CFG.ABMC_En=1
> >>> (see Figure 19-7). When the state of ABMC_En is changed, it must be
> >>> changed to the updated value on all logical processors in the QOS Domain.
> >>> Upon transitions of the ABMC_En the following actions take place:
> >>> All ABMC assignable bandwidth counters are reset to 0.
> >>> The L3 default mode bandwidth counters are reset to 0.
> >>> The L3_QOS_ABMC_CFG MSR is reset to 0."
> >>>
> >>> So, all the monitoring group counters will be reset.
> >>>
> >>> It is technically possible to enable without remount. But ABMC mode
> >>> requires few new files(in each group) which I added when mounted
> >>> with "-o abmc". Thought it is a better option.
> >>>
> >>> Otherwise we need to add these files when ABMC is supported(not when
> >>> enabled). Need to add another file in /sys/fs/resctrl/info/L3_MON to
> >>> enable the feature on the fly.
> >>>
> >>> Both are acceptable options. Any thoughts?

I think we didn’t conclude on this yet.  I will remove the requirement to
remount the filesystem to use ABMC.  That way users can move back and
forth between the modes without having to remount. We need to take care of
extra cleanup of states(data structure) when user moves back and forth.
Hopefully, I should be able to take care of that.

Thanks
Babu