Received-SPF: pass (google.com: domain of linux-kernel+bounces-167029-linux.lists.archive=gmail.com@vger.kernel.org designates 139.178.88.99 as permitted sender) client-ip=139.178.88.99;
Message-ID: <c8a23c54-237c-4ebb-9c88-39606b9ae1ab@intel.com>
Date: Thu, 2 May 2024 16:00:17 -0700
User-Agent: Mozilla Thunderbird
Subject: Re: [RFC PATCH v3 17/17] x86/resctrl: Introduce interface to modify
 assignment states of the groups
To: <babu.moger@amd.com>, Peter Newman <peternewman@google.com>
CC: <corbet@lwn.net>, <fenghua.yu@intel.com>, <tglx@linutronix.de>,
	<mingo@redhat.com>, <bp@alien8.de>, <dave.hansen@linux.intel.com>,
	<x86@kernel.org>, <hpa@zytor.com>, <paulmck@kernel.org>,
	<rdunlap@infradead.org>, <tj@kernel.org>, <peterz@infradead.org>,
	<yanjiewtw@gmail.com>, <kim.phillips@amd.com>, <lukas.bulwahn@gmail.com>,
	<seanjc@google.com>, <jmattson@google.com>, <leitao@debian.org>,
	<jpoimboe@kernel.org>, <rick.p.edgecombe@intel.com>,
	<kirill.shutemov@linux.intel.com>, <jithu.joseph@intel.com>,
	<kai.huang@intel.com>, <kan.liang@linux.intel.com>,
	<daniel.sneddon@linux.intel.com>, <pbonzini@redhat.com>,
	<sandipan.das@amd.com>, <ilpo.jarvinen@linux.intel.com>,
	<maciej.wieczor-retman@intel.com>, <linux-doc@vger.kernel.org>,
	<linux-kernel@vger.kernel.org>, <eranian@google.com>, <james.morse@arm.com>
References: <cover.1711674410.git.babu.moger@amd.com>
 <f7dac996d87b4144e4c786178a7fd3d218eaebe8.1711674410.git.babu.moger@amd.com>
 <CALPaoCihU+mat2A-wNtTm=qbpya8ZqhDURsfZfjuHitch0WrLA@mail.gmail.com>
 <9d59d38b-af1a-46d8-81c4-b426d47d4ed6@amd.com>
 <CALPaoCgFEybS5MhsPx4EaJmsfBe8Es_6QwWBXpoctdaNf0NcMQ@mail.gmail.com>
 <80c56417-3d74-7d68-1228-9cd944567b4e@amd.com>
Content-Language: en-US
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <80c56417-3d74-7d68-1228-9cd944567b4e@amd.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ZmdQQnora2FDU0c5Q01ZTXpHeXozaEdXM2xoTnVjcmdUUGx6WkJlZnM4TmZq?=
 =?utf-8?B?RWdjenBkblJtWXZwSXRrazYrNzc1RzZwYk1PMzVteWJTd3ZVKzVSekVSYXQz?=
 =?utf-8?B?c2Z2TlplMlU5NTBFYjVrZkpmOFJJMG9rd2hHczI2VE81Vjd6R0t5TmV5eURl?=
 =?utf-8?B?eDVHVWZVS2x0RGRqZTZVVEFISlhaT0N0NSt0YW1QdTBHazdGNktQekZaakZ3?=
 =?utf-8?B?SXZ6KzlCa1d3a2Fqc0Q2V1VvUzRuUkxINDdMRU53eXdKNkxrVzl4TExyNjA2?=
 =?utf-8?B?M05CNjA2anBOVUVpQzhuaXB2S0VlanhFZnZnV1FZcmZOY3IvTURNREZTQlZV?=
 =?utf-8?B?RW1mRDRJcG5RSW5zVjMxcUZoVlJWclBmcGRrQUk2dWF0M25GRmtwTlBDOHBo?=
 =?utf-8?B?YjJiUU9HQVJtenhQVDFwMkNVa1c3bkFsNzgxNXdtbks4WjhScU11SEZEbGJq?=
 =?utf-8?B?T2ZtMjRqakZjcmhDQjlWdndRWE9veUgxTC9jY0pDblc4L2xncC9BTGt3dTE2?=
 =?utf-8?B?YVF4S1AzcHBtZld1WW8xTzV4VC9QanYvOHZZcU5QR1dhNHV3ZjIycWcyQ0Rl?=
 =?utf-8?B?WmF3aXU1eG9UWlRycmFnTmYrb0Mwdk5TTUFPUEJQT0xtaVBwbFI1Q2ttUWJC?=
 =?utf-8?B?bmswSjVGWldta1o3UVUyMjZpOFVhdnZJQTBVYzNqd3loTk9ZV09qaE5kOFo5?=
 =?utf-8?B?VVVyTE5ocHhqSXpneStsQXdHNFJxK3FCc2dGQ1k5UHRhb1U0cDI3UlVKOW1F?=
 =?utf-8?B?MlFoU0lnWWVZaEVOU2o4OWtGOVozR3VyOGRQYTFpS1dteFdHSlRCNWgvR0lz?=
 =?utf-8?B?ZkM5MWtteUdGTS9xRWcxcjFWc0dlTXF5Q3pJZXp5NGRpUzAycEtNUXVoNmJO?=
 =?utf-8?B?TG5SWnpGWFJOVTNaTm5vWjJWUS9UbVc3ZmtsdzQ3ZGZEcVEvWUIzRE1qNE5C?=
 =?utf-8?B?VmpyRWs0SjVYR05lMm1QbGlLR3BteENQQ1F1U0YvVDBSUHVENDNUSVNUU1kw?=
 =?utf-8?B?cGROeVRvRiswQmpGOUhpRjhMK2ZFMjV5YkpMSG1hQ0dTZTBIUFIvT0MxZm1Z?=
 =?utf-8?B?SVlaVjBxTVNOTVhOaldQV2c4bmZDbVUxMmFkS05JWTJNNUZTWEVMMUhBeVB5?=
 =?utf-8?B?T2hBMFc4cC9TVXpjNDBDeHZONnJpSXlFYTFPUkVDZWRQaS9EWm52d1hYUXc0?=
 =?utf-8?B?eksyazgwOHM3SmZtNkxmai9zd3ZEcm9kWjhSOXFLNWl2bnBRTSt5OWg2SXRM?=
 =?utf-8?B?NUhER2VDczNSamw4YjVRSlRSZ3dKaTdxUGZ4dGlwTW5pSVEzS3J2V3RQS3Ez?=
 =?utf-8?B?ZnM0M2kzOExuU0pJUmF1NVRqd0pYcEhjdktETzU4OXMyeXduMmxUdkltVHdP?=
 =?utf-8?B?bkJPbnE3ck95czd5RjBYUVdadndQUGcxc3R5ajlud3dRTEQ0a3ZISDB0STlq?=
 =?utf-8?B?N3ozYk1nVk5qTlplcjBWOEExSGZ3Szg1eFhpU1VFRkhCNUFjNmdpeVc2Z21N?=
 =?utf-8?B?UVkwWnZVYjgyTWlhVWs2QVFFWGk1NUlZVW00RGxtOG9BdlRYcS90UURTNDRW?=
 =?utf-8?B?NEF6Q1owVks2T3FPcE05MWhCbVFieXczTTViRnRqRTR4L2VDZ3l1OHZDNFV3?=
 =?utf-8?B?bEtYTTNsVmZWQ2l4M1RuZUNrYkNnMXl1UnkxWlNtY0V3VFA1U21Qd2ZJYWRB?=
 =?utf-8?B?aXN4ZkZoK2hVd1g2QWtxbzlyMHVueG9ib3NObmVRTVFjZ3poSXFpTlJMc0hx?=
 =?utf-8?B?M0Q4VXFqRTRDS1pCM0IvNmdQcXREY1VYaVJCOVhPYTdlYzc5OHBWem94NW9i?=
 =?utf-8?B?VFVPQXdJUWFiQ2V0VE8xSkE0N2tNdytkUnREYVdpSjJXYWJyY0kyRWRmSDZ5?=
 =?utf-8?B?ZUppSTNycVg2SGYwUUpRdktSeitsYTdRcXlHazBBTUpnNXFrbUpPbXJLeHJL?=
 =?utf-8?B?NW5ZVDBrQjUwMDhzbFl5b3gxZnowaWNETFBkRFB3SHVKb1FiMWxlaGdsVXhj?=
 =?utf-8?B?Q2Vlc3k1VUIwcllOc1liVG1lQ0ltQndwaldGcEdzSE1oRXlkbDE5WENQUnBz?=
 =?utf-8?B?aEtpamRybEEyb0M0dFUvZC9LNjkyUXNFb3pHYXFKQjhwL0hJZ0dqZmVvMGFk?=
 =?utf-8?B?bWxZMCtpNGxra0g0TjB6Y0hTajZ5RnlBdkpQMzczVGRRNVhPeEcxS0JlZ2NX?=
 =?utf-8?B?Tnc9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: deaa6f48-0e7a-400b-7fa7-08dc6afba479
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 May 2024 23:00:21.0330
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: CGctgyM7+BVlkFvEo/M6hCOnhK4gXvpFUzH4deq9aEsGA3C1Tv0F/9ty5TD17gD5Qc9nsK6LZ9x3xtekZalINUNjhlYPBHgplPui79xV80I=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR11MB6934
X-OriginatorOrg: intel.com

Hi Babu,

On 4/17/2024 3:52 PM, Moger, Babu wrote:
> Hi Peter,
> 
> On 4/17/2024 3:56 PM, Peter Newman wrote:
>> Hi Babu,
>>
>> On Wed, Apr 17, 2024 at 12:39 PM Moger, Babu <babu.moger@amd.com> wrote:
>>> On 4/17/24 12:45, Peter Newman wrote:
>>>> On Thu, Mar 28, 2024 at 6:10 PM Babu Moger <babu.moger@amd.com> wrote:
>>>>> diff --git a/Documentation/arch/x86/resctrl.rst b/Documentation/arch/x86/resctrl.rst
>>>>> index 2d96565501ab..64ec70637c66 100644
>>>>> --- a/Documentation/arch/x86/resctrl.rst
>>>>> +++ b/Documentation/arch/x86/resctrl.rst
>>>>> @@ -328,6 +328,77 @@ with the following files:
>>>>>           None of events are assigned on this mon group. This is a child
>>>>>           monitor group of the non default control mon group.
>>>>>
>>>>> +       Assignment state can be updated by writing to this interface.
>>>>> +
>>>>> +       NOTE: Assignment on one domain applied on all the domains. User can
>>>>> +       pass one valid domain and assignment will be updated on all the
>>>>> +       available domains.
>>>> How would different assignments to different domains work? If the
>>>> allocations are global, then the allocated monitor ID is available to
>>>> all domains whether they use it or not.
>>> That is correct.
>>> [A] Hardware counters(max 2 per group) are allocated at the group level.
>>> So, those counters are available to all the domains on that group. I will
>>> maintain a bitmap at the domain level. The bitmap will be set on the
>>> domains where assignment is applied and IPIs are sent. IPIs will not be
>>> sent to other domains.
>> Unless the monitor allocation is scoped at the domain level, I don't
>> see much point in implementing the per-domain parsing today, as the
>> only benefit is avoiding IPIs to domains whose counters you don't plan
>> to read.
> 
> In that case lets remove the domain specific assignments. We can avoid some code complexity.
> 

As I understand counters are scoped at the domain level and it is
an implementation choice to make the allocation global. (Similar to
the decision to make CLOSIDs global.)

Could you please elaborate how you plan to remove domain specific
assignments? I do think it needs to remain as part of the user interface
so I wonder if this may look like only "*=<flags>" is supported on
these systems and attempting to assign an individual domain may fail
with "not supported".

Reinette