Received-SPF: pass (google.com: domain of linux-kernel+bounces-97685-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161;
Message-ID: <55b868e8-6fdb-44a0-958b-892170a33f0f@intel.com>
Date: Fri, 8 Mar 2024 15:08:12 -0800
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH v5 0/2] x86/resctrl: Pass domain to target CPU
Content-Language: en-US
To: Tony Luck <tony.luck@intel.com>, Borislav Petkov <bp@alien8.de>, "James
 Morse" <james.morse@arm.com>
CC: Thomas Gleixner <tglx@linutronix.de>, <x86@kernel.org>,
	<linux-kernel@vger.kernel.org>, "Yu, Fenghua" <fenghua.yu@intel.com>, "Ingo
 Molnar" <mingo@redhat.com>, H Peter Anvin <hpa@zytor.com>, Babu Moger
	<Babu.Moger@amd.com>, <shameerali.kolothum.thodi@huawei.com>, "D Scott
 Phillips OS" <scott@os.amperecomputing.com>, <carl@os.amperecomputing.com>,
	<lcherian@marvell.com>, <bobo.shaobowang@huawei.com>,
	<tan.shaopeng@fujitsu.com>, <baolin.wang@linux.alibaba.com>, Jamie Iles
	<quic_jiles@quicinc.com>, Xin Hao <xhao@linux.alibaba.com>,
	<peternewman@google.com>, <dfustini@baylibre.com>, <amitsinght@marvell.com>,
	David Hildenbrand <david@redhat.com>
References: <ZdZPht8hY4J9uIOz@agluck-desk3>
 <20240308213846.77075-1-tony.luck@intel.com>
From: Reinette Chatre <reinette.chatre@intel.com>
In-Reply-To: <20240308213846.77075-1-tony.luck@intel.com>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?bWo4blVENGJYekowcGZOZ1lUdHM2WTVwZGhwRHd3aXpWVUtTOWdZN3NraHF4?=
 =?utf-8?B?M1dXVVpubnArTy9Qelc3eWhlSHNVN2QwS29GRGp4UmU5TndjOHkyaG1XK2VL?=
 =?utf-8?B?K1dmajY5SFRqWjgzYU5ZejVkS01lWWVBMStGekwyajJ5Y2g5c3JzTzYxRSto?=
 =?utf-8?B?b1dtMVFQWXF4WENmckVyV0QyNnhrblVNL1M3MytlSFBBRGU1dWtVc1FPZjdU?=
 =?utf-8?B?ZEdPRXlXSnRIWVMyc0o1QWw2Q2VEWlZEc1p6QlBaQ0taWThVT1djb2dkY2lE?=
 =?utf-8?B?U1dONjhxMy9pZ0ZWazg0KzRvNEdEUTVzTS9JY1ovbTFrY0dHR1paVG9tcG9M?=
 =?utf-8?B?dmNWY2doN2pCSmRMR1JGK0dWRzBaSDNmd0xPSytsZk9vcHN6bHc5V2hFVWpD?=
 =?utf-8?B?Qnk4VmVrYXI4YjlrNkVIektLcHYycTNlZmY0dVdzL0xJYU5nR3lZcjhsdXJp?=
 =?utf-8?B?bU9HZ1pEa2RFWlh3NU96SlRwOEtDVlVmSzlnY0VCa2pmcWRBWGZGZ3RObko5?=
 =?utf-8?B?YUlzZVlDS0gwT1NvY1hzazdoWXJMSUR5NGYyamxtRTNVckdiQmxDQTlyQndw?=
 =?utf-8?B?a3FyN2tXajhLVkRGeDlKaFREZCtPdmJYcnc3N2VJc0pXRGppRWYyVVJsTHVZ?=
 =?utf-8?B?Z0drSUZib3hyWjJnUFp0eTQyVk9hc21sYjlENGNFWm84enZMaWxVTzNadDEw?=
 =?utf-8?B?SkgzS0x0Q0RmSnRjTnZDR2t0TlBQbFhaOTc0Rzh1MkZhblQveEVYKzc5RVVk?=
 =?utf-8?B?Qitva1h4LzRVOEJPK0VuRDdKMVBmQmF5L0VUOHNDcHFRNjR1MzRPaXFYUVp4?=
 =?utf-8?B?L2tTdTVYbVdqVkZXL3RSOWNUQ1FWcG9jMy8xQ0VlcExGUVlEaGJyRnhocHZL?=
 =?utf-8?B?am5xQmo5b1pEV1F2RlJiNm13a3RXMUJyQ3hBbFdac0pZWnJiRUE1SVN6YW5E?=
 =?utf-8?B?WkloSXVaZW0yU0ZxRmFSbzIzZ3huMnJ0Vk91b3BBbnE1NjVZUzkrRy9wZys2?=
 =?utf-8?B?aktlZUxNS21GWnJjU2VkNmZ3OUJ1cGs2ZE42cVZEZjE1UVNZWGtGbUhDQ2NJ?=
 =?utf-8?B?MTcxdVVNdEUwRjRGUWlaMWkxZlNRQTJCYWd1VlZJU1YxK3V2NTlJM0hlakNh?=
 =?utf-8?B?UmhWV202T0hiNVFmNGdRemNHZys5QW9hSUhVR1Z3UzhRYk43UHJLb3dyVFhp?=
 =?utf-8?B?Rkd3SGpNSTJIT3FWa2hWaUkzZ2pQWG4wV2NsY1ZmWFlvUlRuNXF6R05KZUFx?=
 =?utf-8?B?bXVXZElkV0xnWUdvQkx2RWhYZjZUcmRhWE5ISk9DNU1HRi9SMGU3eVN0NHFw?=
 =?utf-8?B?ZXdPeWhkNS9iYWpNdjRKaFR0R05oZWlSRjFMWXZ5c3NOR3YvVERJL2hUc2h4?=
 =?utf-8?B?ZlFJLzlReStoaHIvWTJhTE56UGNpdnBMaWtxTmhaeGFkSDhSWCtUc3lxdndD?=
 =?utf-8?B?RTJYNmV4YldJaVl0dnMwYkFGalhOK1hYS1ExOFM2VSt6Rm8vWXZVRzF4Q2x0?=
 =?utf-8?B?Y2p2QzVDazdiM2RlTVJwQWVvV2ZCcHVrNmtkODFPVTRoMmttcDVtU2hEc0Vr?=
 =?utf-8?B?SUdNd0NVQXdJSXQwNUs2bEJlbGtWbkVlbDdVdXF1M3k0QkI0eHJreFd6OHVO?=
 =?utf-8?B?ZjlzUHF6eU8rQStBcnRwYWVXYW5sSGU5VWFRQ01kWWJJejRMUGxVY1JOa3py?=
 =?utf-8?B?QldyUDdiYnFaRGhBS0FnTXRUZEFYMHBFRXVjMWc2MngxYVdacFgreHhUcFFl?=
 =?utf-8?B?dGVKZGRsMGl6bmFqTWRuOVZEMVRaM0I0ZURHSXRmMC9XMGkzSVhpY2VSTml5?=
 =?utf-8?B?Z2lDMWVtZlZLZ1FOdGlreGkvTjBMbUxmbitjdm1qVDdFYVI2YTkzS2JONHMv?=
 =?utf-8?B?SEVGMFhmellPUHhYZ1dkTEFIUEhxTFE5blRKTFVtTEVla0JkVFhqcjJCVEtJ?=
 =?utf-8?B?aDNTSkRJVTd2cUJBMXpnMnk5UkYxZUo1NUFxd1lVYmQ3YXMrNk9MeExJK1BJ?=
 =?utf-8?B?ai9xZncrSnJ3Z01CamRSb2NabFF0WGNyQnJWNk10KzlvQXp3cExtdEdQaXBW?=
 =?utf-8?B?NFdkQVY4RG9XQXdiVTh4UnpwY3hwSkZDa2JsSkh1bmFnVEYwYWtQdGZxYmRJ?=
 =?utf-8?B?MmhVUXdEQjdudGN0OTluK0ZqQWRrRlR6QWJnVnR2RktuZHp2ZmhJRXA5SVV2?=
 =?utf-8?B?d3c9PQ==?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 562c197e-dd06-4097-abb5-08dc3fc4a251
X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB7573.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Mar 2024 23:08:15.0340
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 9CsflgAcVoIvQaa7C8rwuYCX6QGAMiVGzLlvsw1cfXTHAHrPfPH1R6PnYHU8qg111B1TkXyoNYJjFpHeoi/9+Wy85SOgROkeRqaxOBjKY7Q=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR11MB5300
X-OriginatorOrg: intel.com

Hi Tony,

On 3/8/2024 1:38 PM, Tony Luck wrote:
> reset_all_ctrls() and resctrl_arch_update_domains() use on_each_cpu_mask()
> to call rdt_ctrl_update() on potentially one CPU from each domain.
> 
> But this means rdt_ctrl_update() needs to figure out which domain to
> apply changes to. Doing so requires a search of all domains in a resource,
> which can only be done safely if cpus_lock is held. Both callers do hold
> this lock, but there isn't a way for a function called on another CPU
> via IPI to verify this.
> 
> Commit c0d848fcb09d ("x86/resctrl: Remove lockdep annotation that triggers
> false positive") removed the incorrect assertions.
> 
> Add the target domain to the msr_param structure and
> call rdt_ctrl_update() for each domain separately using
> smp_call_function_single(). This means that rdt_ctrl_update() doesn't
> need to search for the domain and get_domain_from_cpu() can safely assert
> that the cpus_lock is held since the remaining callers do not use IPI.
> 
> Signed-off-by: Tony Luck <tony.luck@intel.com>
> 
> ---
> Changes since V4: Link: https://lore.kernel.org/all/20240228193717.8170-1-tony.luck@intel.com/
> 
> Reinette: Only assign "cpu" once in resctrl_arch_update_domains() [but
> see change from James below]
> 
> James: Use smp_call_function_any() instead of cpumask_any() +
> smp_call_function_single() to avoid unnecessary IPI in both
> resctrl_arch_update_domains() and reset_all_ctrls(). This
> eliminates a need for the "cpu" local variable.

Great catch, thank you for doing this. 

Also, could you please stop referring to previous versions (in this
case it even follows v3) using "In-Reply-To:"? Although v5 here
follows v3, not v4. You previously [1] agreed and did so for v4
but not here.

Reinette

[1] https://lore.kernel.org/lkml/SJ1PR11MB60839AD3BC4DB15BF5B0BBE0FC562@SJ1PR11MB6083.namprd11.prod.outlook.com/