Received-SPF: pass (google.com: domain of linux-kernel+bounces-141236-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223;
Message-ID: <47af4fef-35d3-4d88-9afa-42c1a99fbe07@marvell.com>
Date: Thu, 11 Apr 2024 21:21:38 +0530
User-Agent: Mozilla Thunderbird
Subject: Re: [EXTERNAL] Re: [PATCH v1 28/31] x86/resctrl: Drop __init/__exit
 on assorted symbols
To: Dave Martin <Dave.Martin@arm.com>,
        Reinette Chatre <reinette.chatre@intel.com>
Cc: James Morse <james.morse@arm.com>, x86@kernel.org,
        linux-kernel@vger.kernel.org, Fenghua Yu <fenghua.yu@intel.com>,
        Thomas Gleixner <tglx@linutronix.de>, Ingo Molnar <mingo@redhat.com>,
        Borislav Petkov <bp@alien8.de>, H Peter Anvin <hpa@zytor.com>,
        Babu Moger <Babu.Moger@amd.com>, shameerali.kolothum.thodi@huawei.com,
        D Scott Phillips OS <scott@os.amperecomputing.com>,
        carl@os.amperecomputing.com, lcherian@marvell.com,
        bobo.shaobowang@huawei.com, tan.shaopeng@fujitsu.com,
        baolin.wang@linux.alibaba.com, Jamie Iles <quic_jiles@quicinc.com>,
        Xin Hao <xhao@linux.alibaba.com>, peternewman@google.com,
        dfustini@baylibre.com, David Hildenbrand <david@redhat.com>,
        Rex Nie <rex.nie@jaguarmicro.com>
References: <20240321165106.31602-1-james.morse@arm.com>
 <20240321165106.31602-29-james.morse@arm.com>
 <c27c7813-5744-4363-bb7b-f9fbe80fd549@intel.com>
 <ZhfzF8L6w1pgJJ1r@e133380.arm.com>
Content-Language: en-US
From: Amit Singh Tomar <amitsinght@marvell.com>
In-Reply-To: <ZhfzF8L6w1pgJJ1r@e133380.arm.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?utf-8?B?aG9nWXhIeXV6Uk05ckIvdXZxYVBSejNQMENVTTFPSnpOLzI5MEZJdVJDcENG?=
 =?utf-8?B?cUtFd1hxNjQ4VGJRUmQ4SkdJWC84Z3VtdlFsQlJ6T1dqUEhzMVY5TmUrTm9M?=
 =?utf-8?B?Nkw3TXZKNUNsYTRFREdJaUFHZWhyS1JEN0R3REdSSGlvUFBoc0Q0T0U1OXlr?=
 =?utf-8?B?RU1uOElWNzQ1WXJidm80ODZMU3YzZTZoSWk1Nm5xYzR6RktFZ05SSFM0THFH?=
 =?utf-8?B?TFFmQlJlem9qaVNWNjBSZ1Z3bXFQamJKMXZvQzNVNUVCaUV3Yjg4SzI3NlFV?=
 =?utf-8?B?Q252YnFJS3RycUJGZDFGbWx3SXU3bVhnY3dobEN0S1Z6MDUxM1YyS1FJcGRz?=
 =?utf-8?B?QU14a3Y0Vm5jUlFhSmJUUzFvc2ViRkthRXV2Z3d5UDFwbHdxMUFLelBqVXRM?=
 =?utf-8?B?NGxxRVpMZjl0TnRWSzIvS2V4Sk8vZFExeFJSdm1aNWZzeEhOOFBPbXNaajdt?=
 =?utf-8?B?cVgxUlRSZ3dzdDY5V2V6dlpGNzYzT1BJdGFHSldMd1ZWRVRRb2lDbVdyMnB1?=
 =?utf-8?B?dFFDUllGSEFKaVZ6SC9LVWRZaXpQVU5qMHB0b1JjbHlLMzBLRXNXdWtvWmw1?=
 =?utf-8?B?Ym1icEV0cEtHU1Qvb3FpZXY3L0pYamppaVhxVnp6eE5TVmZHOW1FWmx3b0RZ?=
 =?utf-8?B?TERISGZJc0hQQnN0MzNjWmMzVEN2YzBEZHBkOWNsWkxrYWtDd1Vha1FnNmIv?=
 =?utf-8?B?SzlhbThJRzVqclRnOUxjVWF6Ym15OUNCZUVKVlB1emZGb2pqS1lxS3h1MDY3?=
 =?utf-8?B?bHBWd2IzMUdXaTI5RGRVQkJCT053ZnVUUWxBbWpEaGFOL0xoWGRFNXRsakhx?=
 =?utf-8?B?cG9MaUFseVczY2wxVTJDbkx1RXZxcVdBVllmbU9tc1pYYWVMY1JUME1wZEJi?=
 =?utf-8?B?K0t5Si9wMU1IaDJFd21zbUJVWnBqUHJONXBjaHJJNE44VzM4MHVwRThxbUxv?=
 =?utf-8?B?SzhwaElISVlqdHB3S3dMNlFJQ1ByVFl4WU1pSEZKV045WFRWMElLV25Pc2Yz?=
 =?utf-8?B?TEcyWnpHU3I0VTFBYmNCbkJtVUovbHFmcW5VRTZRVFVoQ2phTHh5VXgvSDJJ?=
 =?utf-8?B?Y2hOYlBjckhzUUNVT0d1VjI2cHMvajY2VzNmSndTN2tEUTUvK0JNUm02Qkha?=
 =?utf-8?B?Y3gzcXVCak90QVBOVXBnS3V0cTRxWWdVamFlNDNRb3BWL21GeDZENHJiNDc0?=
 =?utf-8?B?RWJYMXpuNDhrU00vYUlDZFhTTzR1V1lGcHNnalh4cE9wRkplc0pVMkdvd015?=
 =?utf-8?B?eisxZFNsMXpWeUp4SDh4NnQrVzdRNWZob0ptWlVnSlBxZ0FYbGJuc0JyRXFC?=
 =?utf-8?B?YmtvSVpFWkhJWE9QdWxEVFRZNUJQNmNLTSs2S3J1dFZiaEtwZXN1bDJtZWZs?=
 =?utf-8?B?cm5sL2l4L1d6VWJ0T3VGcU9SeFZGeUFzT28yYmt3dGFQbXEyVkROdC9ab1Q0?=
 =?utf-8?B?ZG9Xa0tlMWNLa3pKU25lKzhZQXE3S3VTSU9SR2hKT2ZaVEtjckFBZTRtQXdG?=
 =?utf-8?B?SkVQUWh2by9nbDlhR3BEUURzZDJodHhOaXY3U1J2V3FIWjRxeVYxU2FJVW5M?=
 =?utf-8?B?RVVZQ0RBM3EzYmlYNWVtSkNwTUh6SEprY0tiTlp5aFdaREZOVEhJcHhiZ3Bv?=
 =?utf-8?B?RFE1VXVjZG14aDJXMVFCTE0rRGY1NitUMG5sRk9LSE5oYy9HTDF6VEFmSENN?=
 =?utf-8?B?WWx3Qk03UnJWUVgzNUlUaGhQdDNSU3RZSlhvUFZlRDE0TktOVlQ1R1RMdDN0?=
 =?utf-8?B?aXJDTEk3SThVU3pieHR6RHhiUlB1TzZ5UFZPT1Y5UHpCdGRhNFE3ZEZHNnpF?=
 =?utf-8?B?MmZjYktXUmtZUHAxTGdmRjRvOUowbEcwVHpua1M5NlpYeWdrN24zMmtOSnNR?=
 =?utf-8?B?bWpxT2w4ejM0Y2Q2em5IQTJSTEFxMC9WT1RqTXE3czZxaERuQTlHMmplR0Nl?=
 =?utf-8?B?RWlXcG5MV01DWGZXbVAvMDVydlFBMDJaTzlyMmRxRVJLUlBuL053Q2UwZ0lM?=
 =?utf-8?B?c0lIYlpzNVMySGhPQy9CanBFdloxWVYyZ3I3UVNpaHNuK3dSNHJZY3psOXMz?=
 =?utf-8?B?SnpORk9oOWlrMlhXUDdCSnRyLzg1eUtsc09zb21jZ3dmbVdtVCtSSWhPUDNv?=
 =?utf-8?Q?sQBHxHzI+wUGohlRM3HOqlwv8?=
X-OriginatorOrg: marvell.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 0fa125e1-fdde-478c-a9fa-08dc5a3f4d12
X-MS-Exchange-CrossTenant-AuthSource: MW4PR18MB5084.namprd18.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Apr 2024 15:51:50.6579
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 70e1fb47-1155-421d-87fc-2e58f638b6e0
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: jbzqwEYiRm5wzs+ZUZ39OB3aad3+6GWyAc1OtKqYuZDOESuH1I7mLRCe5Pfhq7o7MsCsr7K2TAOX5BW/FQbeTA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR18MB4426
X-Proofpoint-ORIG-GUID: ysbyWRyiOQavc4L682Dk0Flif0_MDjvU
X-Proofpoint-GUID: ysbyWRyiOQavc4L682Dk0Flif0_MDjvU
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2024-04-11_08,2024-04-09_01,2023-05-22_02

Hi Dave, Reinette,

> On Mon, Apr 08, 2024 at 08:32:36PM -0700, Reinette Chatre wrote:
>> Hi James,
>>
>> On 3/21/2024 9:51 AM, James Morse wrote:
>>> Because ARM's MPAM controls are probed using MMIO, resctrl can't be
>>> initialised until enough CPUs are online to have determined the
>>> system-wide supported num_closid. Arm64 also supports 'late onlined
>>> secondaries', where only a subset of CPUs are online during boot.
>>>
>>> These two combine to mean the MPAM driver may not be able to initialise
>>> resctrl until user-space has brought 'enough' CPUs online.
>>>
>>> To allow MPAM to initialise resctrl after __init text has been free'd,
>>> remove all the __init markings from resctrl.
>>>
>>> The existing __exit markings cause these functions to be removed by the
>>> linker as it has never been possible to build resctrl as a module. MPAM
>>> has an error interrupt which causes the driver to reset and disable
>>> itself. Remove the __exit markings to allow the MPAM driver to tear down
>>> resctrl when an error occurs.
>>
>> Obviously for the reasons you state this code has never been exercised.
>> Were you able to test this error interrupt flow yet?
>>
>> Reinette
>>
> 
> I think this will have to wait for James to respond.
> 
> There is code to tear down resctrl in response to an MPAM error interrupt,
> but I don't know how it has been exercised so far (if at all).

We are managed to test the MPAM error interrupt (on the platform that 
supports MPAM interrupts on software errors). For instance programming
more resource control groups (part IDs) than available, and It appears 
to correctly remove the "resctrl" mount point (though mount command 
still shows resctrl on /sys/fs/resctrl type resctrl (rw,relatime)
), but

# mount -t resctrl resctrl /sys/fs/resctrl
mount: /sys/fs/resctrl: mount point does not exist.

Additionally, a question regarding this, Is a complete system restart 
necessary to regain the mount?

Thanks
-Amit