Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18;
From:   "Koralahalli Channabasappa, Smita" <skoralah@amd.com>
Subject: Re: [PATCH 1/5] x86/mce/inject: Check if a bank is unpopulated before
 error simulation
To:     Borislav Petkov <bp@alien8.de>,
        Smita Koralahalli <Smita.KoralahalliChannabasappa@amd.com>
Cc:     x86@kernel.org, linux-edac@vger.kernel.org,
        linux-kernel@vger.kernel.org, Tony Luck <tony.luck@intel.com>,
        "H . Peter Anvin" <hpa@zytor.com>, yazen.ghannam@amd.com
References: <20210915232739.6367-1-Smita.KoralahalliChannabasappa@amd.com>
 <20210915232739.6367-2-Smita.KoralahalliChannabasappa@amd.com>
 <YU2Lm+11Pqg/RBK3@zn.tnic>
Message-ID: <78bec0e8-a64a-466c-4245-2386de7db5c9@amd.com>
Date:   Mon, 11 Oct 2021 16:12:14 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
 Thunderbird/78.2.1
In-Reply-To: <YU2Lm+11Pqg/RBK3@zn.tnic>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Content-Language: en-US
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?eC8rOHVrRUFlSmlzdHVqNWRHbTd0WkdSUEpNVlV6cmhJZnpNblhvSDlhQ0Q4?=
 =?utf-8?B?N3VHS3Q3ZEdzaWtiUENiVWxERC9ZSFFXUlFhd1BYUGZ2V01QMHhTL3RvUTFD?=
 =?utf-8?B?R2Z0aWVienVEUUs3OWdWMkJNSk02OVE3MjlMeDU4RlYxNTVpK1BraEwvcnp0?=
 =?utf-8?B?dHMxem5ldTJTRzZNZXdqZlZZTFFEWnc4aUFvVU5nd0FDUHdYajVpYitLb2h5?=
 =?utf-8?B?RUNWdzJoRTFwWkZCeWxXRlBSdkxtL2tzTmNEaHRSMUl5aGxWR2gzRnkwSFJB?=
 =?utf-8?B?MFIvbjdaczB2V3lpL0FjcFRoSlN6ZDR2YXJGWlppVklBUWw4eUx5YW1wMkYx?=
 =?utf-8?B?Y1lDd2dLdERQcGpsOTlHN0M0Vk4yUmtIa2pHYzFuWjVTOEdiYTE0ZDdNUE9j?=
 =?utf-8?B?MnZsS1JrV2hZdFJCS3JRTThJcElMZjJxclRiazJ1MGcySjg4RlV1c1orUXA1?=
 =?utf-8?B?dm43cnBQV2x4L3RmdkxQbkhFWlFIQkpRSmFWS0JUOFYxRFVySnJ2bitXbnZr?=
 =?utf-8?B?N2VNZVJFUHFvWTl0K0kyZlZJdys3NWpLNFZZZzZEamtiU2d1TFp1dFBLbDRH?=
 =?utf-8?B?NjhWSUJVVi9KVDkvbnZiVFgvQXdSSXEvazJNam9SZlZIanNOZW1jMzl1YjVD?=
 =?utf-8?B?T3Ayc09XYVYvUHJjcHhnM25EK092ZHpoUmhqaU1lNU5Fd2RjZk5ZdFJ2Snkx?=
 =?utf-8?B?OWlDNklJdDkzanA1N0VyMDB3S2t3KytMa3ZnTEtCYlhPMEh4b1pPOGdPQ3Y3?=
 =?utf-8?B?S1FWMytZMEV1T1VEUjhhU3dQTjZUUHEyRTc2LzhHQjRORWNERm5PZkpBQ0Q5?=
 =?utf-8?B?bnVoTU5Nczl6bjdnTTdLN1B6bnNKbEJPUXRCUjN3Q3A3TGtWejArVU43WWhV?=
 =?utf-8?B?MVVaaWdoVlc2VlU3cTkzOE9qM2Q1NXN1STBuV0VXQk1SN3ErYnpCWXErR29u?=
 =?utf-8?B?VDc2K0FhWnd5d3lKZEs5Ky9yTXEyVkpmcmtRQTBzQ21Ba3lmdlJadEp4cEFF?=
 =?utf-8?B?M08rSXUyczVKVEc4TUpHOVpwVmZKT2h4T1VHR2VIdUtmM3JxWFBYc2doL3k1?=
 =?utf-8?B?bjVtengyR1JCQmllWVpxTlptQ2V6cnh6cldSZHlYWEtuYnVvbnJ2YS95eE5D?=
 =?utf-8?B?Vm5qdndnNGhDOHJnOFB0eWJzbkFzMXNiaDN5ZjNhR1hHTDZxSHRzd3NpbFBo?=
 =?utf-8?B?RUhtSkU3OFBQcDFkL1Y5NVU4a0N3cDdzS2VTNTZqTVRsWGZqWUdyVkNOam8r?=
 =?utf-8?B?ZWt0Y2JBa2Uxb242Q2Z0TWxyOGdET2RPQVlxR2g5a08wNUpjTW02TDlFTVNQ?=
 =?utf-8?B?RHArY0RRc1lmbTlMR09Wb0xodThOZG5KVndSYjErQk5QWXZoZFZHZStvankr?=
 =?utf-8?B?K0hVV3paait6TTVuS0FXNFY4cTV3NFF5elJmZkZXNVZhWXpFdzU3ZDdLdmlV?=
 =?utf-8?B?SXFkNXpzTnZaR2t6cE9QMDl3TW5EVzlqWUt1OW1FSlE2SXQ5cTAwOVp0TmxV?=
 =?utf-8?B?aC9mZ0lRdkxiOGFhL0ZUa2pIZ3pRMm9VMzlFUWViVlVtY3JKTlEwK05lbERm?=
 =?utf-8?B?OVBzUXN6RjA0VGJJck9ZMGNnZndyOUFQUWZqUE9VUHFMYzRtVnRjanhScHZB?=
 =?utf-8?B?RTRoUVY3d0QySU5MTUJEOC81UlJ5MTRzc2liUE94OVZnMTBQR0praEdqUE9T?=
 =?utf-8?B?ZmNNNjBUMTZiWGpJUDdRR3lsb3A3cldobXh1N0daY3N6ckdYUEFxUEpRL0FH?=
 =?utf-8?B?T0RnMW84d1hoajhjU3RsOWVYcjQvTEE0NXljS21zQlZNRld0Q2FKQTQ5NFZu?=
 =?utf-8?B?T0UvbzdVQk12K1cvOHVtZW5ZcGllVWcvVTkvTURqenNwRXRyc0I5ZHBtV3Zi?=
 =?utf-8?Q?xIUZci4LMnXrE?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 398aa8bb-6dbe-4498-9892-08d98cfbcd13
X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB2869.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Oct 2021 21:12:15.7587
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: n2jRA7mcQ56NJIYzF3R8rpx8RtmM86In/75kG5HDlXNOgnloV+xxDWf6o5xaZzdTwm4ygeVa0f1Dw0le3mokSA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR12MB2776
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hi Boris,

Sorry for the delayed response.

When I was coding this up, I came across few issues. Mentioning below.

On 9/24/21 3:26 AM, Borislav Petkov wrote:

> On Wed, Sep 15, 2021 at 06:27:35PM -0500, Smita Koralahalli wrote:
>> The MCA_IPID register uniquely identifies a bank's type on Scalable MCA
>> (SMCA) systems. When an MCA bank is not populated, the MCA_IPID register
>> will read as zero and writes to it will be ignored. Check the value of
>> this register before trying to simulate the error.
>>
>> Signed-off-by: Smita Koralahalli<Smita.KoralahalliChannabasappa@amd.com>
>> ---
>>   arch/x86/kernel/cpu/mce/inject.c | 18 ++++++++++++++++++
>>   1 file changed, 18 insertions(+)
>>
>> diff --git a/arch/x86/kernel/cpu/mce/inject.c b/arch/x86/kernel/cpu/mce/inject.c
>> index 0bfc14041bbb..51ac575c4605 100644
>> --- a/arch/x86/kernel/cpu/mce/inject.c
>> +++ b/arch/x86/kernel/cpu/mce/inject.c
>> @@ -577,6 +577,24 @@ static int inj_bank_set(void *data, u64 val)
>>   	}
>>   
>>   	m->bank = val;
>> +
>> +	/* Read IPID value to determine if a bank is unpopulated on the target
>> +	 * CPU.
>> +	 */
> Kernel comments style format is:
>
> 	/*
> 	 * A sentence ending with a full-stop.
> 	 * Another sentence. ...
> 	 * More sentences. ...
> 	 */
>
>> +	if (boot_cpu_has(X86_FEATURE_SMCA)) {
> This whole thing belongs into inj_ipid_set() where you should verify
> whether the bank is set when you try to set the IPID for that bank.

I do not have the bank number in order to look up the IPID for that bank.
I couldn't know the bank number because mce-inject files are synchronized
in a way that once the bank number is written the injection starts.
Can you please suggest what needs to be done here?
  
Also, the IPID register is read only from the OS, hence the user provided
IPID values could be useful for "sw" error injection types. For "hw" error
injection types we need to read from the registers to determine the IPID
value.

Should there be two cases where on a "sw" injection use the user provided
IPID value whereas on "hw" injection read from registers?

I'm pasting the code snippet after rework on the comments.

static int inj_ipid_set(void *data, u64 val)
{
         struct mce *m = (struct mce *)data;

         if (cpu_feature_enabled(X86_FEATURE_SMCA)) {
                 if (val && inj_type == SW_INJ)
                         m->ipid = val;
                 else {
                         rdmsrl_on_cpu(m->extcpu, MSR_AMD64_SMCA_MCx_IPID(?),
                                       &m->ipid); // Requires bank number here.
                         if (!m->ipid) {
                                 pr_err("Cannot set IPID - unpopulated bank\n");
                                 return -ENODEV;
                         }
                 }
         }

         return 0;
  }

Please let me know what do you think?
Thanks,

>> +
>> +		/* Check for user provided IPID value. */
>> +		if (!m->ipid) {
>> +			rdmsrl_on_cpu(m->extcpu, MSR_AMD64_SMCA_MCx_IPID(val),
>> +				      &m->ipid);
> Oh well, one IPI per ipid write. We're doing injection so we can't be on
> a production machine so who cares about IPIs there.
>
>> +			if (!m->ipid) {
>> +				pr_err("Error simulation not possible: Bank %llu unpopulated\n",
> "Cannot set IPID for bank... - bank %d unpopulated\n"
>
> Also, in all your text, use "injection" instead of "simulation" so that
> there's no confusion.
>
> Thx.
>