Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <83cc0a88-b212-c3f1-a2d5-68142344245a@amd.com>
Date:   Tue, 8 Mar 2022 12:24:37 +0700
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101
 Thunderbird/91.5.1
Subject: Re: [RFC PATCH 08/13] KVM: SVM: Do not update logical APIC ID table
 when in x2APIC mode
Content-Language: en-US
To:     Maxim Levitsky <mlevitsk@redhat.com>, linux-kernel@vger.kernel.org,
        kvm@vger.kernel.org
Cc:     pbonzini@redhat.com, seanjc@google.com, joro@8bytes.org,
        jon.grimm@amd.com, wei.huang2@amd.com, terry.bowman@amd.com
References: <20220221021922.733373-1-suravee.suthikulpanit@amd.com>
 <20220221021922.733373-9-suravee.suthikulpanit@amd.com>
 <55c391a51bf6b7d3927493ff56333e9846e04a4a.camel@redhat.com>
From:   "Suthikulpanit, Suravee" <suravee.suthikulpanit@amd.com>
In-Reply-To: <55c391a51bf6b7d3927493ff56333e9846e04a4a.camel@redhat.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?S1lPMkFuVHNlQ21LQjAvaDhUZzUwVHdGdlpxVk9xdkhscWR1ZUpIM3BQZFZp?=
 =?utf-8?B?VytmMXpKb0N1M3RJZm5BQ0I2SjNGd0xiUjc3bmc5L3Rja294d1hNbDMyV2pi?=
 =?utf-8?B?dTZLaW0xSUlKYlFHNHlZdEZQckJsbldER3VTSEdaWmhoaWtBU1ducEZ1UFE2?=
 =?utf-8?B?dms0cTlXaVhyUlVlb2FQVEVlTFhaL2pTaWhGMHJodHJEenp1UDE1blpvKy8z?=
 =?utf-8?B?WjRKclQzZXhtQ1h1aWtWeUoyeDFxTzJmQ3RyYXJ3Rkt1aVJQcXBTYzdheS9i?=
 =?utf-8?B?cmVlUmh6d1Exb0tFTVJtK2d3Z09FV3VtWitBcktpdFVRSXcrUWlkcG9ycCt1?=
 =?utf-8?B?S0w3VjlzSGxvZHBlQ2VWc01LK09hWWptZ2k5cVBZVjhKRDFKeUE4M1RyeFNO?=
 =?utf-8?B?NVlnSXVmSjhJWW5jZmgydlJINVZNVGhnMWFFRTlnWEhsK0xsd2RXdzhKZCtY?=
 =?utf-8?B?NTUzYTMwdzduT05zekp0RkNRY3h1azl6NlZSdVZieUJTZ0FuU29JQ015a3Ry?=
 =?utf-8?B?VXlkRzU2WGJwM3pRMEFybDR1enlkYmZPS3A1cFYxMzBXbUttUFdEYldzWHE4?=
 =?utf-8?B?amdGcmNhRFZvNUZkblVnNnJraU9qVS9hYUlDTkQ2ancyMHNlTFYxQWozV3Fs?=
 =?utf-8?B?NTllMTI2dkNrNDl6OWsycVpxWXhkeEtDSkxuU3VaRlhVRzlPNkR4cy9ZSUFQ?=
 =?utf-8?B?TFRPRkNaenJML21GWWZmZ0dXMkJZeGdEOGFPYmpOSDBlYkJkQUVJRkcvMGVi?=
 =?utf-8?B?L3hLd3NlRzE4dG9hVkM3c1JJelRvTHd2ZGtjcndybUpXN3lTZi9pdXV1UDZN?=
 =?utf-8?B?d25xQnNjOW5jQ25iYmNua1ZBNndJN1NvTG1mQ3MrNG9adk5iSTVzWU41RFQ4?=
 =?utf-8?B?MExrR01SRE9zQW5PbEszQ2hUTVk4ZmhqaU1tU1ozRUN2Z3JMTE1RRHIyOGFw?=
 =?utf-8?B?UFhXRUpseWZWcHlyOENUQ1N1c25jUkRyR3JjZVdtRGJ0VlJDTFgxdDRleUdF?=
 =?utf-8?B?WHhSVkVIVUZ0VDBGQU4vSW52OCtvaWh4bjBtMmQvK2lFQWo5L21FbHVMSklz?=
 =?utf-8?B?bm54ZUg0TVVEbkpOYmRVK0JiaUdudXV2QkRnZE5LQWpTZXdXZnB0azZlclo1?=
 =?utf-8?B?OXF0K29VZnJFbWNIUFVwVTlaNTY0d0sxTWlxTXd0c093bE4yRStvYUszYnNu?=
 =?utf-8?B?amR2RUYySi9VL1VhSmlVMVYyN2ZlV21aQlM4cEZnTkhGSUpSRkp2SkY5d0pQ?=
 =?utf-8?B?WEQ2ZkFiMm94RmlhR010VDQxam1QYklTUTlzRzVRRUNsRDB5NFExZzF3dDlt?=
 =?utf-8?B?SVJYcWQwaS9GNFNORGlCOUtsbzVtN3pBdkpSL3R5S09DbUJxVDBpREoxMjBH?=
 =?utf-8?B?b3JPVjBvWmRsa3JHY0dRK3RIOVIwN1lERDl5NUhnL0pwZkxYeVlUWURya1p3?=
 =?utf-8?B?ODNpbkhBdTlLeHhsM1VnaDB2Q0RIY25QajAyWTNRN2JQTnVLR0lDUE1GWCtN?=
 =?utf-8?B?M0xwajNhT0tGOVRab1d0aURMYm82RG9mUzZoRXM4K2FqcXpVYTlTYjlDelZv?=
 =?utf-8?B?M3JFN0tBSjVUNHUvOUZqV2pqbzRtRkNCdXE5d1FyL2NwTk5XYXBxZmpDeERJ?=
 =?utf-8?B?eGtCU3FaSXl2OW1lcWZuNFNrVHg3eEdlZlQyVll0VUN2dWcrdlc1MDRqdUhq?=
 =?utf-8?B?Y0NONC9IVUlzazhtOEdrM1FpNCtXTTVoY29zcThtK1JPL2hDOHlTZitqdGQ0?=
 =?utf-8?B?aFA0dmhrL0hzUFR5TkN4Uy81VDlkeGd2ZUc0YlkyaFB3UnZVMFJzd0NSN09N?=
 =?utf-8?B?bkEzdG5zek1tVkJKYzhIdmlOTjJWSWxrajU1UmJodStibWRvWlhEd2ZCVEZv?=
 =?utf-8?B?US9maytLcnJQaGhDZ2tYWUJGbFhXMkQycEVCS1E2NEk4YXhSSlZKVmxyT0xk?=
 =?utf-8?B?VG5yVSsyWWxKSkVjSk5oTElaWjhWMEk1NTRQQy96Y3dPZmgyNWxjVG1Vd0JQ?=
 =?utf-8?B?MXhjL1Q2a3p5Rk1oWkJkY0dtMHBpL3VqZFZOOXU0dU1YQks1N3RYL2lkc0hX?=
 =?utf-8?B?enFLWFdwUHYxZlRJb0RwUGMrUlgwZUwxZGJqS3FtTXpMVDZITjZQYVd2aG5W?=
 =?utf-8?B?VzhWZjl5SExrS0paQnppS3FjOHVTOXRtMHFLTW5waXlkeTRDeGIyNUV4OFdO?=
 =?utf-8?Q?ufSvo7F3gQMEIuGT2ddJUtk=3D?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ff6779e7-fbab-483f-0fac-08da00c3f542
X-MS-Exchange-CrossTenant-AuthSource: DM8PR12MB5445.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Mar 2022 05:24:46.3309
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: m1V1EXqctv0npLKOVzmrMlCEpZFLQyZnsdm9SdYl1Za5tGCbukzMcghgvtL/IMTFWOQFnNYcskMyPcPTN8whpQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR12MB1738
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Maxim,

On 2/25/2022 12:41 AM, Maxim Levitsky wrote:
> On Sun, 2022-02-20 at 20:19 -0600, Suravee Suthikulpanit wrote:
>> In X2APIC mode the Logical Destination Register is read-only,
>> which provides a fixed mapping between the logical and physical
>> APIC IDs. Therefore, there is no Logical APIC ID table in X2AVIC
>> and the processor uses the X2APIC ID in the backing page to create
>> a vCPU’s logical ID.
>>
>> Therefore, add logic to check x2APIC mode before updating logical
>> APIC ID table.
>>
>> Signed-off-by: Suravee Suthikulpanit<suravee.suthikulpanit@amd.com>
>> ---
>>   arch/x86/kvm/svm/avic.c | 11 ++++++++++-
>>   1 file changed, 10 insertions(+), 1 deletion(-)
>>
>> diff --git a/arch/x86/kvm/svm/avic.c b/arch/x86/kvm/svm/avic.c
>> index 215d8a7dbc1d..55b3b703b93b 100644
>> --- a/arch/x86/kvm/svm/avic.c
>> +++ b/arch/x86/kvm/svm/avic.c
>> @@ -417,6 +417,10 @@ static int avic_ldr_write(struct kvm_vcpu *vcpu, u8 g_physical_id, u32 ldr)
>>   	bool flat;
>>   	u32 *entry, new_entry;
>>   
>> +	/* Note: x2AVIC does not use logical APIC ID table */
>> +	if (apic_x2apic_mode(vcpu->arch.apic))
>> +		return 0;
>> +
>>   	flat = kvm_lapic_get_reg(vcpu->arch.apic, APIC_DFR) == APIC_DFR_FLAT;
>>   	entry = avic_get_logical_id_entry(vcpu, ldr, flat);
>>   	if (!entry)
>> @@ -435,8 +439,13 @@ static void avic_invalidate_logical_id_entry(struct kvm_vcpu *vcpu)
>>   {
>>   	struct vcpu_svm *svm = to_svm(vcpu);
>>   	bool flat = svm->dfr_reg == APIC_DFR_FLAT;
>> -	u32 *entry = avic_get_logical_id_entry(vcpu, svm->ldr_reg, flat);
>> +	u32 *entry;
>> +
>> +	/* Note: x2AVIC does not use logical APIC ID table */
>> +	if (apic_x2apic_mode(vcpu->arch.apic))
>> +		return;
>>   
>> +	entry = avic_get_logical_id_entry(vcpu, svm->ldr_reg, flat);
>>   	if (entry)
>>   		clear_bit(AVIC_LOGICAL_ID_ENTRY_VALID_BIT, (unsigned long *)entry);
>>   }
> 
> Here actually the good apic_x2apic_mode was used.
> 
> However, shouldn't we inject #GP in avic_ldr_write to make this read realy read-only?
> It might be too late to do so here, since most AVIC writes are trap like.

I'm checking to see how HW would respond to LDR write in x2AVIC enabled case.

> Thus we need to make the msr that corresponds to LDR to be write protected in the msr bitmap,
> and inject #GP when write it attempted.

Actually, we can setup the MSR interception for LDR register (0x80d) to intercept
into hypervisor (i.e. not virtualized by AVIC HW), and let the current KVM
implementation handles the WRMSR emulation (i.e. inject #GP). Would that be sufficient?

Regards,
Suravee