Message-ID: <a53c8ba7-f66d-5bd7-c934-2357f42b3ac9@amd.com>
Date:   Mon, 13 Mar 2023 16:27:04 +0530
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101
 Thunderbird/102.6.1
From:   Sandipan Das <sandipan.das@amd.com>
Subject: Re: [PATCH 0/5] KVM: x86/pmu: Hide guest counter updates from the
 VMRUN instruction
To:     Like Xu <like.xu.linux@gmail.com>
Cc:     Paolo Bonzini <pbonzini@redhat.com>,
        Sean Christopherson <seanjc@google.com>,
        Ravi Bangoria <ravi.bangoria@amd.com>, kvm@vger.kernel.org,
        linux-kernel@vger.kernel.org,
        Santosh Shukla <santosh.shukla@amd.com>,
        Tom Lendacky <thomas.lendacky@amd.com>,
        Ananth Narayan <ananth.narayan@amd.com>
References: <20230310105346.12302-1-likexu@tencent.com>
Content-Language: en-US
In-Reply-To: <20230310105346.12302-1-likexu@tencent.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Z1N5bnVrNDhCdGRmMWVLR2tjSk1RdGRaaTlJVGlaNzAxQUlEdVdlUmlJOGxs?=
 =?utf-8?B?RGE3WlpNWEdyTzdtQnB5bDFLSVVrdWp0RXlac1UzZ2x0MFEwNVdoVmtWcDdU?=
 =?utf-8?B?Q2xBZU4vRE5taDFHRStlYU1USlZqYU92T1lKb29KbFR5eGtKODJSRDBpM094?=
 =?utf-8?B?YkdDNzZtdnJ2Ynpkek53aXVYNmcxR0laSUFoaHdNdmJuQm8vcnJ3bnRVK0ZU?=
 =?utf-8?B?YlowSmJrNFVxU2R1N1ZWYWpkaTFrMkhYU1hxYi91OElYeFpiS0o3aUtGUDRJ?=
 =?utf-8?B?c3hLMWc1TkF3d2lxU1FHN0ZDVXJHMFh4KzQyVDVPTklKTXBkd1F2b25kY29Z?=
 =?utf-8?B?bDFseCtvZGk0d2lVZjc5dGhPNnN6dGJGNTkvY3EzU3BIeHFNY1JENDYvYmlO?=
 =?utf-8?B?OW5DSXd2S3JWRHM3cXBtdmFVVTNUc21YRllBYjF5WVgzbVRwb241SmsyVzZv?=
 =?utf-8?B?c1BONSt5K1pRZlBaR3JmaU9yOGZRTWUvTEx6dEFpNFQ2QzYwNHErNkN3WHFq?=
 =?utf-8?B?Z1NMYlBPakhoc1BQSC9XSmx3ZTNoUFMzOTk3WFV2TElUMTJmTDRYUWtLUUVZ?=
 =?utf-8?B?RlN6VFo5bStHL2FYQzFjdURsdk9LS3RjYXNyMk9yN1Z3MW9oMklhMWE2a05R?=
 =?utf-8?B?a3ZCZHVCcUlqWlVaWlBIR05lemEyUFF0anp3d2VLeEo5VWkyelpvMmp2MTlq?=
 =?utf-8?B?TWsvUm02RlNNQi9kUFpFZ2JBTTBOS3dNQ3BKRTFBVzI0NHZod2NOdXFxQWlQ?=
 =?utf-8?B?VzlrT0FINlEyb3pHbUlyYUVtUWhlaS9MZGFtemt1ZEhBYys4bW9SSkdwNHNR?=
 =?utf-8?B?NnUySjVvaWR1Z0NTbmlaMGluaThuVHV5c0tLTzNHUW0vaTJqK25SN3dMUTFB?=
 =?utf-8?B?NEQxS3pIZGF2OXZSTlkrd0NmS2llSDRGQWNwN0hQM1FFTVJsano0TlcvS1BE?=
 =?utf-8?B?ZGx0dFk5WTlCVjhLODlxZzNvTWpzUFppaWdaVVpXaFdRVWpJTUVBalhCY0xz?=
 =?utf-8?B?QVFqaXdYSmdjeUpCMFVnaXNxSjZRdVAzUWQ0M3dUNm5QRlJOMUtkNDhka0d1?=
 =?utf-8?B?L0ZBZFJ3Tmpscmk1MTlvbmVwYnA1UDZaNEs4cHZ2QkhRMDJ1aURVWjZGNFg4?=
 =?utf-8?B?ZGJjejBBYmFGamVKZkp5VnA3a0JOcUx6Z0Z0eDNjTEc2bXdEMnZIUzJHOStP?=
 =?utf-8?B?cHE2aHQrU2lBQlBSM2ZrMVE0N1h0TzVZR2t3U2FvczVaYkVxRU9qYmhDZDEr?=
 =?utf-8?B?Tml6MnN5Q254SWhNN0YrNnNUcFhPK1IvbW9RdHQrWDIreDcrbUt2bkgvemxp?=
 =?utf-8?B?cjVvVVo1UEJ6TWYzelBOcENKcnc1ZVJwUDE0cU5BK2dUNkVDTFhuOVlPUVU2?=
 =?utf-8?B?ZWlqNHFxZHlldnQxREJBaE1GcTZ4cGpZb3hlK3E2ZWs1NjhHYXZBNXlsbVJF?=
 =?utf-8?B?RDVidmVkTy9JRnVaZlV2VmhVWGh0cDB2alRKakdXNUVKRTB1RUJUNG9weC9B?=
 =?utf-8?B?OW1TUjhkQlNTWktSVDFTdUxKbHRteDFGQ3NBNXBYNkZ0cG42b1kydjNrdjNv?=
 =?utf-8?B?SFlUdUQ2T2xGejRDNVM0R3RmTCtzeVhURmFxaEZLYWN4OC9YRVZXT2xWRTBu?=
 =?utf-8?B?aDlOcVdRalMraVpOcS9RWTExa1VWT3dxdTAwV21xeGVrYW1qdUt2T1lPNlo2?=
 =?utf-8?B?RkhYTE9Ic3dCS24rTGJaS1lPM1NkcDVNdTVpQkltaW9EaWVIM3pvaG1rMnNn?=
 =?utf-8?B?aUphdjRiNmhJdmVMdks5OHdGUzF5RDdiM1YxMmFKeFBUWDcvcWNVT3V4My8z?=
 =?utf-8?B?akRWZi9CTmY4NGJFdzdGNDd4QXlqamwwUlNpRTNWRlhSTGpUZ2FGMmhrMW5u?=
 =?utf-8?B?RFducTdRZzM2bE02Sy9PcjQxc2V5Y09iNXVNQW1Tc1hsbytaOGcvaDFkVHdl?=
 =?utf-8?B?cUVHM3lyZDNHTkZqWFJjUVFYbE5CN3lHRk9RRFV2MjJsQjNaek1POWdXSWUx?=
 =?utf-8?B?OVllL3M1U1BYcFR2R1lzYXBuUWIvZlRnNU5VUlRZMmxIKzFkUWEzc25LSVhG?=
 =?utf-8?B?QnF4QVliVUdJaWRSUGZrenhSZW5YZVZvNzBjUHAvaFg3cklEb0QvSktjcS8x?=
 =?utf-8?Q?4akfRNwvclgS3CkLJGJlPgIek?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3396222e-f3f0-44bc-61fb-08db23b1b60c
X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB5712.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Mar 2023 10:57:17.7879
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: EFVNTTUYW7vdUwMNWVurtBUCVP7S45j+wnymMMUCXSFw4yGssaoNr8JqWGhViEJLBMEzMWIVpvEBrR5cwUrvLw==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH8PR12MB7253
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

+CC: Santosh, Tom, Ananth

Hi Like,

On 3/10/2023 4:23 PM, Like Xu wrote:
> Considering that developers are more likely to have access to AMD VMs
> and use vPMU inside guest, there's a dark cloud that needs to rain.
> The x86_64/pmu_event_filter_test always fails on Zen3 boxes:
> 
>   test_amd_deny_list: Branch instructions retired = 43 (expected 42)
>   test_without_filter: Branch instructions retired = 43 (expected 42)
>   test_member_allow_list: Branch instructions retired = 43 (expected 42)
>   test_not_member_deny_list: Branch instructions retired = 43 (expected 42)
> 
> ,which is not caused by the event_filter feature (otherwise it's zero).
> 
> After some dubious guessing and microtesting on Zen3+ pmu hardware,
> we found that VMRUN or one of the instructions in __svm_vcpu_run()
> causes a guest-only enabled counter for counting guest instruction (in the
> pmu_event_filter case, the branch instruction) to always increase by one
> right after each vm_entry.
> 
> This creates an inconsistency with the AMD64_EVENTSEL_GUESTONLY,
> where the vPMU user in the VM does not expect to see any counter
> changes due to the SVM transaction at all. This patch set provides a low
> overhead software fix until HW change arrives or simply no fix planned.
> 

Yes, VMRUNs do get counted as retired branches in the guest context. My
understanding is that this behaviour applies to all generations of Zen
and even some older ones too, not just Zen 3 and later. I also do not
expect this to change in the near future.

- Sandipan