Subject: Re: [PATCH v8 08/40] x86/sev: Check the vmpl level
To:     Brijesh Singh <brijesh.singh@amd.com>,
        Mikolaj Lisik <lisik@google.com>,
        Venu Busireddy <venu.busireddy@oracle.com>
Cc:     x86@kernel.org, linux-kernel@vger.kernel.org, kvm@vger.kernel.org,
        linux-efi@vger.kernel.org, platform-driver-x86@vger.kernel.org,
        linux-coco@lists.linux.dev, linux-mm@kvack.org,
        Thomas Gleixner <tglx@linutronix.de>,
        Ingo Molnar <mingo@redhat.com>, Joerg Roedel <jroedel@suse.de>,
        "H. Peter Anvin" <hpa@zytor.com>, Ard Biesheuvel <ardb@kernel.org>,
        Paolo Bonzini <pbonzini@redhat.com>,
        Sean Christopherson <seanjc@google.com>,
        Vitaly Kuznetsov <vkuznets@redhat.com>,
        Jim Mattson <jmattson@google.com>,
        Andy Lutomirski <luto@kernel.org>,
        Dave Hansen <dave.hansen@linux.intel.com>,
        Sergio Lopez <slp@redhat.com>, Peter Gonda <pgonda@google.com>,
        Peter Zijlstra <peterz@infradead.org>,
        Srinivas Pandruvada <srinivas.pandruvada@linux.intel.com>,
        David Rientjes <rientjes@google.com>,
        Dov Murik <dovmurik@linux.ibm.com>,
        Tobin Feldman-Fitzthum <tobin@ibm.com>,
        Borislav Petkov <bp@alien8.de>,
        Michael Roth <michael.roth@amd.com>,
        Vlastimil Babka <vbabka@suse.cz>,
        "Kirill A . Shutemov" <kirill@shutemov.name>,
        Andi Kleen <ak@linux.intel.com>,
        "Dr . David Alan Gilbert" <dgilbert@redhat.com>,
        tony.luck@intel.com, marcorr@google.com,
        sathyanarayanan.kuppuswamy@linux.intel.com
References: <20211210154332.11526-1-brijesh.singh@amd.com>
 <20211210154332.11526-9-brijesh.singh@amd.com> <YbugbgXhApv9ECM2@dt>
 <CADtC8PX_bEk3rQR1sonbp-rX7rAG4fdbM41r3YLhfj3qWvqJrw@mail.gmail.com>
 <79c91197-a7d8-4b93-b6c3-edb7b2da4807@amd.com>
From:   Tom Lendacky <thomas.lendacky@amd.com>
Message-ID: <d56c2f64-9e31-81d8-f250-e9772ba37d7e@amd.com>
Date:   Fri, 17 Dec 2021 16:33:02 -0600
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
 Thunderbird/78.11.0
In-Reply-To: <79c91197-a7d8-4b93-b6c3-edb7b2da4807@amd.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?YjNpTkptdTlJQlFPNEVtLzRLYmU4ajczdklYQWhFY3poNDJEejRSUDREeW9T?=
 =?utf-8?B?THNBS3M4ZmxJb2FsdjJnd25wVHdHK2pJMm1ELzJSRUEvNzQyRlIvd2pzeEV3?=
 =?utf-8?B?MnJQaFBTRmpaNy9EdDd6K1RVbGlwZWlQOGxWM0FLQmNzQlJmTUc2SnM1aGw3?=
 =?utf-8?B?aHl4dmNMblFQcHU3c2UwNGlZZmxEekllTTZ3dlhHWWQvb0hpcnF5ZTUzNmJ0?=
 =?utf-8?B?eXpPME9CK2RBSnJZWmcraGJSNzYvdTFvVDBPMkw5K0QvbTZCcFRhUzBaQzlQ?=
 =?utf-8?B?ZCtkM0tDZ3JGTWpCNHZyaFRqS09FYmdBdlhyZm1Dc256WGxzTzNKQlA2RENC?=
 =?utf-8?B?RUwxK2pJanJtVkJJM2dNbHcvcEJRV3Nha1k2dmN2KzBZUW5LajJNYW5KTGRk?=
 =?utf-8?B?SllzcUQwbWIwUURqMmpaTkUwaFRsV09UUTcvTmh0MGRUdG5kLzdIM3doZ0xE?=
 =?utf-8?B?RDlMRHJVcm1PcmRSalY0MUJJVm9GblNXRWUrU3JJdVlSbXIzVVlHbkVjTG9F?=
 =?utf-8?B?T0tsTkxlRnFNRkJwaHI5YkJzNmlDRjcxelA5OUVlNlBzejBKcFNHZWgvM1ho?=
 =?utf-8?B?RjNONUxXSHRCQ3p2cGRlSUJhTE51TVR2UFkxM1hZcWtlWFhPUTBVZFNrS00z?=
 =?utf-8?B?eDhHOFdFYVcvdjdPUnJ6SUtod041d0FPWjB5R3ZxN1ZkSGhPUjRhM3QvMDd5?=
 =?utf-8?B?UVBLWnJIL0NKWG5mSFNvaUV1MlNGYS92STFQWmN6MG5xRnpRdllmMzQrQ0lO?=
 =?utf-8?B?aHlRTlNkZk5GNlhVeXVJakJiZEhiclJJVFh3a2FqSHVuaWM4aCtWTTdFYzkz?=
 =?utf-8?B?eklZUE5iZDdLQzdpTVp5K0k0czFud1BKVWtQd1ZnbjJad2toN0c1d3JQN0xL?=
 =?utf-8?B?cGN4c1J1UFRIYTRqV1dqSW9qelI1TVBBN1QxRmRocFNYRlJjeDNWY0Q2Q3BB?=
 =?utf-8?B?RS9ib0RaWGxBanBrWkdQaDlVQ05ab3RXWEpNTnFWTEdYNG9kNTFNN3diQVNB?=
 =?utf-8?B?TUtXd08vNGxPa201T2xiR2dSckY0UXRMazZoWWRlZzcxM3JiN1hsMVo0ckY2?=
 =?utf-8?B?V1FPWXpSL0N1ZC85bGlhRlpoNjV0WHZMNUsrV0Y3dnZTWkdrQ1d0ZFBLdHJH?=
 =?utf-8?B?NHAzbnh6MVRrNUU3OWM1R04zZWIwRzRhcmRPY2hhZ2k2dlF3L0lQK3VkUDRE?=
 =?utf-8?B?QlQ4S0FZVDZhVS9jV0w0dENVRWd1UHNhN0MzcklCS29KQ0F3WjZYejJ2Ymtl?=
 =?utf-8?B?R0FTZE1ueC9ac0Mxc01tWk9oekcwMkYyTUJpNTNKd3pqSHhrT2Y2MjllUG1x?=
 =?utf-8?B?NG5Idk9RZlhYMWhCcml6R3ZLYm9aczlNKzZIZ2ZzR2JMYzRpMFl4ek5DUm10?=
 =?utf-8?B?Z3NRWE5EbU5BYnZNOXYrUFNjU2k0VUovbFpiMG91dTQrSUplQVBHYW1jTXFj?=
 =?utf-8?B?L01sUTVLQ1JGZTRiazNYZngxa1BWMUxNWW9wNWE3SEJCeEc2RzlLbUJubTY5?=
 =?utf-8?B?V1AvR2U4amMwTUIzV2MwaDk0bG44K2lEL0pUeG9TT2NsU1c0Q2hFTmt4Sm5C?=
 =?utf-8?B?blhGRllzTzJPdWlsNHVVaDBocUNKc3ZTbHhWbFp5Q0RlQjVqWjYwanpjYmN4?=
 =?utf-8?B?UEVVUkEzNGZZZ2ZxNkRrSjUrV1VwUWR2MFlOY0JPUUt2U0VoZUxqS0lFTTl0?=
 =?utf-8?B?Q1k5L1dTV3pEWWZUeThLUW9RbkJQVG83blZuaG9yR0ZjRnpoNGJWakorRmZS?=
 =?utf-8?B?S1JGS21QWHBhU3k5d1NFUEJmdEFnNHc4V2owUFQrRkZhbHl6MG5nQTE1bDJL?=
 =?utf-8?B?azNiZ0NUQzRUOHROWVNEYmNzUklrNVN3ajlrN3Y5Yi9GOURJZnFPTC9pYVJz?=
 =?utf-8?B?UloxcmZsdlF2N1ZOS0RiVmRhOFJBd3grQW93emdBeEhtNXAwZlpBU3BrYzFa?=
 =?utf-8?B?TWI5YnFDaEFNZ05FMS9ycXBEMXdjdktxaGRHWGoxT3cxdElsRXlicmJWUlBH?=
 =?utf-8?B?andZdnVZZjlNWFhucW1Dbld4UkhYQVFuejVPa3pURDRZV1lGUFBzcEs1eFRk?=
 =?utf-8?B?ZGlFZERCM2pCV3pFYVZPRUNraTd4Y1VXSU8ydjdqVFM4ejAwVFc5eC85bUFK?=
 =?utf-8?B?YlhhNzB0VWFwQTdsNlcwMllBVVlTdjQ1M2FCRVorNm16NHRpZGFGYnROQXlB?=
 =?utf-8?Q?evL9eUhPhZG+LgJI38E+cms=3D?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 8434f5e2-d80a-4f3d-38de-08d9c1ad321a
X-MS-Exchange-CrossTenant-AuthSource: DM4PR12MB5229.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Dec 2021 22:33:06.5410
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: Az6UWmVmkoP4p13zRoz021iPQrEkZzd9zjc0zg73dJ7IoY648UKOUGo8WFJ/9ZT9WGuph+zwfXwtowd0VVQQeg==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB5182
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 12/17/21 4:19 PM, Brijesh Singh wrote:
> 
> On 12/16/21 5:39 PM, Mikolaj Lisik wrote:
>> On Thu, Dec 16, 2021 at 12:24 PM Venu Busireddy
>> <venu.busireddy@oracle.com> wrote:
>>> On 2021-12-10 09:43:00 -0600, Brijesh Singh wrote:
>>>> Virtual Machine Privilege Level (VMPL) feature in the SEV-SNP architecture
>>>> allows a guest VM to divide its address space into four levels. The level
>>>> can be used to provide the hardware isolated abstraction layers with a VM.
>>>> The VMPL0 is the highest privilege, and VMPL3 is the least privilege.
>>>> Certain operations must be done by the VMPL0 software, such as:
>>>>
>>>> * Validate or invalidate memory range (PVALIDATE instruction)
>>>> * Allocate VMSA page (RMPADJUST instruction when VMSA=1)
>>>>
>>>> The initial SEV-SNP support requires that the guest kernel is running on
>>>> VMPL0. Add a check to make sure that kernel is running at VMPL0 before
>>>> continuing the boot. There is no easy method to query the current VMPL
>>>> level, so use the RMPADJUST instruction to determine whether the guest is
>>>> running at the VMPL0.
>>>>
>>>> Signed-off-by: Brijesh Singh <brijesh.singh@amd.com>
>>>> ---
>>>>   arch/x86/boot/compressed/sev.c    | 34 ++++++++++++++++++++++++++++---
>>>>   arch/x86/include/asm/sev-common.h |  1 +
>>>>   arch/x86/include/asm/sev.h        | 16 +++++++++++++++
>>>>   3 files changed, 48 insertions(+), 3 deletions(-)
>>>>
>>>> diff --git a/arch/x86/boot/compressed/sev.c b/arch/x86/boot/compressed/sev.c
>>>> index a0708f359a46..9be369f72299 100644
>>>> --- a/arch/x86/boot/compressed/sev.c
>>>> +++ b/arch/x86/boot/compressed/sev.c
>>>> @@ -212,6 +212,31 @@ static inline u64 rd_sev_status_msr(void)
>>>>        return ((high << 32) | low);
>>>>   }
>>>>
>>>> +static void enforce_vmpl0(void)
>>>> +{
>>>> +     u64 attrs;
>>>> +     int err;
>>>> +
>>>> +     /*
>>>> +      * There is no straightforward way to query the current VMPL level. The
>>>> +      * simplest method is to use the RMPADJUST instruction to change a page
>>>> +      * permission to a VMPL level-1, and if the guest kernel is launched at
>>>> +      * a level <= 1, then RMPADJUST instruction will return an error.
>>> Perhaps a nit. When you say "level <= 1", do you mean a level lower than or
>>> equal to 1 semantically, or numerically?
> 
> Its numerically, please see the AMD APM vol 3.

Actually it is not numerically...  if it was numerically, then 0 <= 1 
would return an error, but VMPL0 is the highest permission level.

> 
> Here is the snippet from the APM RMPAJUST.
> 
> IF (TARGET_VMPL <= CURRENT_VMPL)  // Only permissions for numerically

Notice, that the target VMPL is checked against the current VMPL. So if 
the target VMPL is numerically less than or equal to the current VMPL 
(e.g. you are trying to modify permissions for VMPL1 when you are running 
at VMPL2), that is a permission error. So similar to CPL, 0 is the highest 
permission followed by 1 then 2 then 3.

Thanks,
Tom

> 
>          EAX = FAIL_PERMISSION                // higher VMPL can be modified
> 
>          EXIT
> 
> 
>> +1 to this. Additionally I found the "level-1" confusing which I
>> interpreted as "level minus one".
>>
>> Perhaps phrasing it as "level one", or "level=1" would be more explicit?
>>
> Sure, I will make it clear that its target vmpl level 1 and not (target
> level - 1).
> 
> thanks
> 
>