Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <4ea6e1c3-fae5-a64a-9bd3-f9ea0821fc67@amd.com>
Date:   Fri, 18 Nov 2022 18:58:07 +0530
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101
 Thunderbird/102.4.2
From:   "Nikunj A. Dadhania" <nikunj@amd.com>
Subject: Re: [PATCH] x86/sev: Add SEV-SNP guest feature negotiation support
To:     Borislav Petkov <bp@alien8.de>
References: <20221117044433.244656-1-nikunj@amd.com>
 <Y3YP5FQ6OHzVFKbp@zn.tnic> <7e224da6-6b02-2972-1334-bc8e7894cdab@amd.com>
 <Y3YuxGO8Kycymxg3@zn.tnic>
Content-Language: en-US
Cc:     linux-kernel@vger.kernel.org, x86@kernel.org, kvm@vger.kernel.org,
        mingo@redhat.com, tglx@linutronix.de, dave.hansen@linux.intel.com,
        seanjc@google.com, pbonzini@redhat.com, thomas.lendacky@amd.com,
        michael.roth@amd.com, stable@kernel.org,
        "Rao, Bharata Bhasker" <bharata@amd.com>
In-Reply-To: <Y3YuxGO8Kycymxg3@zn.tnic>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?am9McHFWampzMFhDSW9ueXRqZkNxUlhqSUJBckEzMnZQanhVTXVMTWd4UVdo?=
 =?utf-8?B?Q21VQ1ZiZGpiMlJMempJaWRsbC96U1ZSQ1ZZb09SVE55NTRCZ2pmc21kOHRH?=
 =?utf-8?B?T0UzMlgrdjVKaWYrWHdSay9ubjlUYjN5YnFncDJYdDhNTjhYUGlFekFIWUVy?=
 =?utf-8?B?anljN2toTi9xYmsybGxRV3N5QTRLN2RnS2Q4VWRhNUdkTStSVjNkM0JHeStx?=
 =?utf-8?B?dUMyWHlNRGpUR2EzcUlWTG5UdHRlSmdJTTJFVjdaK2VMVGlXMEYvVU1BYVp3?=
 =?utf-8?B?d1BwcjBTT1k3T3ovbXAycHBsQ2ZpMFdFWVp1MHk5ZldOdTFaOENJMkxvRFhD?=
 =?utf-8?B?Wm4rdGxTcHBhUjQvTFRiY2xUTS9mT0UralB2ZHB0Sk5tWWRVMUlmeEdEYmxG?=
 =?utf-8?B?Lys1Zmt6UjdCU3hnR09oN1pqZWloaFhkTFVsd1ZRVzl4bHV6VU1wWE0rZDEw?=
 =?utf-8?B?a204SFVrWWpja3o1N1VJYlBybVJwOTlxQ3RneU5NQXBjSDNrU0hWMFNQTEVh?=
 =?utf-8?B?MXRvL0c3QVhyMnhOMlFqUkF6QlFiWWx1bVJkd3BqTHMzY0x6ZzhnUlJLbEMv?=
 =?utf-8?B?cHM4N3JMU2xvSzVuMUpQWEVGK3YwU2hBZ2dxZi9BRmp5ZlQram9Lb1V2dEZn?=
 =?utf-8?B?dHhDOWdXVWRhUjhYUjlUZzVidS9xZDcyNVRvV0hudlVBcmZqZ0ZOU3p0d2Vj?=
 =?utf-8?B?b1l6cFRVckY4bjh6b1lzaDZTUXpybGFaNWE0clgvdWM4RVpVMUU5R0FSbE5Q?=
 =?utf-8?B?VUp1L0g1NFlYY3VTZ2ZKdWlGUG9CU0F5ekswdU91dU54T2djSXZ0a29Qeldy?=
 =?utf-8?B?VFA2OFd1TlNPTzZYZ2hxWk8zMkdrMWlubjliOGpaWks5RFcrTHQ4YmZpVkR3?=
 =?utf-8?B?cEU5VlUyTFc0TVc1U1BlR3ltTURocGFLa1A3MUhFRCtxSkNhVkt0NWQ5eVB1?=
 =?utf-8?B?cnBqMmlNaDd3VnFuWTJDcW11VFpESGdlNmZIbWhtbitZVnIvMkNTZGNPOG9w?=
 =?utf-8?B?RWxpQnpoSTlaN25HeHhzcUFrbnQ2NWJseDcybFBtMFFkQzdLSkt6ZUsrVHk2?=
 =?utf-8?B?d05HRGlmRm4vY2crTUJYT2ZlZlVmYWRpaEFwR05uNElvcEoxbTVXcTd3QVNJ?=
 =?utf-8?B?MmJsL3lIK2NtSmdMWW9BRk44cjdidnB6cElYeTZjN3RKcTlvR2Q5akJnMVo4?=
 =?utf-8?B?NVJ1M1ZXM0c3OWpheWxTYlpBcnA1aUYvZmhuM0d4cmt1eVRvTXFtbFJzamJQ?=
 =?utf-8?B?QXhtTUFKanRReVF4b0pyUTBDRHU5S3lsaklGNDNrUzROT2RlaU5rSFBpSVZj?=
 =?utf-8?B?eHViRmRZb2tRalcrUXpBcFZUcEhzNWRHbDdQZ3ppbks4bnROV2VlZ2J1c3JZ?=
 =?utf-8?B?TGQzTzAyeWJWVUJOczE4RnhabEcweW9iQlFiTW9YQTIwTjJsSWI5a1loNkVX?=
 =?utf-8?B?YlBoZTBZOHlPTVlxMEk5YW01RTNmZkVGR0dMMzNkQ0RKdWhVMkxqVXBDVGVK?=
 =?utf-8?B?azFtdUZUYWYybW1YYjNydElKUEdSRlVYQzc2RUluQUNueHFkL2Jla0RyNUk3?=
 =?utf-8?B?WFg2c0NGZTY5Y05Odlo3NzBHdVBJVlFtZkhMRE9NT09zYzNjOFZIelpkaEpR?=
 =?utf-8?B?R0NwUkNGVmVaYzQ2YTU1NmdrM2ZCQkFRWTIwTTRiRWN0SHZpc3IyaWpkeHZ4?=
 =?utf-8?B?ZE9HeERtUGpRUis0V1RWSGd1eVZTWGpXVlFlVDdzckJQN1lFazdiVHFIbFZW?=
 =?utf-8?B?SnVDYXFRdEMzb1BJS0VTUEdsVXV5bkRYNkEyVkp5eXgxWUU0Q1FuaGZTU1Y2?=
 =?utf-8?B?WTh2ckFLVU5kNWFuUnYzZHE0RzF5cUpXOGRjeUZHUjFvM3pyUTN0U0k3cGpl?=
 =?utf-8?B?R2VNVzhzeE51T1luY2NZZk1VcVdMV0lHU1hMN3VrZ3NIdTVuU1FDTW9mVElM?=
 =?utf-8?B?UzNQQVpHb1FDV2JWcm8wd0ZhQ3BaZkJ4ZU0rWWMyV0V0eVEwY2JUdERpaTF2?=
 =?utf-8?B?eDg4STArNC9xcUo2SjFEK0k0SVh4MmdTNHJlbGpoMUkyL2RQT0M3RUpXNzM3?=
 =?utf-8?B?cXc5MjZOZnBrVFM4bjQrSit3dXNWZ1Ryc25hNTJpYnJiSklhU1ZTWWx4eURG?=
 =?utf-8?Q?vMya+2p7uCseWDPRnEa/R1zRa?=
X-OriginatorOrg: amd.com
X-MS-Exchange-CrossTenant-Network-Message-Id: e77e0f74-ec06-40bc-031b-08dac968c276
X-MS-Exchange-CrossTenant-AuthSource: DS7PR12MB6309.namprd12.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 18 Nov 2022 13:28:21.9983
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: YO/E4zW3TJka2U8aQjnhcrKofRCEs1lYkFkQUO2WuXgXUUQyL91Adaz4U7DKyhUswXKFLPO0pIiZJlh81rZ6uQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR12MB5730
X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NICE_REPLY_A,RCVD_IN_DNSWL_NONE,
        RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS autolearn=ham
        autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

On 17/11/22 18:23, Borislav Petkov wrote:
> On Thu, Nov 17, 2022 at 05:50:34PM +0530, Nikunj A. Dadhania wrote:
>> Purpose of this patch is older guests kernel that have SNP enabled
>> (5.19 onward), when a particular SNP feature is enabled by the
>> hypervisor that needs enlightened guest, older kernel wont be able to
>> support the feature. There is no mechanism that the hypervisor can
>> find out what feature is supported by the SNP guest before hand.
>>
>> For example PREVENT_HOST_IBS needs changes on hypervisor and no
>> changes in the guest kernel. In this any guest kernel having SNP
>> support should work.
>>
>> While for SECURE_TSC, hypervisor and guest kernel changes are
>> required. And older guest kernel will not work if hypervisor enables
>> Secure TSC. When secure tsc feature is enabled following define should
>> be changed:
> 
> This all is still veiled in mist to me. What are you trying to do here?
> 
> - Make sure older SNP guests boot on newer hypervisors?

Yes and No.

Yes: For feature flags that do not need an enlightened guest, older guests should 
     boot.

No: For feature flags that need an enlightened guest, older guests should detect 
    and fail booting on any hypervisor that sets this feature flag. 

> - Newer guests boot on older hypervisors?

Yes, as the older hypervisor won't enable the new SNP feature flag.

> So, first, pls explain in detail what the goal here is.

The hypervisor can enable various new features flags(in SEV_FEATURES[1:63]) 
and start the guest. The hypervisor does not know beforehand that the guest 
kernel supports the feature that is being enabled.

While booting, SNP guests can discover the hypervisor-enabled features by looking 
at SEV_STATUS MSR. At this point, the SNP guest needs to decide either to 
continue boot or terminate depending on the feature support in the guest kernel.
Otherwise, if we let the guest continue booting with an unsupported feature, 
the guest can fail in non-obvious manner. 

* Primary goal here is to detect such unsupported features beforehand and 
  deterministically terminate the guest.
* Secondary goal is to use this mechanism to future-proof the current guests 
  for newer reserved features flags that may be defined later.

Here is the support matrix per feature that can explain better:

HypervisorEnabled: Feature bit is enabled in SEV_FEATURES
Required: Feature requires enlightened guest
Available: The guest is enlightened for that particular feature.
Boot: The expected behavior of the guest, whether it should boot or fail.

+-------------------+----------+-------------+----------+
| HypervisorEnabled | Required | Available   |   Boot   |
+-------------------+----------+-------------+----------+
| Y                 |  Y       |  N          | N (Fail) |
| Y                 |  Y       |  Y          | Y        |
| Y                 |  N       |  N          | Y        |
| N                 | Y/N      | Y/N         | Y        |
+-------------------+----------+-------------+----------+

> I'm reading the above in multiple ways so you need to spell out first
> what you wanna do.
> 
> PREVENT_HOST_IBS doesn't need any enablement. So why is it in the mask?

PREVENT_HOST_IBS will be defined but shouldn't be part of the 
"Required" mask.

> SECURE_TSC needs enablement on both. Why aren't you checking only this
> one.

SECURE_TSC should be part of "Required" mask and once secure tsc 
support is up-streamed it should be added to "Available" mask.

> IOW, I would expect to check *only* for features which the guest needs
> for the hypervisor to support before it boots. But not check everything
> wholesale.

Guests need to check for features enabled by the hypervisor that is not 
supported as well, so that we can terminate the guest right there.

> IOW, I see it this way: guest boots, sees what the hypervisor has
> enabled as SEV_STATUS cannot be intercepted and acts accordingly.
>
> Now, the question how *old* guests should act here is a whole different
> story as it depends on whether this gets backported to old guests -
> which doesn't make them old anymore as the checking will happen - 

Old guests with backport will deny booting with unsupported features. 

> or to
> really old guests without the checking. There it doesn't matter.

It does matter for old guests which dont have backport, the behavior will 
be undefined.

Hence fix needs to be back ported till 5.19, where SNP guest support was added.
 
> And come to think of it, this whole deal is no different than having
> feature bits in CPUID and the kernel implementing them.
> 
> If the kernel finds a feature bit set in CPUID, it enables the
> corresponding code. If it doesn't know about it, then it doesn't do
> anything.
> 
> Pretty much the same here: if a SNP guest finds a feature flag in
> SEV_STATUS, then it enables the code corresponding to it. 

This is the good case, where the feature flag is enabled and the guest 
kernel has support for the feature. This should boot fine.

Second Case which we are handling in this patch: SNP guest finds the 
feature flag enabled, but it does not have code corresponding to that 
feature. The guest boot should *fail*.

> If it doesn't
> find it but it needs it due to enablement, then it stops booting.

Above is the third case: where the SNP guest does not see the feature flag 
enabled and the  guest should boot fine irrespective of whether it is enlightened 
or not.

Regards,
Nikunj