Received-SPF: pass (google.com: domain of linux-kernel+bounces-141592-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3;
Date: Thu, 11 Apr 2024 16:50:12 -0400
From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
To: Chao Gao <chao.gao@intel.com>
Cc: Paolo Bonzini <pbonzini@redhat.com>,
        Alexandre Chartre <alexandre.chartre@oracle.com>,
        Andrew Cooper <andrew.cooper3@citrix.com>, x86@kernel.org,
        kvm@vger.kernel.org, linux-kernel@vger.kernel.org,
        daniel.sneddon@linux.intel.com, pawan.kumar.gupta@linux.intel.com,
        tglx@linutronix.de, peterz@infradead.org, gregkh@linuxfoundation.org,
        seanjc@google.com, dave.hansen@linux.intel.com, nik.borisov@suse.com,
        kpsingh@kernel.org, longman@redhat.com, bp@alien8.de
Subject: Re: [PATCH] KVM: x86: Set BHI_NO in guest when host is not affected
 by BHI
Message-ID: <ZhhNBCtY0rgfJdRK@char.us.oracle.com>
References: <7f1faa48-6252-4409-aefc-2ed2f38fb1c3@citrix.com>
 <caa51938-c587-4403-a9cd-16e8b585bc13@oracle.com>
 <CABgObfai1TCs6pNAP4i0x99qAjXTczJ4uLHiivNV7QGoah1pVg@mail.gmail.com>
 <abbaeb7c-a0d3-4b2d-8632-d32025b165d7@oracle.com>
 <2afb20af-d42e-4535-a660-0194de1d0099@citrix.com>
 <ff3cf105-ef2a-426c-ba9b-00fb5c2559c7@oracle.com>
 <CABgObfZU_uLAPzDV--n67H3Hq6OKxUO=FQa2MH3CjdgTQR8pJg@mail.gmail.com>
 <99ad2011-58b7-42c8-9ee5-af598c76a732@oracle.com>
 <CABgObfa_mkk-c3NZ623WzYDxw59NcYB_tEQ8tFX4CECHW3JxQQ@mail.gmail.com>
 <ZhgIN4LIu2K5vf5y@chao-email>
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <ZhgIN4LIu2K5vf5y@chao-email>
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
	=?utf-8?B?d3VJU0xrOVlPWGlaRVo4K1BpZlBSOUIrdm1yL2diZnoxd3BTY1Qzd1IwV21i?=
 =?utf-8?B?NWtNMmxmckR1TEVqaG9sS2RiQjN3czBZUnV5ZFozd1lYdGtoNER1Rk1CS2w1?=
 =?utf-8?B?RkVjR3lmZUFqdVJBb3N1V1FHOG5YYlBqRkEwaElOVThmVU5BcU45d2VlYUFW?=
 =?utf-8?B?VnJwZmM4M1hzWGtHeFk0b1VQdHFQMFh3SHVBR2NqN3dYSzJGTFZhMitNd1hK?=
 =?utf-8?B?TTZNRlhNSFZpeWJlTTJUWFpvbUdvdENMQklhWUFkM01lVVlMbU1TbG82dEFI?=
 =?utf-8?B?VXl4NjM3b2FMcjF3anZ6NXhsM2NNcWx4SXVhL0VJZ1p5czZEalZOL2JTcC9W?=
 =?utf-8?B?ODM1YVJvRlNHV3dkanZpa0p2eis4YzR5UWtzRXJEZlo3YjRQbElSNkNhRkM4?=
 =?utf-8?B?V2s0RklPTkQwaVlRUXl2NEJRb3VEZnFvbWYwejQ5anczallTSjJzMG1BM2NS?=
 =?utf-8?B?c1RuNms3a3hROGcxVGhnbVNJcmFOcGRZdHBLN2xwcGpIeVBXQ3ZqQkFPQTdw?=
 =?utf-8?B?a2VCWnc2aWZMVm1udG9GSzhUbzh1M2RKdmRlNXB5V1ZLMWZmNWpOa1dFYzBP?=
 =?utf-8?B?dWFEa0xNZDhJUlRSV1hBZ3lmd1kxbGV5bjhoWkFzWk4zaXYxbytRTno3b2oz?=
 =?utf-8?B?RU5LQTEwR1crVnBJak5TVU9KbytrT0VpaVEwY0M1YXdVNVF6K3pRdGJmSEtw?=
 =?utf-8?B?OTE4QkhueWJhMUh0WEpvVFQxbUNTOXZFZi9BbEZVNENMN2xsNXhDMFMxbUVV?=
 =?utf-8?B?dHFQTkN4S0diWlphY05sM1dtbnVjR1V6ZGpLWjR2d3VIaEw1Z1YxYUpoRjgz?=
 =?utf-8?B?VkVTRVFVM2xXWkpVZzVkbU5PZ3lueTAvKzN4V3Jwb2ZYMUp5amFzTWNCTUZr?=
 =?utf-8?B?MXRxd1dYcUF1aEU0NTZicnZETWtmQ2tsTk1hM2FxOUU5UE9xNGVLWWZPSk4z?=
 =?utf-8?B?SFdVRnRyandIaVdtV2RlRGZ1cU5xS2ZZaHpNVTlWelJ0cXIwUFhRTW40YlBJ?=
 =?utf-8?B?OGFSK251Ty8yRTJUVVp2VWNMSG5EenVEcEw5OWdja2JnOEJ1NlJmckpjZ0I2?=
 =?utf-8?B?TEZXcGtibFd5cUJVT2hZUCthczh4dUVNSnVNWHRrSTlGR1RJOHkrRVR4ckkx?=
 =?utf-8?B?VlNXS2pYalNvaVhyZDJaOFdMY1NiUFhlWndjVHRMdDUxSE9oNk5MczJXY201?=
 =?utf-8?B?YmFTdkZ6d3BvdUt6bTMzdG5BMFIwTTZ1Vyt1ajNtZlpKaDZnTGQvK3RDSEFH?=
 =?utf-8?B?eEVWREhOMzNoMkVDMU1xWVkwczdqdEJCWkhUelJLRVlJSEZTR3htcDZBdmFp?=
 =?utf-8?B?MjF2dHhoOEs0TzEydnovQjBTRW9jU3k4eVVtSEo2eStacjFqbG9XWmlGdG9u?=
 =?utf-8?B?dU5SemxmV1p0SHUzcjFISGFpMXduNTdFY3U3K3d6YXhZaTgzRTYzaGpRLzF5?=
 =?utf-8?B?WUM3UmZDNHB2WkloUEhpQjY0QTlKUTkzVDlMYTNxNGN4VFEvOGJNMGFxcE9X?=
 =?utf-8?B?b0xoQ2VGSWNXRDkxZXIzMVAvL1NCeU1PRW42aENjZ1JoRmFnbklQTDJzb0xl?=
 =?utf-8?B?RjBRWWMrM2Iyb2Z4M0FEcktxdCthbE0wVFdtL0pJLzh4QU0yUEJSdlJPOVlX?=
 =?utf-8?B?eWwvc1ZEYWlSYW5vVDgyZDJPZDNQR2dSa2tqaWpFZlo1b3RseFBuRUE4VExF?=
 =?utf-8?B?YXpXemtEMHF3dWxrNTdrVE5sNmNkS1dvMTAxM1ZWd2dHQmV5M2dIZEVWbU1y?=
 =?utf-8?B?YWdUb2Q2Z0I0WlUxVUhQcklDN3d2M1hqQW1GcTk0UXhzb0pkbFhoMFFrT2l4?=
 =?utf-8?B?OWl4R3BUbnFhVGNJSXV1WFNONzhUdEFKRlFQdUFZS3ppamZUTWdUdFU1dUhF?=
 =?utf-8?B?M3JyNjZnRS9IMnR2QUJpOHphR0xGSFkxTGMvWmRyWVUrNGpJZzMzS3NQYzRm?=
 =?utf-8?B?T0twNlozSGpTYUFZSVFTVEZUWmc3aHJOU1Z6dDhnbVdlZ0F2V3J2WkVJRStI?=
 =?utf-8?B?Z21UNDg4em5tTDdGYkpJRW1CbFBKTlNPR1ZRak9EMVRBWjVpY1MvR3VuL0I3?=
 =?utf-8?B?MG82NHR6dnBmcGM0Q0c3U1VsL09GdGhjYU9idkEwd1RRUTNhVGhuUGJpbE9O?=
 =?utf-8?B?MkFHN05pNWU4bEZzb3lzdWNOMzF5aFE4ai9Cd2x1dVhKY3dDNGRXbXduK0lF?=
 =?utf-8?B?OUE9PQ==?=
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 
	6HSCKXT6FKbkYVgEFSY9rXoTjDi2hpJH3LTlTtVBkGkbRd7evAFJZ84t2sYb6DQRTXonOqNkRSBDIOn1jIaOgqAS70w0VkoOeRnu6O1JNxb73T8IBXXsJa57Ltmez47ZThX3xHGLQh3cHI/p1+XKVlyVW/QwDdaIwCTEI8TQXA3/TzNax6JkxogZTL1AlotPjctj/EVF+wkUEXFXiwiAYtDu/8/K1VdkJn6gXUi/8dW2wJPfLWU3W7cxcANEFzOYFuQG9LionJhNxdiup7Qvo7ntPcU1dQ7u2NUu899/R1IdEnoWL9Eqp/wGvSdt37duOIZ04IVsFUfkqZ0Hq3u9RkbM29DhEulbi4n2HxFa2BKnsBStmrByYOXp7EjOtZw8HNcgzeiJcQN1czT51JG1EabFOWOMxYs6c8mMQCrlPKpPI0DC14omCMBHshd7B7BTXIqpnNi44jQyen8SEpNgbHZWJZLpYa8QYCqgNI2PErpYGE1g0XxrYP3fRvbl+VfHsRF+e/3IdZme0gUEHOWZGhWvCr4FaLp0gtKzPujXrEzHE8wztpPwNDEYD8CvGUmFvbmzmSQeacufdQ8o+lAEssBPEK7lcQvaViZBVl5URW0=
X-OriginatorOrg: oracle.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f9c6ee25-2bcf-4428-2966-08dc5a690870
X-MS-Exchange-CrossTenant-AuthSource: DM4PR10MB6719.namprd10.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Apr 2024 20:50:34.2092
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: iAfQeqrBv39xLTNsi0oPEjA6K8f7BNoE17GrtJ6zGGwSmMMX/5/SAXrhxTlEo5GgwDgm1dsZRIcKh/a8txjcXA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH2PR10MB4309
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.272,Aquarius:18.0.1011,Hydra:6.0.619,FMLib:17.11.176.26
 definitions=2024-04-11_10,2024-04-09_01,2023-05-22_02
X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 bulkscore=0 mlxscore=0 adultscore=0
 phishscore=0 spamscore=0 malwarescore=0 mlxlogscore=999 suspectscore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2404010000
 definitions=main-2404110151
X-Proofpoint-GUID: 3-vwZCg6qROAdffXpKNNadaAQR7K_YLG
X-Proofpoint-ORIG-GUID: 3-vwZCg6qROAdffXpKNNadaAQR7K_YLG

On Thu, Apr 11, 2024 at 11:56:39PM +0800, Chao Gao wrote:
> On Thu, Apr 11, 2024 at 05:20:30PM +0200, Paolo Bonzini wrote:
> >On Thu, Apr 11, 2024 at 5:13 PM Alexandre Chartre
> ><alexandre.chartre@oracle.com> wrote:
> >> I think that Andrew's concern is that if there is no eIBRS on the host then
> >> we do not set X86_BUG_BHI on the host because we know the kernel which is
> >> running and this kernel has some mitigations (other than the explicit BHI
> >> mitigations) and these mitigations are enough to prevent BHI. But still
> >> the cpu is affected by BHI.
> >
> >Hmm, then I'm confused. It's what I wrote before: "The (Linux or
> >otherwise) guest will make its own determinations as to whether BHI
> >mitigations are necessary. If the guest uses eIBRS, it will run with
> >mitigations" but you said machines without eIBRS are fine.
> >
> >If instead they are only fine _with Linux_, then yeah we cannot set
> >BHI_NO in general. What we can do is define a new bit that is in the
> >KVM leaves. The new bit is effectively !eIBRS, except that it is
> >defined in such a way that, in a mixed migration pool, both eIBRS and
> >the new bit will be 0.
> 
> This looks a good solution.
> 
> We can also introduce a new bit indicating the effectiveness of the short
> BHB-clearing sequence. KVM advertises this bit for all pre-SPR/ADL parts.
> Only if the bit is 1, guests will use the short BHB-clearing sequence.
> Otherwise guests should use the long sequence. In a mixed migration pool,
> the VMM shouldn't expose the bit to guests.

Is there a link to this 'short BHB-clearing sequence'?

But on your email, should a Skylake guests enable IBRS (or retpoline)
and have the short BHB clearing sequence?

And IceLake/Cascade lake should use eIBRS (or retpoline) and short BHB
clearing sequence?

If we already know all of this why does the hypervisor need to advertise
this to the guest? They can lookup the CPU data to make this determination, no?

I don't actually understand how one could do a mixed migration pool with
the various mitigations one has to engage (or not) based on the host one
is running under.
> 
> >
> >Paolo
> >
> >