Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp253895pxk; Thu, 17 Sep 2020 02:00:51 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzirQQ4e+tAvIkUTfzU7LM7pl2E+QyOmIjg996WYfMgV+FBp3ZRMbVQdC5k3hbiXbStViZp X-Received: by 2002:a17:907:3301:: with SMTP id ym1mr31269672ejb.367.1600333251723; Thu, 17 Sep 2020 02:00:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1600333251; cv=none; d=google.com; s=arc-20160816; b=u/sYEjxxA5mAZjA3T7nNGgC+oTno53BQCOwGwwNq44MkW79amNU8BzmIxo5TJjW91w 4g/k5y9cZ7bGki2qKaTqvi7mFF9HMOLs0G5Bm8RFUWV8o6ekAMCmUDvJBdBdkIqocbrr TuB2e1iPx2EOfWY+ja36B5ITXUhx+/5mVBCK/99hW9NWrCLRSJT67e80ZmYZBgwDyjCd 3TXCWd1vqOaICO/aOEvtQfhUcS5Zzq6DsAOrdS7Ff6Ddmej+DUlO7Pw/QA3X0PswMvvv fDIZSY9LwVo+iqBJ8oNKLxJruVnXIhL7x6naH1ShadFRXIm0nm9a8pl7WBO96zkRr1wg B3Bg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:content-language :in-reply-to:mime-version:user-agent:date:message-id:from:references :cc:to:subject:dkim-signature; bh=u2Q5W6NAzslAk1ByBm0MYfEGJIT21PziYx8gteQ5Vhs=; b=MAqXfCsdrnsaSPZIU062z6YfXBcOrqS9GQ3+BPkNlvxN8wjpFkZgDt99oLiNJ0euUB fK7x/bx10UHI2OsLjwBiifI/AqyOj3A61gsvgZC6v+4N+NpM750swo8w3IIsm54GLZgG kIFaFcPgZoA0jdwToMj9DCZzXIpsIIY6l4GgWsNbQno75TAOfWR9Ly8cExQ5vXZUhqUS EU9Z085zNp3oys0tM3ncWalF7LwBfWDcbbAJNiH/KEtTRrHPNYxqgRqBOVHlAeq/HjQL 804X5bm+JuseToSgWYaACem3/DlZGd4nRxD0JxWhPYvGtRkeUenc0SHeuiPMdlt1fFsI gxGQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=ZazY5rTc; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id e3si14436735ejq.508.2020.09.17.02.00.27; Thu, 17 Sep 2020 02:00:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=ZazY5rTc; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726445AbgIQI40 (ORCPT + 99 others); Thu, 17 Sep 2020 04:56:26 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:27591 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726171AbgIQI4Y (ORCPT ); Thu, 17 Sep 2020 04:56:24 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1600332983; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=u2Q5W6NAzslAk1ByBm0MYfEGJIT21PziYx8gteQ5Vhs=; b=ZazY5rTciOz5z3PkF74rvLA3KRiEgy/gl27HcF9URyWcDF3bEkd5Vuv0BWp8rVZTvnoGTK Wl/e04/AxEW4Y9PWYbG7/8REHkCrx7GLttUJEAz1rLE3OCxiuDEBrJxchZYGKcx9RKS/Oe oUrCBK3rJ6qhddlLyndC/3S1iImje9A= Received: from mail-wr1-f72.google.com (mail-wr1-f72.google.com [209.85.221.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-119-PvbhCh1aNRm0H_fo6Oq5MQ-1; Thu, 17 Sep 2020 04:56:21 -0400 X-MC-Unique: PvbhCh1aNRm0H_fo6Oq5MQ-1 Received: by mail-wr1-f72.google.com with SMTP id h4so621456wrb.4 for ; Thu, 17 Sep 2020 01:56:20 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=u2Q5W6NAzslAk1ByBm0MYfEGJIT21PziYx8gteQ5Vhs=; b=H25yasmsESS9AZu6qNCgLGvzdv02dntJPJkuqWbN13bB/k3WAuu0odDBkSL2es7xwW zL9AvwctNVArdNyE+zougP7yc9mGD7jwHK3mnfe1EzlfM044Qw41spDUfI84x2jBzlbV Kc7v3FvhdU6c3RTMdqRmbVKe+guj6VriopWOqtsrf3Fm/2hVojJ2bOk/FoFQMz3kjMoO pZzsXYiyiH/gdQYcU1ZRaQxlKqNK7AbljvquXHSuCMIaOOpIdhSE5x32OBz7puODuHPX /C1f5oTFBwWuxUqzABiNNFX5qlo5c5/rHM2PuR9SUZFyDkOofiEL22lnjo+UfJPv/GD6 lgMw== X-Gm-Message-State: AOAM532L/Kp+aDDwzl0EpsuUjOAougsf9qg2GkswiSmKAvoSiKXkSAgP QD0bONidUBFqPpyF3WeABcSTTp1IfKeUMaWjCHWRtyQXrG3FM/ASbFF88TWcLBOH2p0Is261Tq+ WYb11RCAXi/WrK0fGTKCXPLj2 X-Received: by 2002:adf:f5c7:: with SMTP id k7mr31978533wrp.246.1600332979873; Thu, 17 Sep 2020 01:56:19 -0700 (PDT) X-Received: by 2002:adf:f5c7:: with SMTP id k7mr31978509wrp.246.1600332979621; Thu, 17 Sep 2020 01:56:19 -0700 (PDT) Received: from ?IPv6:2001:b07:6468:f312:d003:b94f:6314:4839? ([2001:b07:6468:f312:d003:b94f:6314:4839]) by smtp.gmail.com with ESMTPSA id v2sm37283429wrm.16.2020.09.17.01.56.18 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 17 Sep 2020 01:56:19 -0700 (PDT) Subject: Re: [PATCH RFC] KVM: x86: emulate wait-for-SIPI and SIPI-VMExit To: yadong.qi@intel.com, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, x86@kernel.org Cc: sean.j.christopherson@intel.com, vkuznets@redhat.com, wanpengli@tencent.com, jmattson@google.com, joro@8bytes.org, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, hpa@zytor.com, liran.alon@oracle.com, nikita.leshchenko@oracle.com, chao.gao@intel.com, kevin.tian@intel.com, luhai.chen@intel.com, bing.zhu@intel.com, kai.z.wang@intel.com References: <20200917022501.369121-1-yadong.qi@intel.com> From: Paolo Bonzini Message-ID: Date: Thu, 17 Sep 2020 10:56:18 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: <20200917022501.369121-1-yadong.qi@intel.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 17/09/20 04:25, yadong.qi@intel.com wrote: > From: Yadong Qi > > Background: We have a lightweight HV, it needs INIT-VMExit and > SIPI-VMExit to wake-up APs for guests since it do not monitoring > the Local APIC. But currently virtual wait-for-SIPI(WFS) state > is not supported in KVM, so when running on top of KVM, the L1 > HV cannot receive the INIT-VMExit and SIPI-VMExit which cause > the L2 guest cannot wake up the APs. > > This patch is incomplete, it emulated wait-for-SIPI state by halt > the vCPU and emulated SIPI-VMExit to L1 when trapped SIPI signal > from L2. I am posting it RFC to gauge whether or not upstream > KVM is interested in emulating wait-for-SIPI state before > investing the time to finish the full support. Yes, the patch makes sense and is a good addition. What exactly is missing? (Apart from test cases in kvm-unit-tests!) Paolo > According to Intel SDM Chapter 25.2 Other Causes of VM Exits, > SIPIs cause VM exits when a logical processor is in > wait-for-SIPI state. > > In this patch: > 1. introduce SIPI exit reason, > 2. introduce wait-for-SIPI state for nVMX, > 3. advertise wait-for-SIPI support to guest. > > When L1 hypervisor is not monitoring Local APIC, L0 need to emulate > INIT-VMExit and SIPI-VMExit to L1 to emulate INIT-SIPI-SIPI for > L2. L2 LAPIC write would be traped by L0 Hypervisor(KVM), L0 should > emulate the INIT/SIPI vmexit to L1 hypervisor to set proper state > for L2's vcpu state.