Received: by 2002:a05:6a10:17d3:0:0:0:0 with SMTP id hz19csp790480pxb; Thu, 15 Apr 2021 06:44:54 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyDJ8naExcat1TLLw0QRUCXx+RYXXGJn9RgXdsvogx+l4nIHp5yJ4bRE9yR4i4ZiLQdSqru X-Received: by 2002:a63:4d5c:: with SMTP id n28mr3589796pgl.436.1618494294630; Thu, 15 Apr 2021 06:44:54 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1618494294; cv=none; d=google.com; s=arc-20160816; b=ylJRyhzal7r7pvSEJtpbYdyt8FeAg7xnJruYMFNaGRDmqB7uPw9MzEfW0BBNrP7DZC 8bNhodtuh9cDpzYOtubKld6wK7wEc1CAPridN/aoXVpQqYEXAFbCC4YDI3d7jPgzNUBN qDkLFM1T1To3HWRmFploBsFjExpfudvP1KXmMHUt6VXUIymTSHIoEghSLOAxd8h4TiPr HE2urSVyVImoWkP3Ql6qtFShTqTbLy+/ZgnuZEijbFyGbxYSGv8OUXGOMim1QWT7Gavx ihh0ObLA7aiWTFpZe8CuRjpSS/LzlDBHM+Fee+tGvnedWzvagnuL+aMX7XC/+CmBNfUV UPzw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature:dkim-filter; bh=f+72EpphKYDyWb2ni9IPH1kTpGV8sLOlwjys3mFfBxI=; b=rPrytEAb0mJOahpzvS9ll216a8GlLDuneJOEjwjh3/6J4S6jbx5xl2bWTmE0rTrIBF +nGbqB+KHQP+ky/6tbRnxKdDYVkdn1TWWHMe2i+76BI6UeiDasfaW9JKdEoPxtFsTjoz NmbFX2d8JxDtfiVBnUCp3ydT9UEy855LQJrq/Pot1N2Sp5NJZvw8Oxl47ocNnlj1zkgf FAHo4SZQsbS45UgWDNvKptF/lWi9iKbnQlfsMK9mEUiZyHsLo4RAh50VweReUBExrTtE vMojBNvAh85o7KER3R5HJyzY/r4i6qNiNOYZiWv2JrBhMvaCVYlfmU2j06lKB5utarxY JUpQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b="KkjRctg/"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id q4si1820169plr.82.2021.04.15.06.44.42; Thu, 15 Apr 2021 06:44:54 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b="KkjRctg/"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233411AbhDONoW (ORCPT + 99 others); Thu, 15 Apr 2021 09:44:22 -0400 Received: from linux.microsoft.com ([13.77.154.182]:41504 "EHLO linux.microsoft.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233357AbhDONoS (ORCPT ); Thu, 15 Apr 2021 09:44:18 -0400 Received: from viremana-dev.fwjladdvyuiujdukmejncen4mf.xx.internal.cloudapp.net (unknown [13.66.132.26]) by linux.microsoft.com (Postfix) with ESMTPSA id EB6D020B8001; Thu, 15 Apr 2021 06:43:54 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com EB6D020B8001 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1618494235; bh=f+72EpphKYDyWb2ni9IPH1kTpGV8sLOlwjys3mFfBxI=; h=From:To:Cc:Subject:Date:From; b=KkjRctg//cx736rviMBMko/DerhF/2bHx3YRxjgwH+KTq9v0c0jITUtNAKkvMbaHH I3Pp9qTlwLvjsXR53qZUFJlG4MIwku4JjZHaWDeXSYEM5e4Fsm59nhDU+XgK0/rflv eoFIjulbg0eh/ZZF/b+m7IuXBehE31DefmdLu4xA= From: Vineeth Pillai To: Lan Tianyu , Michael Kelley , Paolo Bonzini , Sean Christopherson , Vitaly Kuznetsov , Wanpeng Li , Jim Mattson , Joerg Roedel , Wei Liu , Stephen Hemminger , Haiyang Zhang Cc: Vineeth Pillai , "H. Peter Anvin" , Thomas Gleixner , Ingo Molnar , Borislav Petkov , "K. Y. Srinivasan" , x86@kernel.org, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-hyperv@vger.kernel.org Subject: [PATCH v2 0/7] Hyper-V nested virt enlightenments for SVM Date: Thu, 15 Apr 2021 13:43:35 +0000 Message-Id: X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch series enables the nested virtualization enlightenments for SVM. This is very similar to the enlightenments for VMX except for the fact that there is no enlightened VMCS. For SVM, VMCB is already an architectural in-memory data structure. The supported enlightenments are: Enlightened TLB Flush: If this is enabled, ASID invalidations invalidate only gva -> hpa entries. To flush entries derived from NPT, hyper-v provided hypercalls (HvFlushGuestPhysicalAddressSpace or HvFlushGuestPhysicalAddressList) should be used. Enlightened MSR bitmap(TLFS 16.5.3): "When enabled, L0 hypervisor does not monitor the MSR bitmaps for changes. Instead, the L1 hypervisor must invalidate the corresponding clean field after making changes to one of the MSR bitmaps." Direct Virtual Flush(TLFS 16.8): The hypervisor exposes hypercalls (HvFlushVirtualAddressSpace, HvFlushVirtualAddressSpaceEx, HvFlushVirtualAddressList, and HvFlushVirtualAddressListEx) that allow operating systems to more efficiently manage the virtual TLB. The L1 hypervisor can choose to allow its guest to use those hypercalls and delegate the responsibility to handle them to the L0 hypervisor. This requires the use of a partition assist page." L2 Windows boot time was measured with and without the patch. Time was measured from power on to the login screen and was averaged over a consecutive 5 trials: Without the patch: 42 seconds With the patch: 29 seconds -- Changes from v1: - Move the remote TLB flush related fields from kvm_vcpu_hv and kvm_hv to kvm_vcpu_arch and kvm_arch. - Modify the VMCB clean mask runtime based on whether L1 hypervisor is running on Hyper-V or not. - Detect Hyper-V nested enlightenments based on HYPERV_CPUID_VENDOR_AND_MAX_FUNCTIONS. - Address other minor review comments. --- Vineeth Pillai (7): hyperv: Detect Nested virtualization support for SVM hyperv: SVM enlightened TLB flush support flag KVM: x86: hyper-v: Move the remote TLB flush logic out of vmx KVM: SVM: hyper-v: Nested enlightenments in VMCB KVM: SVM: hyper-v: Remote TLB flush for SVM KVM: SVM: hyper-v: Enlightened MSR-Bitmap support KVM: SVM: hyper-v: Direct Virtual Flush support arch/x86/include/asm/hyperv-tlfs.h | 9 +++ arch/x86/include/asm/kvm_host.h | 14 ++++ arch/x86/include/asm/svm.h | 24 +++++- arch/x86/kernel/cpu/mshyperv.c | 10 ++- arch/x86/kvm/hyperv.c | 87 +++++++++++++++++++++ arch/x86/kvm/hyperv.h | 20 +++++ arch/x86/kvm/svm/svm.c | 120 +++++++++++++++++++++++++++++ arch/x86/kvm/svm/svm.h | 30 +++++++- arch/x86/kvm/vmx/vmx.c | 97 ++--------------------- arch/x86/kvm/vmx/vmx.h | 10 --- arch/x86/kvm/x86.c | 9 ++- 11 files changed, 323 insertions(+), 107 deletions(-) -- 2.25.1