Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp884133pxf; Wed, 7 Apr 2021 14:06:23 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyGVmdrsByESw21wce2P104LWm3az6RcPrh8ZO5eblOcCjh1oDNJud1AqRizHudvDXRYxdM X-Received: by 2002:a17:906:af09:: with SMTP id lx9mr6246456ejb.58.1617829582968; Wed, 07 Apr 2021 14:06:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1617829582; cv=none; d=google.com; s=arc-20160816; b=VtzKwbI4qq8vOwa6olam3x49EhtcFF39Wvj6NDcgN5/QE5WAnyH5ZP9ELU9jQKaDyN D1C7iEYCytcpkqXy/raujN3YOaTwAo6ncoNIXbUKcoLGl7hGKT+u87ZA7ukAXU8aB+tW HQ2w84WfhflKWGqg5p3uEpDW46n3R4bvHxC571rcBWs4qPKTZhUrdWgqVaGMxFPZJxO2 yoQFRO1kE+G1XiGf1dXRd+UICo3ieJVzzkEeqGJGQiaXY6E2RawzCpjftzhY8Tn74+Mn a/ybnCe2V1VMHCoxNE7sBXWYzpQRJ4Lu1/hEwk8u8UO5MPppr8YHc9RURkKRqa6BqWsD 1VUA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature:dkim-filter; bh=RW3dGYVmkQJ81p9LCGjxdTOdnRHf5p6gzfOsmE15srA=; b=phpumriixeFWMjAVzqlk1daNen5vZtt6k8ghEJwrizSNTAQ8rjwfeIY391q3r/fjPr bFTuRr+X05hqINcLVGdvo0xoDk6QIKoAvIcx2S84a4STYSOtxNXrO6Q0wOzROTf5BJIX CaI0FsAY9T8CnzSDKBWP0/tuowyo69CMUa7zdFsjmwuS5i3y8w2SsUUHWm5GvPEHhrl2 ND6LP0bnbysEz+1Ll4HTQyE6sfoP6dBnlOq8qUMwvfGWdjnzidp8BuNXORx/h2Hn7yiq 7amoUwe/y/0iAbd9Bx3nV7E7jMCrO7vXCiiw4vJC9nz/P35ATa201xFkjYpQYcLXw1Nt 9DsA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b=Us9lf1tq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id gb41si19612624ejc.90.2021.04.07.14.05.59; Wed, 07 Apr 2021 14:06:22 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b=Us9lf1tq; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1348560AbhDGOlz (ORCPT + 99 others); Wed, 7 Apr 2021 10:41:55 -0400 Received: from linux.microsoft.com ([13.77.154.182]:52636 "EHLO linux.microsoft.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233143AbhDGOlt (ORCPT ); Wed, 7 Apr 2021 10:41:49 -0400 Received: from viremana-dev.fwjladdvyuiujdukmejncen4mf.xx.internal.cloudapp.net (unknown [13.66.132.26]) by linux.microsoft.com (Postfix) with ESMTPSA id 60D1220B5680; Wed, 7 Apr 2021 07:41:39 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com 60D1220B5680 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1617806499; bh=RW3dGYVmkQJ81p9LCGjxdTOdnRHf5p6gzfOsmE15srA=; h=From:To:Cc:Subject:Date:From; b=Us9lf1tq6SKsXOX+Gk+BQdwovWevpXxp5hu+/E96tUiFLiEJuPMLz8AkIaAYze5GT DZ82VSEuGo5lgEZeVhKduwj9EyrocE65Lt3ViUvUYjDKFLHpOOfXFAzYXLZRs1G/vA SZCcLItDLOtjouYdZpaytaAB6fxqDnv3wmm6gg4E= From: Vineeth Pillai To: Lan Tianyu , Michael Kelley , Paolo Bonzini , Sean Christopherson , Vitaly Kuznetsov , Wanpeng Li , Jim Mattson , Joerg Roedel , Wei Liu , Stephen Hemminger , Haiyang Zhang Cc: Vineeth Pillai , "H. Peter Anvin" , Thomas Gleixner , Ingo Molnar , Borislav Petkov , "K. Y. Srinivasan" , x86@kernel.org, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-hyperv@vger.kernel.org Subject: [PATCH 0/7] Hyper-V nested virt enlightenments for SVM Date: Wed, 7 Apr 2021 14:41:21 +0000 Message-Id: X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch series enables the nested virtualization enlightenments for SVM. This is very similar to the enlightenments for VMX except for the fact that there is no enlightened VMCS. For SVM, VMCB is already an in-memory data structure. The supported enlightenments are: Enlightened TLB Flush: If this is enabled, ASID invalidations invalidate only gva -> hpa entries. To flush entries derived from NPT, hyper-v provided hypercalls (HvFlushGuestPhysicalAddressSpace or HvFlushGuestPhysicalAddressList) should be used. Enlightened MSR bitmap(TLFS 16.5.3): "When enabled, L0 hypervisor does not monitor the MSR bitmaps for changes. Instead, the L1 hypervisor must invalidate the corresponding clean field after making changes to one of the MSR bitmaps." Direct Virtual Flush(TLFS 16.8): The hypervisor exposes hypercalls (HvFlushVirtualAddressSpace, HvFlushVirtualAddressSpaceEx, HvFlushVirtualAddressList, and HvFlushVirtualAddressListEx) that allow operating systems to more efficiently manage the virtual TLB. The L1 hypervisor can choose to allow its guest to use those hypercalls and delegate the responsibility to handle them to the L0 hypervisor. This requires the use of a partition assist page." L2 Windows boot time was measured with and without the patch. Time was measured from power on to the login screen and was averaged over a consecutive 5 trials: Without the patch: 42 seconds With the patch: 29 seconds -- Vineeth Pillai (7): hyperv: Detect Nested virtualization support for SVM hyperv: SVM enlightened TLB flush support flag KVM: x86: hyper-v: Move the remote TLB flush logic out of vmx KVM: SVM: hyper-v: Nested enlightenments in VMCB KVM: SVM: hyper-v: Remote TLB flush for SVM KVM: SVM: hyper-v: Enlightened MSR-Bitmap support KVM: SVM: hyper-v: Direct Virtual Flush support arch/x86/include/asm/hyperv-tlfs.h | 9 +++ arch/x86/include/asm/kvm_host.h | 15 ++++ arch/x86/include/asm/svm.h | 24 ++++++- arch/x86/kernel/cpu/mshyperv.c | 10 ++- arch/x86/kvm/hyperv.c | 89 +++++++++++++++++++++++ arch/x86/kvm/hyperv.h | 12 ++++ arch/x86/kvm/svm/svm.c | 110 +++++++++++++++++++++++++++++ arch/x86/kvm/svm/svm.h | 30 +++++++- arch/x86/kvm/vmx/vmx.c | 97 ++----------------------- arch/x86/kvm/vmx/vmx.h | 10 --- 10 files changed, 302 insertions(+), 104 deletions(-) -- 2.25.1