Received: by 2002:a05:6a10:a841:0:0:0:0 with SMTP id d1csp4838023pxy; Tue, 27 Apr 2021 13:56:53 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy9IGu3m8lh+IMfGlbObyBIdrVKkTMIOxsjC7G4g7NSNxcYoDC2QXt6ChR2c4tycDBFoq0/ X-Received: by 2002:aa7:d5c7:: with SMTP id d7mr6773263eds.114.1619557012982; Tue, 27 Apr 2021 13:56:52 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1619557012; cv=none; d=google.com; s=arc-20160816; b=dEQUbuDjeKZJwgtMST7lE+serJIJhD20Sd75i/zX/+L4pGKU6RzQLbn9Cd6eS5r1tw aZHTrxs1zrMw1CNGePTwfnINN+4NmRhGK/TM6aQ98QnWrdabQJyYuJ4BPdFIXmH+yHL9 JJbC9MfQsIaj0i7as+5M+tuMT0Fz8DD6P+d/zjYv0ZHy5igqBIrLEI+uFgmPi628JTIV KrdSsvV3Avdy6uFIIHe+LL8bHiS0CJkQIxcPRvbxboWgsFs135nB13AUzLXHV1zzGhkq vdaEnvodDI0b5mrTsI2wq17GqIWN//5ErTicmkvYdqRTnwWeunaoTtVaisUVLSjaC84C wrHw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature:dkim-filter; bh=xqElmAcSUSaDejhXkc1b8y5LQbBrxkMdgKVlO7kAJ9k=; b=HYXMKR2UElsJjtEkS4jokWEuApj8UQdPw8/DYkg+IzskOOBuq3U7upX56cTwzR8Pki tjUFzLPFRDvrOjCOmXHc23zexpZqd1JydG0Uxz7uaaetTrF/TrJnRnrvUjclo8dXbjpv z/hpFJmVMnwlP+eHXbp5Cx2O0dCkvDkwzj41jlc7bxnHFcF8490BBEFsrABAfX9ijN6e ztMhVIxveOZg3YMmMHprNVx0Vy+HbBM6P4MGnPt+bquShhaYvb83jkyqmH+DnOW7cRQ/ IP57Pfqhz908O0WzYeFxKt4aFHctthJEA6e/VG+lAakOh859NjU7SqIHi6lCgYXbgl3J af2g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b="iIPEsY/R"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id k5si825835ejd.336.2021.04.27.13.56.06; Tue, 27 Apr 2021 13:56:52 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@linux.microsoft.com header.s=default header.b="iIPEsY/R"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linux.microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S239081AbhD0Uzv (ORCPT + 99 others); Tue, 27 Apr 2021 16:55:51 -0400 Received: from linux.microsoft.com ([13.77.154.182]:35558 "EHLO linux.microsoft.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S239040AbhD0Uzt (ORCPT ); Tue, 27 Apr 2021 16:55:49 -0400 Received: from viremana-dev.fwjladdvyuiujdukmejncen4mf.xx.internal.cloudapp.net (unknown [13.66.132.26]) by linux.microsoft.com (Postfix) with ESMTPSA id BE8B220B8000; Tue, 27 Apr 2021 13:55:05 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com BE8B220B8000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1619556905; bh=xqElmAcSUSaDejhXkc1b8y5LQbBrxkMdgKVlO7kAJ9k=; h=From:To:Cc:Subject:Date:From; b=iIPEsY/RWWfQ3JvBDrepFpdoykwTO1WUSIHuIn29dZd24W4pUZGXbwhbP1w43LYpX Jt6l5k0kIVrenJk0orisZZPNsoZt8GqSWuOoCriOF1O0B1KtbwXHxYRvHo58bmrXbc dv2z0RlXPp2V7ukVL5KKG3trWkSVIs8EZfQmE3VA= From: Vineeth Pillai To: Lan Tianyu , Michael Kelley , Paolo Bonzini , Sean Christopherson , Vitaly Kuznetsov , Tom Lendacky , Wanpeng Li , Jim Mattson , Joerg Roedel , Wei Liu , Stephen Hemminger , Haiyang Zhang Cc: Vineeth Pillai , "H. Peter Anvin" , Thomas Gleixner , Ingo Molnar , Borislav Petkov , "K. Y. Srinivasan" , x86@kernel.org, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-hyperv@vger.kernel.org Subject: [PATCH v4 0/7] Hyper-V nested virt enlightenments for SVM Date: Tue, 27 Apr 2021 20:54:49 +0000 Message-Id: X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch series enables the nested virtualization enlightenments for SVM. This is very similar to the enlightenments for VMX except for the fact that there is no enlightened VMCS. For SVM, VMCB is already an architectural in-memory data structure. The supported enlightenments are: Enlightened TLB Flush: If this is enabled, ASID invalidations invalidate only gva -> hpa entries. To flush entries derived from NPT, hyper-v provided hypercalls (HvFlushGuestPhysicalAddressSpace or HvFlushGuestPhysicalAddressList) should be used. Enlightened MSR bitmap(TLFS 16.5.3): "When enabled, L0 hypervisor does not monitor the MSR bitmaps for changes. Instead, the L1 hypervisor must invalidate the corresponding clean field after making changes to one of the MSR bitmaps." Direct Virtual Flush(TLFS 16.8): The hypervisor exposes hypercalls (HvFlushVirtualAddressSpace, HvFlushVirtualAddressSpaceEx, HvFlushVirtualAddressList, and HvFlushVirtualAddressListEx) that allow operating systems to more efficiently manage the virtual TLB. The L1 hypervisor can choose to allow its guest to use those hypercalls and delegate the responsibility to handle them to the L0 hypervisor. This requires the use of a partition assist page." L2 Windows boot time was measured with and without the patch. Time was measured from power on to the login screen and was averaged over a consecutive 5 trials: Without the patch: 42 seconds With the patch: 29 seconds -- Changes from v3 - Included definitions for software/hypervisor reserved fields in SVM architectural data structures. - Consolidated Hyper-V specific code into svm_onhyperv.[ch] to reduce the "ifdefs". This change applies only to SVM, VMX is not touched and is not in the scope of this patch series. Changes from v2: - Refactored the Remote TLB Flush logic into separate hyperv specific source files (kvm_onhyperv.[ch]). - Reverted the VMCB Clean bits macro changes as it is no longer needed. Changes from v1: - Move the remote TLB flush related fields from kvm_vcpu_hv and kvm_hv to kvm_vcpu_arch and kvm_arch. - Modify the VMCB clean mask runtime based on whether L1 hypervisor is running on Hyper-V or not. - Detect Hyper-V nested enlightenments based on HYPERV_CPUID_VENDOR_AND_MAX_FUNCTIONS. - Address other minor review comments. --- Vineeth Pillai (7): hyperv: Detect Nested virtualization support for SVM hyperv: SVM enlightened TLB flush support flag KVM: x86: hyper-v: Move the remote TLB flush logic out of vmx KVM: SVM: Software reserved fields KVM: SVM: hyper-v: Remote TLB flush for SVM KVM: SVM: hyper-v: Enlightened MSR-Bitmap support KVM: SVM: hyper-v: Direct Virtual Flush support arch/x86/include/asm/hyperv-tlfs.h | 9 ++ arch/x86/include/asm/kvm_host.h | 14 +++ arch/x86/include/asm/svm.h | 9 +- arch/x86/include/uapi/asm/svm.h | 3 + arch/x86/kernel/cpu/mshyperv.c | 10 +- arch/x86/kvm/Makefile | 9 ++ arch/x86/kvm/kvm_onhyperv.c | 94 +++++++++++++++++++ arch/x86/kvm/kvm_onhyperv.h | 33 +++++++ arch/x86/kvm/svm/svm.c | 13 +++ arch/x86/kvm/svm/svm.h | 22 ++++- arch/x86/kvm/svm/svm_onhyperv.c | 41 +++++++++ arch/x86/kvm/svm/svm_onhyperv.h | 141 +++++++++++++++++++++++++++++ arch/x86/kvm/vmx/vmx.c | 97 ++------------------ arch/x86/kvm/vmx/vmx.h | 10 -- arch/x86/kvm/x86.c | 8 ++ 15 files changed, 406 insertions(+), 107 deletions(-) create mode 100644 arch/x86/kvm/kvm_onhyperv.c create mode 100644 arch/x86/kvm/kvm_onhyperv.h create mode 100644 arch/x86/kvm/svm/svm_onhyperv.c create mode 100644 arch/x86/kvm/svm/svm_onhyperv.h -- 2.25.1