Received: by 2002:a05:6a10:9e8c:0:0:0:0 with SMTP id y12csp691719pxx; Wed, 28 Oct 2020 14:39:17 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzIkpo6DeSPkoGCbcEfly63xrQR13i8pfIUz7GqrqxnutO60yzpJz0LkEzHcGrJ+ApHLupc X-Received: by 2002:aa7:dada:: with SMTP id x26mr931491eds.167.1603921157445; Wed, 28 Oct 2020 14:39:17 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1603921157; cv=none; d=google.com; s=arc-20160816; b=vHKFOIj7ffeQKoOeYmMd5nJj0TjwgHGRRPHSlsxbVWPSCLpg5EJeAoxtRmA2SW8BFh +qx5Vk5Fq3J2PIoXhRnMxXRvTI0P49wIFmc+76oji4vRnLrvPnHfE/GppCrnJZr+JYle gdEO3C6Ijsr3DIAZPXnFFu76BgTkGeJ3XbiOuW+IRx272CgCnUnM/o4l3eGHURa/a6gG qfS17eQJcxGcxYmhJCTxxuHfgrKd6Kvrw2tg+0AbGt8j6t+lMncHkJHMp1CTuK+xeQQ8 DhH6HQ+DlLKiciBIxlTSvT2b1T/SfcXEbTtR7rXhJtADVAqcknZTq6ibmegUyV632nbS 6Grw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :ironport-sdr:ironport-sdr; bh=MErElHRnJGEImOSRgoBKZd3k9Rmz9st6GAWOOwhwTnc=; b=gG+vg0ezILinkjKAT6WurArwq+NoNUpcbXp40Cj/VaFiKcgIcW9+CoQPTNOdHQcd0S /kssUXAvlb9IkS8P6vhe2NdGVoNw+Q/4YicEQsNdeyOVdzdVoGe1QtUcl7F5RDjzFrje Fl3UcgRF6yV/QbulGhEDBm/nHQJ7PeXfEAfMD59StYbRTrPEQthhwuyQY6XNBWxhN+rq bOeL7S7Wi3YARk89GaJalMe1AuG46ksqjNu+cbD/6ZpXxFaDAbYJNeHoJTWQeTyNbmqL 1MqGo6vivSrKIV/e94WThZkyn+Zru0yAixY9apyxLbboRa20P9rZioc6DPwNr0NTs8gO As6Q== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id o2si519179edv.485.2020.10.28.14.38.55; Wed, 28 Oct 2020 14:39:17 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S373793AbgJ0VXx (ORCPT + 99 others); Tue, 27 Oct 2020 17:23:53 -0400 Received: from mga02.intel.com ([134.134.136.20]:56183 "EHLO mga02.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S373768AbgJ0VXw (ORCPT ); Tue, 27 Oct 2020 17:23:52 -0400 IronPort-SDR: MjnUB3EqW/biV6+XQZAVlgUgfzJCSMlWuMBiYh+7SKOsubFq4iD8kywFH96SoJNFNAtzixva6O BKGmfpSYjrYw== X-IronPort-AV: E=McAfee;i="6000,8403,9787"; a="155133700" X-IronPort-AV: E=Sophos;i="5.77,424,1596524400"; d="scan'208";a="155133700" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga006.fm.intel.com ([10.253.24.20]) by orsmga101.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 27 Oct 2020 14:23:50 -0700 IronPort-SDR: 3UozLD4kj4WnCWtLJ7DqPUL0Cpp8zQELJIy/Gr/IV75Ox6lYLnHHhqYtpMhw50iNRpXhqWMM6l 8UsKHQmoMRiA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.77,424,1596524400"; d="scan'208";a="524886379" Received: from sjchrist-coffee.jf.intel.com ([10.54.74.160]) by fmsmga006.fm.intel.com with ESMTP; 27 Oct 2020 14:23:50 -0700 From: Sean Christopherson To: Paolo Bonzini Cc: Sean Christopherson , Vitaly Kuznetsov , Wanpeng Li , Jim Mattson , Joerg Roedel , kvm@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH v3 02/11] KVM: VMX: Track common EPTP for Hyper-V's paravirt TLB flush Date: Tue, 27 Oct 2020 14:23:37 -0700 Message-Id: <20201027212346.23409-3-sean.j.christopherson@intel.com> X-Mailer: git-send-email 2.28.0 In-Reply-To: <20201027212346.23409-1-sean.j.christopherson@intel.com> References: <20201027212346.23409-1-sean.j.christopherson@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Explicitly track the EPTP that is common to all vCPUs instead of grabbing vCPU0's EPTP when invoking Hyper-V's paravirt TLB flush. Tracking the EPTP will allow optimizing the checks when loading a new EPTP and will also allow dropping ept_pointer_match, e.g. by marking the common EPTP as invalid. This also technically fixes a bug where KVM could theoretically flush an invalid GPA if all vCPUs have an invalid root. In practice, it's likely impossible to trigger a remote TLB flush in such a scenario. In any case, the superfluous flush is completely benign. Signed-off-by: Sean Christopherson --- arch/x86/kvm/vmx/vmx.c | 20 +++++++++----------- arch/x86/kvm/vmx/vmx.h | 1 + 2 files changed, 10 insertions(+), 11 deletions(-) diff --git a/arch/x86/kvm/vmx/vmx.c b/arch/x86/kvm/vmx/vmx.c index 273a3206cef7..ebc87df4da4d 100644 --- a/arch/x86/kvm/vmx/vmx.c +++ b/arch/x86/kvm/vmx/vmx.c @@ -483,12 +483,14 @@ static void check_ept_pointer_match(struct kvm *kvm) if (!VALID_PAGE(tmp_eptp)) { tmp_eptp = to_vmx(vcpu)->ept_pointer; } else if (tmp_eptp != to_vmx(vcpu)->ept_pointer) { + to_kvm_vmx(kvm)->hv_tlb_eptp = INVALID_PAGE; to_kvm_vmx(kvm)->ept_pointers_match = EPT_POINTERS_MISMATCH; return; } } + to_kvm_vmx(kvm)->hv_tlb_eptp = tmp_eptp; to_kvm_vmx(kvm)->ept_pointers_match = EPT_POINTERS_MATCH; } @@ -501,21 +503,18 @@ static int kvm_fill_hv_flush_list_func(struct hv_guest_mapping_flush_list *flush range->pages); } -static inline int __hv_remote_flush_tlb_with_range(struct kvm *kvm, - struct kvm_vcpu *vcpu, struct kvm_tlb_range *range) +static inline int hv_remote_flush_eptp(u64 eptp, struct kvm_tlb_range *range) { - u64 ept_pointer = to_vmx(vcpu)->ept_pointer; - /* * FLUSH_GUEST_PHYSICAL_ADDRESS_SPACE hypercall needs address * of the base of EPT PML4 table, strip off EPT configuration * information. */ if (range) - return hyperv_flush_guest_mapping_range(ept_pointer & PAGE_MASK, + return hyperv_flush_guest_mapping_range(eptp & PAGE_MASK, kvm_fill_hv_flush_list_func, (void *)range); else - return hyperv_flush_guest_mapping(ept_pointer & PAGE_MASK); + return hyperv_flush_guest_mapping(eptp & PAGE_MASK); } static int hv_remote_flush_tlb_with_range(struct kvm *kvm, @@ -533,12 +532,11 @@ static int hv_remote_flush_tlb_with_range(struct kvm *kvm, kvm_for_each_vcpu(i, vcpu, kvm) { /* If ept_pointer is invalid pointer, bypass flush request. */ if (VALID_PAGE(to_vmx(vcpu)->ept_pointer)) - ret |= __hv_remote_flush_tlb_with_range( - kvm, vcpu, range); + ret |= hv_remote_flush_eptp(to_vmx(vcpu)->ept_pointer, + range); } - } else { - ret = __hv_remote_flush_tlb_with_range(kvm, - kvm_get_vcpu(kvm, 0), range); + } else if (VALID_PAGE(to_kvm_vmx(kvm)->hv_tlb_eptp)) { + ret = hv_remote_flush_eptp(to_kvm_vmx(kvm)->hv_tlb_eptp, range); } spin_unlock(&to_kvm_vmx(kvm)->ept_pointer_lock); diff --git a/arch/x86/kvm/vmx/vmx.h b/arch/x86/kvm/vmx/vmx.h index a2d143276603..9a25e83f8b96 100644 --- a/arch/x86/kvm/vmx/vmx.h +++ b/arch/x86/kvm/vmx/vmx.h @@ -301,6 +301,7 @@ struct kvm_vmx { bool ept_identity_pagetable_done; gpa_t ept_identity_map_addr; + hpa_t hv_tlb_eptp; enum ept_pointers_status ept_pointers_match; spinlock_t ept_pointer_lock; }; -- 2.28.0