Received: by 2002:ac0:a581:0:0:0:0:0 with SMTP id m1-v6csp976206imm; Fri, 29 Jun 2018 09:18:30 -0700 (PDT) X-Google-Smtp-Source: ADUXVKLcSCPBZNjEAqiQtxNlAvekPmFn4gIc2/q0t05xVJKkOF/Z/sb17/ZpgJ5OORzNDycBdPYE X-Received: by 2002:a63:64c2:: with SMTP id y185-v6mr13090834pgb.126.1530289110277; Fri, 29 Jun 2018 09:18:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1530289110; cv=none; d=google.com; s=arc-20160816; b=ZXnWhopkE5dqegZK+jyOpegmFxYb6XZu6nySN589POEpviHDcAVvOSw6KvEoKFDFZg SF8gCajOPHKP7DJu1ntozOAPQDMvgcsPie96dpU4yJb2lcuALrJUwBeKCrw6xF0b8XDL xtmJRjMXQG3uiit4ljTZjamMe+IITl0MjyYU5fzk+2m1C7HaZKoyyzY8cQ1NCoBtIbXF lLIIYtWp84+e9qKFGaIgAs7EkXiaZigNvOas1qwSvD5T4Yx14mISiqb8pGUm2jOYaitK WZcRBdD6+3TPVQdKzf2otMQZqykK4nqXwveE50vUp8L2UHyMZsut0u9GJYHslilyVUKU jZPg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :arc-authentication-results; bh=HB2LJtaFfTB+32pYM/T5EfgVxWRfF68oQeuO1WLTw38=; b=pjKUaHSmvsWkqQwQf0s47hH34PtKAtUeF5GD64zM5PcFv6GB386zB83a/8bi41PDtF gtfxXTo1QQXoQXkFDwYxZsFEaSQHZRNi7sURGX+nDIj/t1Bmx1W/r4rnLoutiIAeqUdw XEVhdKnru7NIC1OLAwXmAO24wPf+ARNXnCqFhHP3c3YNozULPGT705kAM+APnhhWY6Kd QKPmiD/82oT2YaJQzphWoRpJYh0sPamc0bFl4owxaMAQsa9/ZT74AWSi3zmo8Wc5rUKM znlT1OuVhluyoyHSRb+oApdl6ZoyOgP3Lg/vJQ6geC+ol2u3/QUv1/kpMhq/MQ5bNqP3 zmwg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 196-v6si8649219pgg.588.2018.06.29.09.18.15; Fri, 29 Jun 2018 09:18:30 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S936645AbeF2OPL (ORCPT + 99 others); Fri, 29 Jun 2018 10:15:11 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:39282 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S935441AbeF2OPI (ORCPT ); Fri, 29 Jun 2018 10:15:08 -0400 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.rdu2.redhat.com [10.11.54.3]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 814A14068029; Fri, 29 Jun 2018 14:15:07 +0000 (UTC) Received: from vitty.brq.redhat.com (unknown [10.43.2.155]) by smtp.corp.redhat.com (Postfix) with ESMTP id 8804B1102E29; Fri, 29 Jun 2018 14:15:01 +0000 (UTC) From: Vitaly Kuznetsov To: kvm@vger.kernel.org Cc: x86@kernel.org, Paolo Bonzini , =?UTF-8?q?Radim=20Kr=C4=8Dm=C3=A1=C5=99?= , Roman Kagan , "K. Y. Srinivasan" , Haiyang Zhang , Stephen Hemminger , "Michael Kelley (EOSG)" , Mohammed Gamal , Cathy Avery , Wanpeng Li , linux-kernel@vger.kernel.org Subject: [PATCH v3 2/5] KVM: x86: hyperv: optimize 'all cpus' case in kvm_hv_flush_tlb() Date: Fri, 29 Jun 2018 16:14:52 +0200 Message-Id: <20180629141455.19525-3-vkuznets@redhat.com> In-Reply-To: <20180629141455.19525-1-vkuznets@redhat.com> References: <20180629141455.19525-1-vkuznets@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.78 on 10.11.54.3 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.5]); Fri, 29 Jun 2018 14:15:07 +0000 (UTC) X-Greylist: inspected by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.5]); Fri, 29 Jun 2018 14:15:07 +0000 (UTC) for IP:'10.11.54.3' DOMAIN:'int-mx03.intmail.prod.int.rdu2.redhat.com' HELO:'smtp.corp.redhat.com' FROM:'vkuznets@redhat.com' RCPT:'' Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org We can use 'NULL' to represent 'all cpus' case in kvm_make_vcpus_request_mask() and avoid building vCPU mask with all vCPUs. Suggested-by: Radim Krčmář Signed-off-by: Vitaly Kuznetsov --- arch/x86/kvm/hyperv.c | 42 +++++++++++++++++++++++------------------- virt/kvm/kvm_main.c | 6 ++---- 2 files changed, 25 insertions(+), 23 deletions(-) diff --git a/arch/x86/kvm/hyperv.c b/arch/x86/kvm/hyperv.c index ceaa7fb10c49..c5b921c0a467 100644 --- a/arch/x86/kvm/hyperv.c +++ b/arch/x86/kvm/hyperv.c @@ -1312,35 +1312,39 @@ static u64 kvm_hv_flush_tlb(struct kvm_vcpu *current_vcpu, u64 ingpa, cpumask_clear(&hv_current->tlb_lush); + if (all_cpus) { + kvm_make_vcpus_request_mask(kvm, + KVM_REQ_TLB_FLUSH | KVM_REQUEST_NO_WAKEUP, + NULL, &hv_current->tlb_lush); + goto ret_success; + } + kvm_for_each_vcpu(i, vcpu, kvm) { struct kvm_vcpu_hv *hv = &vcpu->arch.hyperv; int bank = hv->vp_index / 64, sbank = 0; - if (!all_cpus) { - /* Banks >64 can't be represented */ - if (bank >= 64) - continue; - - /* Non-ex hypercalls can only address first 64 vCPUs */ - if (!ex && bank) - continue; + /* Banks >64 can't be represented */ + if (bank >= 64) + continue; - if (ex) { - /* - * Check is the bank of this vCPU is in sparse - * set and get the sparse bank number. - */ - sbank = get_sparse_bank_no(valid_bank_mask, - bank); + /* Non-ex hypercalls can only address first 64 vCPUs */ + if (!ex && bank) + continue; - if (sbank < 0) - continue; - } + if (ex) { + /* + * Check is the bank of this vCPU is in sparse + * set and get the sparse bank number. + */ + sbank = get_sparse_bank_no(valid_bank_mask, bank); - if (!(sparse_banks[sbank] & BIT_ULL(hv->vp_index % 64))) + if (sbank < 0) continue; } + if (!(sparse_banks[sbank] & BIT_ULL(hv->vp_index % 64))) + continue; + /* * vcpu->arch.cr3 may not be up-to-date for running vCPUs so we * can't analyze it here, flush TLB regardless of the specified diff --git a/virt/kvm/kvm_main.c b/virt/kvm/kvm_main.c index ada21f47f22b..153f14e91fb1 100644 --- a/virt/kvm/kvm_main.c +++ b/virt/kvm/kvm_main.c @@ -213,7 +213,7 @@ bool kvm_make_vcpus_request_mask(struct kvm *kvm, unsigned int req, me = get_cpu(); kvm_for_each_vcpu(i, vcpu, kvm) { - if (!test_bit(i, vcpu_bitmap)) + if (vcpu_bitmap && !test_bit(i, vcpu_bitmap)) continue; kvm_make_request(req, vcpu); @@ -237,12 +237,10 @@ bool kvm_make_all_cpus_request(struct kvm *kvm, unsigned int req) { cpumask_var_t cpus; bool called; - static unsigned long vcpu_bitmap[BITS_TO_LONGS(KVM_MAX_VCPUS)] - = {[0 ... BITS_TO_LONGS(KVM_MAX_VCPUS)-1] = ULONG_MAX}; zalloc_cpumask_var(&cpus, GFP_ATOMIC); - called = kvm_make_vcpus_request_mask(kvm, req, vcpu_bitmap, cpus); + called = kvm_make_vcpus_request_mask(kvm, req, NULL, cpus); free_cpumask_var(cpus); return called; -- 2.14.4