Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp3349457pxf; Sun, 28 Mar 2021 22:51:05 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyZh8eXMocTS42TgMkwEc69QOxuOHxdtPO1oDqzSpw8Wdp2XAgdkLEgALFI9XI6G295LK4l X-Received: by 2002:aa7:cb82:: with SMTP id r2mr27033077edt.209.1616997065207; Sun, 28 Mar 2021 22:51:05 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1616997065; cv=none; d=google.com; s=arc-20160816; b=RmyNml28xJhPNJUQDREdxXvRy2QTlWJY71t5GfvyUoVVuj38SKjQdrrQrJGNovI2wy 4UJOcqZZYrcMrzkvBJbr7Fd2qn1Cl4r5qEPktnU+scxKI3XCpKBe4LCvt3w+xIsED8pT 2sS5HZ7AUoV0Zh9hoC1g20Mtpvx0IEYQEHIh709VmKcW9vGA4UNMqGtxetADlzwHCXv6 5fu+2sXmPYnkxVivZmdo7kcdd0+JyckXdLbVzqUEiqG0c2v2pcfMqxs5MtAtpE4tbeIv yzvuXp5oIxGL0vEMjwlpDjNWaJyzlQscdLXWhDvxz2TyUltt2VXKBQ2xh1kHChbiwEQ4 6hIA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr; bh=IbIAZORCO2r38XwwHSlzyP5v2+knMc7vsOdLXVdj5Ig=; b=vJ9XTZOLHdNu5iB52OYfr1Qg1fX5t6khj6Dtq75qdoIqvaxPrwVmW68jVUTrPMFJnv JFLbeZ52If9qsvZonhpLwlFf2ctSi6KX/0hlwdXJsH3s2g0xU4LOtasaXmUYXiEDwa03 m/X+xgj9ursHbHlhVca6R9U3WPuWjNmmHhFahHiLjtXj/V2tfpdw5wRjszMfgAvnxZCd kXsCCHJVaA9LQFvDVqF7AXqDq7McxVWCmoexTQS8oI2qZ+q/xVcKq0CFkPdZ1H8TTMSc WKfwDc3VP0fYUau4Rsab0ZTR2gAI2Hh0VFD+zzrekt/bBjxKboHIGcQIK9AXtYrOpZVu g55A== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id s9si12139193edc.296.2021.03.28.22.50.42; Sun, 28 Mar 2021 22:51:05 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230220AbhC2Ftk (ORCPT + 99 others); Mon, 29 Mar 2021 01:49:40 -0400 Received: from mga07.intel.com ([134.134.136.100]:15632 "EHLO mga07.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229515AbhC2FtZ (ORCPT ); Mon, 29 Mar 2021 01:49:25 -0400 IronPort-SDR: cLO0AHKdrH1kXzRcwbUeJjOuZYhT0CrookATUbqjWo0VZeNfuXUhy5dO3bMn5SzpU3vo+KIv08 kQKQHZsPtzLA== X-IronPort-AV: E=McAfee;i="6000,8403,9937"; a="255478706" X-IronPort-AV: E=Sophos;i="5.81,285,1610438400"; d="scan'208";a="255478706" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Mar 2021 22:49:23 -0700 IronPort-SDR: t/wHvNuUyofxcUzRtyW16YZzvE2GIz4pUu4kq7TFfIAGk2lkMT5gCBZMNLI1DMCP5mmc3an8CS IHjUPuthU6JA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.81,285,1610438400"; d="scan'208";a="417506661" Received: from clx-ap-likexu.sh.intel.com ([10.239.48.108]) by orsmga008.jf.intel.com with ESMTP; 28 Mar 2021 22:49:20 -0700 From: Like Xu To: peterz@infradead.org, Sean Christopherson , Paolo Bonzini Cc: eranian@google.com, andi@firstfloor.org, kan.liang@linux.intel.com, wei.w.wang@intel.com, Wanpeng Li , Vitaly Kuznetsov , Jim Mattson , Joerg Roedel , kvm@vger.kernel.org, x86@kernel.org, linux-kernel@vger.kernel.org, Like Xu Subject: [PATCH v4 00/16] KVM: x86/pmu: Add basic support to enable Guest PEBS via DS Date: Mon, 29 Mar 2021 13:41:21 +0800 Message-Id: <20210329054137.120994-1-like.xu@linux.intel.com> X-Mailer: git-send-email 2.29.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org The guest Precise Event Based Sampling (PEBS) feature can provide an architectural state of the instruction executed after the guest instruction that exactly caused the event. It needs new hardware facility only available on Intel Ice Lake Server platforms. This patch set enables the basic PEBS via DS feature for KVM guests on ICX. We can use PEBS feature on the Linux guest like native: # perf record -e instructions:ppp ./br_instr a # perf record -c 100000 -e instructions:pp ./br_instr a To emulate guest PEBS facility for the above perf usages, we need to implement 2 code paths: 1) Fast path This is when the host assigned physical PMC has an identical index as the virtual PMC (e.g. using physical PMC0 to emulate virtual PMC0). This path is used in most common use cases. 2) Slow path This is when the host assigned physical PMC has a different index from the virtual PMC (e.g. using physical PMC1 to emulate virtual PMC0) In this case, KVM needs to rewrite the PEBS records to change the applicable counter indexes to the virtual PMC indexes, which would otherwise contain the physical counter index written by PEBS facility, and switch the counter reset values to the offset corresponding to the physical counter indexes in the DS data structure. The previous version [0] enables both fast path and slow path, which seems a bit more complex as the first step. In this patchset, we want to start with the fast path to get the basic guest PEBS enabled while keeping the slow path disabled. More focused discussion on the slow path [1] is planned to be put to another patchset in the next step. Compared to later versions in subsequent steps, the functionality to support host-guest PEBS both enabled and the functionality to emulate guest PEBS when the counter is cross-mapped are missing in this patch set (neither of these are typical scenarios). With the basic support, the guest can retrieve the correct PEBS information from its own PEBS records on the Ice Lake servers. And we expect it should work when migrating to another Ice Lake and no regression about host perf is expected. Here are the results of pebs test from guest/host for same workload: perf report on guest: # Samples: 2K of event 'instructions:ppp', # Event count (approx.): 1473377250 # Overhead Command Shared Object Symbol 57.74% br_instr br_instr [.] lfsr_cond 41.40% br_instr br_instr [.] cmp_end 0.21% br_instr [kernel.kallsyms] [k] __lock_acquire perf report on host: # Samples: 2K of event 'instructions:ppp', # Event count (approx.): 1462721386 # Overhead Command Shared Object Symbol 57.90% br_instr br_instr [.] lfsr_cond 41.95% br_instr br_instr [.] cmp_end 0.05% br_instr [kernel.vmlinux] [k] lock_acquire Conclusion: the profiling results on the guest are similar tothat on the host. Please check more details in each commit and feel free to comment. Previous: [0] https://lore.kernel.org/kvm/20210104131542.495413-1-like.xu@linux.intel.com/ [1] https://lore.kernel.org/kvm/20210115191113.nktlnmivc3edstiv@two.firstfloor.org/ v3->v4 Changelog: - Update this cover letter and propose a new upstream plan; [PERF] - Drop check host DS and move handler to handle_pmi_common(); - Pass "struct kvm_pmu *" to intel_guest_get_msrs(); - Propose new assignment logic for perf_guest_switch_msr(); - Introduce x86_pmu.pebs_vmx for future capability maintenance; [KVM] - Add kvm_pmu_cap to optimize perf_get_x86_pmu_capability; - Raising PEBS PMI only when OVF_BIT 62 is not set; - Make vmx_icl_pebs_cpu specific for PEBS-PDIR emulation; - Fix a bug for fixed_ctr_ctrl_mask; - Add two minor refactoring patches for reuse; Like Xu (16): perf/x86/intel: Add x86_pmu.pebs_vmx for Ice Lake Servers perf/x86/intel: Handle guest PEBS overflow PMI for KVM guest perf/x86/core: Pass "struct kvm_pmu *" to determine the guest values KVM: x86/pmu: Set MSR_IA32_MISC_ENABLE_EMON bit when vPMU is enabled KVM: x86/pmu: Introduce the ctrl_mask value for fixed counter KVM: x86/pmu: Reprogram guest PEBS event to emulate guest PEBS counter KVM: x86/pmu: Add IA32_PEBS_ENABLE MSR emulation for extended PEBS KVM: x86/pmu: Add IA32_DS_AREA MSR emulation to manage guest DS buffer KVM: x86/pmu: Add PEBS_DATA_CFG MSR emulation to support adaptive PEBS KVM: x86: Set PEBS_UNAVAIL in IA32_MISC_ENABLE when PEBS is enabled KVM: x86/pmu: Adjust precise_ip to emulate Ice Lake guest PDIR counter KVM: x86/pmu: Move pmc_speculative_in_use() to arch/x86/kvm/pmu.h KVM: x86/pmu: Disable guest PEBS before vm-entry in two cases KVM: x86/pmu: Add kvm_pmu_cap to optimize perf_get_x86_pmu_capability KVM: x86/cpuid: Refactor host/guest CPU model consistency check KVM: x86/pmu: Expose CPUIDs feature bits PDCM, DS, DTES64 arch/x86/events/core.c | 5 +- arch/x86/events/intel/core.c | 93 +++++++++++++++++++++++--- arch/x86/events/perf_event.h | 5 +- arch/x86/include/asm/kvm_host.h | 16 +++++ arch/x86/include/asm/msr-index.h | 6 ++ arch/x86/include/asm/perf_event.h | 5 +- arch/x86/kvm/cpuid.c | 24 ++----- arch/x86/kvm/cpuid.h | 5 ++ arch/x86/kvm/pmu.c | 49 ++++++++++---- arch/x86/kvm/pmu.h | 37 +++++++++++ arch/x86/kvm/vmx/capabilities.h | 26 ++++++-- arch/x86/kvm/vmx/pmu_intel.c | 105 ++++++++++++++++++++++++------ arch/x86/kvm/vmx/vmx.c | 25 ++++++- arch/x86/kvm/vmx/vmx.h | 2 +- arch/x86/kvm/x86.c | 14 ++-- 15 files changed, 339 insertions(+), 78 deletions(-) -- 2.29.2