Received: by 2002:a05:7412:8521:b0:e2:908c:2ebd with SMTP id t33csp798452rdf; Fri, 3 Nov 2023 16:06:47 -0700 (PDT) X-Google-Smtp-Source: AGHT+IHn+d3+1amQtX8uXdphm7d3Fxlv4ycO09axY6Y4u+zpCGw7ML6+apRJ+INca9gLzRBV6wlk X-Received: by 2002:a17:902:cf46:b0:1cc:33e7:95f5 with SMTP id e6-20020a170902cf4600b001cc33e795f5mr4090303plg.33.1699052806681; Fri, 03 Nov 2023 16:06:46 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1699052806; cv=none; d=google.com; s=arc-20160816; b=BDCc9yeAwffyPyJidzTAw9K2zSh7eWsIONFJpBvxmlo2SRANfP6ayT+eZvyu2idP9R lgRmBnTZ2vH4nQE9/sqqpp9ctB+TSIyxKH2Coevq4Q31X5WSN95BTNi6aTh5ym7Nuw8Q EAdC4tR7hOrF3a69gTn7J9dB8lvRUhCNlqw8+XjBafj++suMLYDIUT5B7GUOCAHyXjBU LDBvn+8Q0FxrFEbeLAK0NJSthRTLJUcGMiYa05wr8MPUMqVUmN55vAJFLRDZH33V6/4Z nVAkddUt9ZEdpUmXJFk/7//st9AsXrleOQYRxyG+VBuiZaVLWt38YXCHsdpjzChAAKrI cDag== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:from:subject:message-id:references :mime-version:in-reply-to:date:reply-to:dkim-signature; bh=KalgR4SKhAn+0sVVXRME3OmIqom3v7Pw10s1BHql8OU=; fh=GEJ0r4Uylk4yNLU+0Cus278tKN04SijuDr+21/yG6nk=; b=MC8S3DIDGgZeDNSWCVY1ZG0ME9e6n4/9+nMC4h0t01JcjyqrzhA0mYRDkl5x5+JKmj H9sJmyBw2fVm0NJn4PZs9iZcca6CkPzndqfkrzSJf1r6th+u2R98+6WDLQF1BthdFTw9 hBmzvB9OnGghMRKFLvnWdpxLVVgkoyjbEsRV4sthbw7OAZx+StlbBf30kxB3l9vGksAu Tchl6voIKBHLgdJCmrY5cWU0xYQR8l0g9kmQV87basZRHXBhHFXkIsc4YRFgDCM0cFuw Yv3jMZ18orfCMQvs9a4roAukx42eddUx/7NFhpPROYhN2pLvGmkphf6z/HOSG8E2acOm 4O2g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=qJpmvbS4; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from fry.vger.email (fry.vger.email. [2620:137:e000::3:8]) by mx.google.com with ESMTPS id cf7-20020a056a02084700b00565cc12ee24si2571765pgb.874.2023.11.03.16.06.46 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 03 Nov 2023 16:06:46 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) client-ip=2620:137:e000::3:8; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20230601 header.b=qJpmvbS4; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::3:8 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from out1.vger.email (depot.vger.email [IPv6:2620:137:e000::3:0]) by fry.vger.email (Postfix) with ESMTP id E9CD78080D7C; Fri, 3 Nov 2023 16:06:25 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.103.10 at fry.vger.email Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231670AbjKCXGF (ORCPT + 99 others); Fri, 3 Nov 2023 19:06:05 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:45162 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231365AbjKCXF4 (ORCPT ); Fri, 3 Nov 2023 19:05:56 -0400 Received: from mail-pg1-x54a.google.com (mail-pg1-x54a.google.com [IPv6:2607:f8b0:4864:20::54a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D80CFD72 for ; Fri, 3 Nov 2023 16:05:53 -0700 (PDT) Received: by mail-pg1-x54a.google.com with SMTP id 41be03b00d2f7-5b62a669d61so1919899a12.1 for ; Fri, 03 Nov 2023 16:05:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1699052753; x=1699657553; darn=vger.kernel.org; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:reply-to:from:to:cc:subject:date:message-id:reply-to; bh=KalgR4SKhAn+0sVVXRME3OmIqom3v7Pw10s1BHql8OU=; b=qJpmvbS4OgR53WFbHs4AZgKDK5ndzazak1vWEbz/cDu6CgzVXgDynazd9FqmPpal3x cTu/rGCHdGUYjECGOWrV6pmfhcqQm6SXNGQvdDJFO2Ad1g6nzx/c+eDWpeBjmCtGNTEv FNSWmhJu9y985Wwe4KRQDCUluhoT5vbHyqXIaQaQsl33REWDVBH+Ql4LiukQEd7vC2LL 9A41oSFLehYil9jiv4L58PfRA5SerZXfovsWnpvaJTqhWHGos1EG1JlhtHkrSrVrmTNs vpwmumI2Y7ivqlesPqGUMfmNOpka1mf3EJvfhFCPw12j91gp+D0TIZHM53F03W3AxHXJ 2FfA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699052753; x=1699657553; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:reply-to:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=KalgR4SKhAn+0sVVXRME3OmIqom3v7Pw10s1BHql8OU=; b=FuF5/x5ypCksm5TgY/xu8CgDoaAbx+TynGaNHxhy5WJooDcnnTQc3LYDzSqdPJkDR+ J542riQoOMkcrqpQhOQQOktlfldLhxV0SHzjuLiH66whcZqV+BwDDDTeDtnXR7JewZfF fCKrjtRE2yeRxlGyuKsgshEDRuclEVC+ZUbiueScg9g0ZCKiNmW01B7DKzhSX6u0cex7 pVwxgnVymPnnbXmKDqrahsFtnWgTNEqCoa0wCYp0HxkIPDB12vHlzBygHzzUeBkPhpT5 +f8ChwHaFyZ26R+TvKKPdXZacDi9Y7jd2CPGd1uk9OOjWb11pKyuol4EYgg6voeKdzt/ IFkw== X-Gm-Message-State: AOJu0Yw+C8EmYcQ7rg9tItwfPkWRjOBsKk3zdkr+wWYjXsoFlmIMFtKd NGeNlypybJ0XTsG4gTxTAtEu2U8AkdU= X-Received: from zagreus.c.googlers.com ([fda3:e722:ac3:cc00:7f:e700:c0a8:5c37]) (user=seanjc job=sendgmr) by 2002:a17:902:efd1:b0:1c6:2b9d:570b with SMTP id ja17-20020a170902efd100b001c62b9d570bmr412463plb.7.1699052753358; Fri, 03 Nov 2023 16:05:53 -0700 (PDT) Reply-To: Sean Christopherson Date: Fri, 3 Nov 2023 16:05:40 -0700 In-Reply-To: <20231103230541.352265-1-seanjc@google.com> Mime-Version: 1.0 References: <20231103230541.352265-1-seanjc@google.com> X-Mailer: git-send-email 2.42.0.869.gea05f2083d-goog Message-ID: <20231103230541.352265-6-seanjc@google.com> Subject: [PATCH v2 5/6] KVM: x86/pmu: Update sample period in pmc_write_counter() From: Sean Christopherson To: Sean Christopherson , Paolo Bonzini Cc: kvm@vger.kernel.org, linux-kernel@vger.kernel.org, Dapeng Mi , Mingwei Zhang , Roman Kagan , Jim Mattson , Like Xu Content-Type: text/plain; charset="UTF-8" X-Spam-Status: No, score=-8.4 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE, USER_IN_DEF_DKIM_WL autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on fry.vger.email Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (fry.vger.email [0.0.0.0]); Fri, 03 Nov 2023 16:06:26 -0700 (PDT) Update a PMC's sample period in pmc_write_counter() to deduplicate code across all callers of pmc_write_counter(). Opportunistically move pmc_write_counter() into pmc.c now that it's doing more work. WRMSR isn't such a hot path that an extra CALL+RET pair will be problematic, and the order of function definitions needs to be changed anyways, i.e. now is a convenient time to eat the churn. Reviewed-by: Dapeng Mi Signed-off-by: Sean Christopherson --- arch/x86/kvm/pmu.c | 27 +++++++++++++++++++++++++++ arch/x86/kvm/pmu.h | 25 +------------------------ arch/x86/kvm/svm/pmu.c | 1 - arch/x86/kvm/vmx/pmu_intel.c | 2 -- 4 files changed, 28 insertions(+), 27 deletions(-) diff --git a/arch/x86/kvm/pmu.c b/arch/x86/kvm/pmu.c index c06090196b00..3725d001239d 100644 --- a/arch/x86/kvm/pmu.c +++ b/arch/x86/kvm/pmu.c @@ -161,6 +161,15 @@ static u64 pmc_get_pebs_precise_level(struct kvm_pmc *pmc) return 1; } +static u64 get_sample_period(struct kvm_pmc *pmc, u64 counter_value) +{ + u64 sample_period = (-counter_value) & pmc_bitmask(pmc); + + if (!sample_period) + sample_period = pmc_bitmask(pmc) + 1; + return sample_period; +} + static int pmc_reprogram_counter(struct kvm_pmc *pmc, u32 type, u64 config, bool exclude_user, bool exclude_kernel, bool intr) @@ -268,6 +277,24 @@ static void pmc_stop_counter(struct kvm_pmc *pmc) } } +static void pmc_update_sample_period(struct kvm_pmc *pmc) +{ + if (!pmc->perf_event || pmc->is_paused || + !is_sampling_event(pmc->perf_event)) + return; + + perf_event_period(pmc->perf_event, + get_sample_period(pmc, pmc->counter)); +} + +void pmc_write_counter(struct kvm_pmc *pmc, u64 val) +{ + pmc->counter += val - pmc_read_counter(pmc); + pmc->counter &= pmc_bitmask(pmc); + pmc_update_sample_period(pmc); +} +EXPORT_SYMBOL_GPL(pmc_write_counter); + static int filter_cmp(const void *pa, const void *pb, u64 mask) { u64 a = *(u64 *)pa & mask; diff --git a/arch/x86/kvm/pmu.h b/arch/x86/kvm/pmu.h index db9a12c0a2ef..cae85e550f60 100644 --- a/arch/x86/kvm/pmu.h +++ b/arch/x86/kvm/pmu.h @@ -74,11 +74,7 @@ static inline u64 pmc_read_counter(struct kvm_pmc *pmc) return counter & pmc_bitmask(pmc); } -static inline void pmc_write_counter(struct kvm_pmc *pmc, u64 val) -{ - pmc->counter += val - pmc_read_counter(pmc); - pmc->counter &= pmc_bitmask(pmc); -} +void pmc_write_counter(struct kvm_pmc *pmc, u64 val); static inline bool pmc_is_gp(struct kvm_pmc *pmc) { @@ -128,25 +124,6 @@ static inline struct kvm_pmc *get_fixed_pmc(struct kvm_pmu *pmu, u32 msr) return NULL; } -static inline u64 get_sample_period(struct kvm_pmc *pmc, u64 counter_value) -{ - u64 sample_period = (-counter_value) & pmc_bitmask(pmc); - - if (!sample_period) - sample_period = pmc_bitmask(pmc) + 1; - return sample_period; -} - -static inline void pmc_update_sample_period(struct kvm_pmc *pmc) -{ - if (!pmc->perf_event || pmc->is_paused || - !is_sampling_event(pmc->perf_event)) - return; - - perf_event_period(pmc->perf_event, - get_sample_period(pmc, pmc->counter)); -} - static inline bool pmc_speculative_in_use(struct kvm_pmc *pmc) { struct kvm_pmu *pmu = pmc_to_pmu(pmc); diff --git a/arch/x86/kvm/svm/pmu.c b/arch/x86/kvm/svm/pmu.c index 3fd47de14b38..b6a7ad4d6914 100644 --- a/arch/x86/kvm/svm/pmu.c +++ b/arch/x86/kvm/svm/pmu.c @@ -161,7 +161,6 @@ static int amd_pmu_set_msr(struct kvm_vcpu *vcpu, struct msr_data *msr_info) pmc = get_gp_pmc_amd(pmu, msr, PMU_TYPE_COUNTER); if (pmc) { pmc_write_counter(pmc, data); - pmc_update_sample_period(pmc); return 0; } /* MSR_EVNTSELn */ diff --git a/arch/x86/kvm/vmx/pmu_intel.c b/arch/x86/kvm/vmx/pmu_intel.c index 90c1f7f07e53..a6216c874729 100644 --- a/arch/x86/kvm/vmx/pmu_intel.c +++ b/arch/x86/kvm/vmx/pmu_intel.c @@ -437,11 +437,9 @@ static int intel_pmu_set_msr(struct kvm_vcpu *vcpu, struct msr_data *msr_info) !(msr & MSR_PMC_FULL_WIDTH_BIT)) data = (s64)(s32)data; pmc_write_counter(pmc, data); - pmc_update_sample_period(pmc); break; } else if ((pmc = get_fixed_pmc(pmu, msr))) { pmc_write_counter(pmc, data); - pmc_update_sample_period(pmc); break; } else if ((pmc = get_gp_pmc(pmu, msr, MSR_P6_EVNTSEL0))) { reserved_bits = pmu->reserved_bits; -- 2.42.0.869.gea05f2083d-goog