Received: by 2002:ab2:1149:0:b0:1f3:1f8c:d0c6 with SMTP id z9csp782204lqz; Sat, 30 Mar 2024 21:19:16 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCX75g4HMywoSkDVv1xDuOyoo5gJ83OSrVzknLausjeTLPso70HrTv+mpsH9t5QNvzB1pgJH6OkwMod1pManx3Q2D7BPxayCldABqQy5ZA== X-Google-Smtp-Source: AGHT+IGUJxsf4jBZlwnj+tRTKLO1gWi+bTV/9SiZlIPWPAfawWM47uR/sVUUtBgxwNqz4204JDJJ X-Received: by 2002:a92:c56a:0:b0:365:70c5:7e66 with SMTP id b10-20020a92c56a000000b0036570c57e66mr7839113ilj.8.1711858755955; Sat, 30 Mar 2024 21:19:15 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1711858755; cv=pass; d=google.com; s=arc-20160816; b=vz40blhRMOPE/QqS+FX8ubaZgQRw7HDqezXWPGlNNn+iFN0Vzu7x79UkEIIRfvKXKt rD6atfv3Ym/CJ6VL6cYZE2PT7RgURGU/J4JI6XYdffJC9RK9ALorjH6dBUFu5mtuOmsQ W1ah+S2Q3LxcozDSVMBv3exPSrJniaXqykwECyKlXIM23Tp+6xqgOZdqTQLAgOHFPNmU oxPfhcFXqQl1kUK90EHNXruTTM/d14yLFJXo4latQf6HQcSDIARlAg5gwNMb/oM7xNYI iYSv1vkK37QG4cZ5uZrKrbo5seQvPsuG6xRSRAgoJaH6nYU58dBvAtQ5chug2FTWaTai BtSw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from:dkim-signature; bh=debH6ZPB+bQmeeylsoKHcO1e82zQn5qn1d5rn8huvsQ=; fh=fp2HDdlH6q5edGh4HXhNtG/K0put97Oj8J18fF96usE=; b=DZF7ARRruxps2Vupd6pJifBg+RxxqhbMI+Zu7/DHdf/D6Kj0jYE/TcA55prL38CVwn UuI0IrhudxXN/EBwTZlmaLK0ko9ag88SKMsVB7cuGK1mROtArCMUHaWjBLpoXgVmDvvG UxkdemG5XIyub4ugQedh5lpEVZLoSDVeP1gvAWRK0+ShvB7kv4nA4vISMm+w++Lxw7zc Wjc7OjfgDotozJnrXK0M3tVUCwuKn1xji5SOP9It6m4NBxro4uixjImYXMrKDucz2AwT spBadFW7Qd0wkVY5oNq2H9ro/fwVQdutmNDIg5Ub+QJPBlJcUVG7SxvOu5A6if4mcUfi BSig==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=lESXkq9D; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-125953-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-125953-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from sy.mirrors.kernel.org (sy.mirrors.kernel.org. [147.75.48.161]) by mx.google.com with ESMTPS id l14-20020a170903244e00b001e245cafca2si2147450pls.383.2024.03.30.21.19.15 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 30 Mar 2024 21:19:15 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-125953-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) client-ip=147.75.48.161; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=k20201202 header.b=lESXkq9D; arc=pass (i=1 dkim=pass dkdomain=kernel.org); spf=pass (google.com: domain of linux-kernel+bounces-125953-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.48.161 as permitted sender) smtp.mailfrom="linux-kernel+bounces-125953-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by sy.mirrors.kernel.org (Postfix) with ESMTPS id 3F600B21885 for ; Sun, 31 Mar 2024 04:18:59 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 3D60E8828; Sun, 31 Mar 2024 04:18:42 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="lESXkq9D" Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 502A379CF; Sun, 31 Mar 2024 04:18:40 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711858721; cv=none; b=J8d0GNK6rRcolipXzcrBMkrdRkvUoae4aiGfuBc6DOXCjr3YZWTBUF7v81vHPto/bV5uSPiU0abzEzvTsTfai/nBLTZ5dsppWEd7C7Th1UEuXh41YddmKAtSi/EfAQsSEkVaABaU2YIpT3o/2m2TfRMwaSSpMU3q/U3rVmgQ18A= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1711858721; c=relaxed/simple; bh=2UoMgzqdK9r8CvIpC3oOB03imODxUNwTnU11qkixdmQ=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=uDhil0dOUy2cS1n8SPuvjWBJ55iRMjKNeeS5XlXmBD/pxIea8Ntv/12z6YN+Pvyuvi6DubJJqwTThpRzYzJorgSQZGvz0Lf+UtObd8QVyOFHZn0t3ednrz/EaaHOp5q4c0kPTcfWkGoj4oynQJMOzD4gA87tKfZjusBYveUhQYg= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=lESXkq9D; arc=none smtp.client-ip=10.30.226.201 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 92972C433F1; Sun, 31 Mar 2024 04:18:40 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1711858720; bh=2UoMgzqdK9r8CvIpC3oOB03imODxUNwTnU11qkixdmQ=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=lESXkq9DIszACumsllrkE24+iuuU5YhDXYwjQ+YXDsxMfoHxc7mo6cRQe4i+S8Th4 rnUNSJEwKmninWTZXwaj6llKPE6itMSq6ibbBgPKaBdYbg3q96pZU3Fq+0cWyxa8jN EyZL2WlcW51O7iP89GXaGDJ2GS7TwVRJZKTQ1Yrq7RO4CZqino98cxES/TCXVlnPCr kXjslbX20zlxuNcArbI9FQwscJNeWiDYJWR7aTSGLnvuv93S37wxZ3J+Ulev/QisE5 ccBhgwP6oDG2q8LQklKujFJ5T6Gbuvc/6+2trgVKHRbIFfo6ZYsQM3aJqFFA94W4aE NdDihVuOqtqFQ== From: Andrii Nakryiko To: x86@kernel.org, peterz@infradead.org, mingo@redhat.com, tglx@linutronix.de Cc: bpf@vger.kernel.org, linux-kernel@vger.kernel.org, jolsa@kernel.org, song@kernel.org, kernel-team@meta.com, Andrii Nakryiko , Sandipan Das Subject: [PATCH v4 1/4] perf/x86/amd: ensure amd_pmu_core_disable_all() is always inlined Date: Sat, 30 Mar 2024 21:18:27 -0700 Message-ID: <20240331041830.2806741-2-andrii@kernel.org> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20240331041830.2806741-1-andrii@kernel.org> References: <20240331041830.2806741-1-andrii@kernel.org> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit In the following patches we will enable LBR capture on AMD CPUs at arbitrary point in time, which means that LBR recording won't be frozen by hardware automatically as part of hardware overflow event. So we need to take care to minimize amount of branches and function calls/returns on the path to freezing LBR, minimizing LBR snapshot altering as much as possible. amd_pmu_core_disable_all() is one of the functions on this path, and is already marked as __always_inline. But it calls amd_pmu_set_global_ctl() which is marked as just inline. So to guarantee no function call will be generated thoughout mark amd_pmu_set_global_ctl() as __always_inline as well. Reviewed-by: Sandipan Das Signed-off-by: Andrii Nakryiko --- arch/x86/events/amd/core.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/arch/x86/events/amd/core.c b/arch/x86/events/amd/core.c index aec16e581f5b..c5bcbc87d057 100644 --- a/arch/x86/events/amd/core.c +++ b/arch/x86/events/amd/core.c @@ -618,7 +618,7 @@ static void amd_pmu_cpu_dead(int cpu) } } -static inline void amd_pmu_set_global_ctl(u64 ctl) +static __always_inline void amd_pmu_set_global_ctl(u64 ctl) { wrmsrl(MSR_AMD64_PERF_CNTR_GLOBAL_CTL, ctl); } -- 2.43.0