Received-SPF: pass (google.com: domain of linux-kernel+bounces-18372-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223;
From: Ilkka Koskinen <ilkka@os.amperecomputing.com>
To: Marc Zyngier <maz@kernel.org>,
	Oliver Upton <oliver.upton@linux.dev>,
	James Morse <james.morse@arm.com>,
	Suzuki K Poulose <suzuki.poulose@arm.com>,
	Zenghui Yu <yuzenghui@huawei.com>,
	Catalin Marinas <catalin.marinas@arm.com>,
	Will Deacon <will@kernel.org>,
	Gavin Shan <gshan@redhat.com>,
	Mark Rutland <mark.rutland@arm.com>,
	Raghavendra Rao Ananta <rananta@google.com>
Cc: Ilkka Koskinen <ilkka@os.amperecomputing.com>,
	D Scott Phillips <scott@os.amperecomputing.com>,
	linux-arm-kernel@lists.infradead.org,
	kvmarm@lists.linux.dev,
	linux-kernel@vger.kernel.org
Subject: [RFC PATCH] KVM: arm64: Workaround for Ampere AC03_CPU_36 (exception taken to an incorrect EL)
Date: Fri,  5 Jan 2024 13:32:51 -0800
Message-ID: <20240105213251.4141-1-ilkka@os.amperecomputing.com>
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?us-ascii?Q?hUPPOu5X2U2ShhruUGmX54ZC2wu3J5wCIoOITnGlWcBHH6WdUl1opl7TScz/?=
 =?us-ascii?Q?2j7PM0SB3fFRvGxjtMdA2T6jZyoKcMl4v5EMofakGm4yOyJ2nkrYHo+nWThE?=
 =?us-ascii?Q?UAjXLsNd16QnR3uIeDRCOkvw/rQzs66u1W/UymIuOtb+pDLDCwvXbDugrVpD?=
 =?us-ascii?Q?sl9SQsnZKSvPdur1Oys9nTihwpXs8mCAF4WVn/Bp+YrORg5fOzhqEhrFHD55?=
 =?us-ascii?Q?U7XrvKtP5BYfl4mRXfVb08wLCLoqxFCfFqeFrXVGinY1M1lSdYuQ/MC+ysZF?=
 =?us-ascii?Q?Ycb6jDijoMHbTpMGyZ0oCDJD1q4LIEiuzez7i7tvOE/6FCVqOnYB7UX7Ea65?=
 =?us-ascii?Q?ug/FPsRT+cJD53FgGS940WmJZIomwSPZYsn1/j1T9tRxw+D7vTOMaqycszyw?=
 =?us-ascii?Q?vxKazXGGzL9aZsGWDwJTWPdBdX3uQ+EdiIfh6SAdip/BwOnlDh6mInSm8BOj?=
 =?us-ascii?Q?rw4Kl0sWquhKSXjQEfhen9GOlNJtsArjuAU4YDWUMBzAXtOdST8tbZOMa6q2?=
 =?us-ascii?Q?OuYxb96MMR9d0rqLGJ8BJvXMP47juxo53YRBDro/502icq5kN8rlYK3xtOn7?=
 =?us-ascii?Q?mSBfYXvxQ5qqo5I9r9hCHeCS3YhSHWxIZCO50H4+mEJun8VlKRLrU3FvPekT?=
 =?us-ascii?Q?XcgumkPVrVZdtEe7c6LV2wZuZJMYNKbSsJ68bePhYlGz0t9ep/53quwdgDWH?=
 =?us-ascii?Q?mKkS0ouvY2xQOLMPgi7yqPcNHoVMZTLVo2PAf5TfMe1lvNnKQWrrJmvuTp/m?=
 =?us-ascii?Q?c0+GNhRybPJJrfz+alhf1zp8XP226F/cyRLDaUJ5EwzXb7sz6pAyDg6WU2Uk?=
 =?us-ascii?Q?BTecrpzBvjBCvXT8rj0TPK40FoQr/N7AE134QS9/9ThWygQ7986Yfvhoeo+x?=
 =?us-ascii?Q?hOvr5J+FzgpQKqgPZFv7ZnCj59QVZ044BnrcGSWrD4Fu8poJQkILRbU67ql6?=
 =?us-ascii?Q?yUl9vq3U1W4FvjpnBMRqS+i8c22m7U9ojs1WTVMrq/naKX5OiNC7VkW+eQRU?=
 =?us-ascii?Q?EG5y5ReJbHheK5bTSCcEpRgAyYW4mgqHT9gPMvvEouL05Qu3fDWHPM0xSvAk?=
 =?us-ascii?Q?8kaswy1SG+LnQUJdazfclheXfvR2Ho4/b0LalQrwDAcPSfhy2LAaA8/37wXA?=
 =?us-ascii?Q?uPjJxuK3rg6ULdwzTMDmSrLMQrMktS5n8y/mglg7BC8dXsInCCyTpX4zh6pY?=
 =?us-ascii?Q?Z4AE2Bz02HDbN1xEMW4wA6ig6a970AV4srllOpP0cruBCvlJVJxGeUwQ2NDR?=
 =?us-ascii?Q?KZNV4MTKoOnsvgmLTVgOV70HvJ0LhvwttfULFfqHFnWlly6oFqBSm0jan0HE?=
 =?us-ascii?Q?udVFfet+rXzcL0XPxfzNUh1A0bDNA+l8IPm9leMFPH/BLEh9FSxwHKpGwfST?=
 =?us-ascii?Q?VqsnM/8Y33o7I1eSlXf5OvvkUgMaMSUhjaNRaexIvqTtzPoKy5BxUwvXWpVJ?=
 =?us-ascii?Q?C+pwhcowYmaYL5A5TY/qLfC4TmMw8MhZYiZ2ahOmoa5tsARqE7hNcnJTi06T?=
 =?us-ascii?Q?cxCqUYd562uWWRA7sBLG8tUElrPiJ1Nk50rddXBVrlJLtd4zY4EgnjjmewFD?=
 =?us-ascii?Q?eH0qReTvgk3PFWZjHgttTSESCjZfRaXuXB7gBVAjysShGXq9LjBhC2C74Gw8?=
 =?us-ascii?Q?ZGrGs6T7793BXK3NqK/J9hg=3D?=
X-OriginatorOrg: os.amperecomputing.com
X-MS-Exchange-CrossTenant-Network-Message-Id: a0108a2c-cfc2-4ad8-a3e9-08dc0e35f00d
X-MS-Exchange-CrossTenant-AuthSource: PH0PR01MB8166.prod.exchangelabs.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Jan 2024 21:33:20.4869
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: jhPfDlc4Wb7z3c7ye/49lhiSXNUYpUV1LfPAVQUVwfOp7vsn9BzyEPBi9p3wlrqLSQxfBtMfzJeR8STX0w4J5h1RMUAV66J49adFnG5lSGfAqhzX0TfpcyiBHSDXzUDr
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO1PR01MB6598

Due to erratum AC03_CPU_36 on AmpereOne, if an Asynchronous Exception
(interrupts or SErrors) occurs to EL2, while EL2 software is modifying
system register bits that control EL2 exception behavior, the processor
may take an exception to an incorrect Exception Level.

The affected system registers are HCR_EL2 and SCTLR_EL2, which contain
control bits for routing and enabling of EL2 exceptions.

The issue is triggered when HGE.TGE bit is cleared while having
AMO/IMO/FMO bits cleared too. To avoid the exception getting taken
at a wrong Exception Level, we set AMO/IMO/FMO.

Suggested-by: D Scott Phillips <scott@os.amperecomputing.com>
Signed-off-by: Ilkka Koskinen <ilkka@os.amperecomputing.com>
---
 arch/arm64/kvm/hyp/vhe/tlb.c | 12 +++++++++---
 1 file changed, 9 insertions(+), 3 deletions(-)

diff --git a/arch/arm64/kvm/hyp/vhe/tlb.c b/arch/arm64/kvm/hyp/vhe/tlb.c
index b32e2940df7d..c72fdd2e4549 100644
--- a/arch/arm64/kvm/hyp/vhe/tlb.c
+++ b/arch/arm64/kvm/hyp/vhe/tlb.c
@@ -61,9 +61,15 @@ static void __tlb_switch_to_guest(struct kvm_s2_mmu *mmu,
 	 * has an ISB in order to deal with this.
 	 */
 	__load_stage2(mmu, mmu->arch);
-	val = read_sysreg(hcr_el2);
-	val &= ~HCR_TGE;
-	write_sysreg(val, hcr_el2);
+
+	/*
+	 * With {E2H,TGE} == {1,0}, IMO == 1 is required so that IRQs are not
+	 * all masked. This also works around AmpereOne erratum AC03_CPU_36
+	 * which can incorrectly route an IRQ to EL1 when HCR_EL2.{E2H,TGE} is
+	 * written from {1,1} to {1,0} with interrupts unmasked.
+	 */
+	sysreg_clear_set(hcr_el2, HCR_TGE, HCR_AMO | HCR_IMO | HCR_FMO);
+
 	isb();
 }
 
-- 
2.43.0