Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp3048237ybz; Mon, 27 Apr 2020 09:05:04 -0700 (PDT) X-Google-Smtp-Source: APiQypJDCv1ibhnIjkzOGw99cXPVEkHxAKl3ZxUlHK9kmWenuFd9kJyF3cZTAVYxXZPJB+231MVI X-Received: by 2002:a5d:5224:: with SMTP id i4mr27996771wra.1.1588003504215; Mon, 27 Apr 2020 09:05:04 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1588003504; cv=none; d=google.com; s=arc-20160816; b=SMeaCKfaITf03N6GNW+tpi2iqgbaOlt/L/Z4Npm7myATDgf3E3YFmNvdDyGiRM8fr8 2gmf7I3ClxsEqNmkyoJvUffb1o5QQNDAY3yPote68oAwUm6W4JVQeZ8KfY9qkbzD7Cae UhmpNZnlyYI88bawKcnOQsAhTgaRBah04PVmcihzVDnZDBcuJclYZ7ko9QD+MNbwjoPS GiZPTGjuDfJKnyL457hwgKMylPVuYWf9uLVs1DLIAaAVgg7giDtWIv6R20uPlMl8BK0i dYVooHsWhCcTiPOXDATL4q7LBCGoCjeYkGZTFiWNsvckFvg5oPryQwm0cYlOlOtkkkO7 jEmg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:from:subject:references :mime-version:message-id:in-reply-to:date:dkim-signature; bh=5K2KfWGbdPDvciUxJWKmXs8jymeyhVJTI52mBn5Jn2U=; b=jcBp2gw6HaRDhV7i5lJjQQPaCUYeQhFSXzpw1ITAC9nBZQqlxfFvOsruHW1HKC+r0s u+1XHPZTb5bTJaPEULhtfEpYFeDcRq6OC85FfNGI2R0q/wlIZFXF1AogAc+A/hisclnQ i1rvKXgLWweYTatxoOB6XIJ8du6dnwCMNrSVOSYJK0fTRBSxjoIFiHLhd7OtZNAt7XZS nZN9bCUnSuczwepRtGgQ/OR44BlI5ue+ePfBLZ/3DaWuTF8NfEIIlbhNJrqZ0UcCw/uD xrjjbRGSCSKUObn/YHZMgsiLkcvlE0xuNRccSzNBbf9xkTtiO350vbeW8Wqs7FfqXH69 SRGQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=Z0D9RdpH; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id x24si10139edr.432.2020.04.27.09.04.39; Mon, 27 Apr 2020 09:05:04 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=Z0D9RdpH; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728585AbgD0QAu (ORCPT + 99 others); Mon, 27 Apr 2020 12:00:50 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48504 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S1728517AbgD0QAt (ORCPT ); Mon, 27 Apr 2020 12:00:49 -0400 Received: from mail-qv1-xf4a.google.com (mail-qv1-xf4a.google.com [IPv6:2607:f8b0:4864:20::f4a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 023E2C0610D5 for ; Mon, 27 Apr 2020 09:00:49 -0700 (PDT) Received: by mail-qv1-xf4a.google.com with SMTP id j92so11058202qva.15 for ; Mon, 27 Apr 2020 09:00:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:in-reply-to:message-id:mime-version:references:subject:from:to :cc; bh=5K2KfWGbdPDvciUxJWKmXs8jymeyhVJTI52mBn5Jn2U=; b=Z0D9RdpHbbOHHtNvqHRo52aZbZAj07cdZRmpWEeU3iQTueml5HmYOfEBcmC2kKVIKm gi/I42ma62LvSvGNYMm2NpEhpa6fsNrdLgOepXOs2lXtqi4B13V7mob+8FE88DmkGTAj cIfoOAEzDwtio1vu3/bEbEwVj3iXpD61m74J35yn1WLDpR++aGJg9GG9gk87kfObQfaq 2Fr6/vhs+4bP5L3TBzKyaTEUUQB4mwZj8HZ3pjL3rr671/M4/cAQ1XkhNhG0tTSV5H0Y Lghd93Heuw59N+AcYzl5+VmFD+sORBxuAIoCgApPPsaEMCghNZl1+DyNOu8XOZdSuzS/ tqpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=5K2KfWGbdPDvciUxJWKmXs8jymeyhVJTI52mBn5Jn2U=; b=jG6XT2sHoRVAfGKGhbkbAYnd28Li7pxUfAgPfemVPF/EdBf9YnhY3VE5ai39WwzpNp qXGndfWpSHAQV+YTXhLNvL6Ul4t3EDpQTSR6K452282pyBrL2R5GSFq20i8aLD1OdkZ4 8t1ADe05txaVIiEVbtBfwj6dIOnswpPGdKkHROnX3314H/BidUj0xiB8kkpjbvDkqK1n JufjTQPoumDmcOhhCyGWWbj1MsY8/eSySZdCnTwx7lHqOOHpQho0dLU/o8g4yOL5sqys jQaUWBtoBW7SyK9nLPNbedI/ZzVnv3fb1DLDgo9k5NY+T2M9gkBBVi5gxew/wKAgZb06 CDAA== X-Gm-Message-State: AGi0PuaCm5SUMpIYKO2Vyf0QpzVKCrgjZeUMWt1gSSR3uE71cnSstPtB zfKz1IwPkk17X0//gsc2ob8F/sDTlwcbSTM9h/w= X-Received: by 2002:a0c:bec4:: with SMTP id f4mr23363061qvj.26.1588003248063; Mon, 27 Apr 2020 09:00:48 -0700 (PDT) Date: Mon, 27 Apr 2020 09:00:13 -0700 In-Reply-To: <20200427160018.243569-1-samitolvanen@google.com> Message-Id: <20200427160018.243569-8-samitolvanen@google.com> Mime-Version: 1.0 References: <20191018161033.261971-1-samitolvanen@google.com> <20200427160018.243569-1-samitolvanen@google.com> X-Mailer: git-send-email 2.26.2.303.gf8c07b1a785-goog Subject: [PATCH v13 07/12] arm64: efi: restore x18 if it was corrupted From: Sami Tolvanen To: Will Deacon , Catalin Marinas , James Morse , Steven Rostedt , Ard Biesheuvel , Mark Rutland , Masahiro Yamada , Michal Marek , Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot Cc: Dave Martin , Kees Cook , Laura Abbott , Marc Zyngier , Masami Hiramatsu , Nick Desaulniers , Jann Horn , Miguel Ojeda , clang-built-linux@googlegroups.com, kernel-hardening@lists.openwall.com, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, Sami Tolvanen Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org If we detect a corrupted x18, restore the register before jumping back to potentially SCS instrumented code. This is safe, because the wrapper is called with preemption disabled and a separate shadow stack is used for interrupt handling. Signed-off-by: Sami Tolvanen Reviewed-by: Kees Cook Acked-by: Will Deacon --- arch/arm64/kernel/efi-rt-wrapper.S | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/arch/arm64/kernel/efi-rt-wrapper.S b/arch/arm64/kernel/efi-rt-wrapper.S index 3fc71106cb2b..6ca6c0dc11a1 100644 --- a/arch/arm64/kernel/efi-rt-wrapper.S +++ b/arch/arm64/kernel/efi-rt-wrapper.S @@ -34,5 +34,14 @@ ENTRY(__efi_rt_asm_wrapper) ldp x29, x30, [sp], #32 b.ne 0f ret -0: b efi_handle_corrupted_x18 // tail call +0: + /* + * With CONFIG_SHADOW_CALL_STACK, the kernel uses x18 to store a + * shadow stack pointer, which we need to restore before returning to + * potentially instrumented code. This is safe because the wrapper is + * called with preemption disabled and a separate shadow stack is used + * for interrupts. + */ + mov x18, x2 + b efi_handle_corrupted_x18 // tail call ENDPROC(__efi_rt_asm_wrapper) -- 2.26.2.303.gf8c07b1a785-goog