Received: by 2002:a25:1985:0:0:0:0:0 with SMTP id 127csp1444132ybz; Thu, 16 Apr 2020 09:15:33 -0700 (PDT) X-Google-Smtp-Source: APiQypJVWhdfN/IOlpo+KGDVNPs1GHFPh7nnhMvmPKjDAFWDEn0nJWflxsY+47IvhvhENfW6MUon X-Received: by 2002:a17:906:3004:: with SMTP id 4mr10211880ejz.256.1587053733482; Thu, 16 Apr 2020 09:15:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1587053733; cv=none; d=google.com; s=arc-20160816; b=n1lnt4sQKXyWVBR2KCye8pQPbPrWt+2T2qAJ7VTZd3+8h0R69yEjEFWlNPKfpIHpzm +L/I3nQMClFN/tmI4QUx+kQdyFK9Oo6aoYdSzdDphJg5khfJEpjL1rTKU43riOYRA9LP IB3P/UaEM9J/x4+gUTuXDj1HwpcHpWZq8cCZJswjaEqsOudvW/zTcqrimbIyToufPnoN 1V/M1POsUCiGWzc5GbzIcJr55a3fba+CrY4SSP/rd/eCJS1cwBuokuf5pCdEnG3046+p 2cNpnKB+Fgi+1FXm7M/pu1CLDahzjqkkgBjZ2pZqgKs7jXpiJym31Rgjhb+9gK+K1FJ9 ahFw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:from:subject:references :mime-version:message-id:in-reply-to:date:dkim-signature; bh=ir6AMcU/LNJfVmH7TAbfuSTmLjnaQbzCZFrLbu9sicg=; b=iXHSpmX1YNWjsVdCRsDacAbOCEIZewlCTi5xnkuQ7EaUbGeCFJSn8ArkaoLOcHyTkf iqXfGngNefJEUbaoywDlDilZbCESRaI/h9wjFAGD0V6aenbiha/cqMj/HEzwK0gmrylL az8/xgjAxcc/H/mInMj5iSxYNyme1vWWTMybdb/pSW1wIwxNxmPDaaAN92QTZd43sHoW hxG5b6orkCCjdiCBJALChwc3t5Mmp1jeCeh4nL6hnb1pGBgqJqp1hQy8kPnCuCACYYy6 /Rzup1YgXBiXuB3o9TZgTL+hPuHdd8yWsi7fzBGfIyVD6D+XW5KZKtt+5f+XoEk997RH Nrsw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=PfLQtJvA; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id y22si4099656edo.236.2020.04.16.09.15.07; Thu, 16 Apr 2020 09:15:33 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=PfLQtJvA; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2506893AbgDPQNP (ORCPT + 99 others); Thu, 16 Apr 2020 12:13:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:53336 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-FAIL-OK-FAIL) by vger.kernel.org with ESMTP id S2506867AbgDPQNI (ORCPT ); Thu, 16 Apr 2020 12:13:08 -0400 Received: from mail-pf1-x449.google.com (mail-pf1-x449.google.com [IPv6:2607:f8b0:4864:20::449]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 15881C0610D5 for ; Thu, 16 Apr 2020 09:13:07 -0700 (PDT) Received: by mail-pf1-x449.google.com with SMTP id f11so3464413pfq.2 for ; Thu, 16 Apr 2020 09:13:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:in-reply-to:message-id:mime-version:references:subject:from:to :cc; bh=ir6AMcU/LNJfVmH7TAbfuSTmLjnaQbzCZFrLbu9sicg=; b=PfLQtJvAzz5yI91olwSgmzdmwgdtJxdSpUwDBUqAfM/Qj4X8PTnr8pe6M1E9q+SxMQ 9DuGyRyHutXrki59bdmwIERRsNZo12qtXtT7YTGaQUvErlBRD5mI0A9o3BWgwYogesFw pJQazMuF7VSg8nXXNbbuwnalk1A8GI2siOE+gzAVLDi5SEfj4qBjBhPGSFAFigx0XT27 2J6qu4mUgNZPuqq+yi7V5b3R7FRrHRFEL+uzZRZfJJCkuZ3Y9YcoQ6IkCgna/0CQ22Jg qGjnRtJiwEZAIC0v5v+CcPVf8e5pwqpO5XgzgToKbUlUPQ54YIcNjAxSzrtDUK8hBIAD 0GIQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=ir6AMcU/LNJfVmH7TAbfuSTmLjnaQbzCZFrLbu9sicg=; b=rrCgakQJHmi0M4Ukg260Wxa7cL8Ae+7/W1PJSvTQkPvUH0kvQCnBBp+3PelBVrKh7y PLXZeidJEGJ60CXIoCjjSBm0ER4Wrmo4eraO1X8iWLSLlW44ihHJnkJ7gpzKQpXV1EXj TobHANAEmzk0scIfk2SnMG5U1tmLK9lOi7DZOuFJJEzefV0D34FGJtmd2CyW+2XAVfWR mcXoJCPQVTc5CtHlFzPa/DwQdxiKZXoE/3vqQx7yQgKU04fleWYCC0TLCRVwHiqcFnw6 8av0xCbHojPJ8tq1HIYoyPnleAj2OnWJePol5u+T+OedfkSxiGch75ovg1bs4K48Me33 0qFw== X-Gm-Message-State: AGi0PuYm7AO7HuBP9n/dTxFM1Kfj8XkWLyypkNP9BpUMlN4udhVY0ggI OQjXVLCkRdlNoHPoDY5kiiKPuvpeaS3WbHxobO8= X-Received: by 2002:a17:90a:cc10:: with SMTP id b16mr5944791pju.29.1587053586616; Thu, 16 Apr 2020 09:13:06 -0700 (PDT) Date: Thu, 16 Apr 2020 09:12:40 -0700 In-Reply-To: <20200416161245.148813-1-samitolvanen@google.com> Message-Id: <20200416161245.148813-8-samitolvanen@google.com> Mime-Version: 1.0 References: <20191018161033.261971-1-samitolvanen@google.com> <20200416161245.148813-1-samitolvanen@google.com> X-Mailer: git-send-email 2.26.1.301.g55bc3eb7cb9-goog Subject: [PATCH v11 07/12] arm64: efi: restore x18 if it was corrupted From: Sami Tolvanen To: Will Deacon , Catalin Marinas , James Morse , Steven Rostedt , Ard Biesheuvel , Mark Rutland , Masahiro Yamada , Michal Marek , Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot Cc: Dave Martin , Kees Cook , Laura Abbott , Marc Zyngier , Masami Hiramatsu , Nick Desaulniers , Jann Horn , Miguel Ojeda , clang-built-linux@googlegroups.com, kernel-hardening@lists.openwall.com, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, Sami Tolvanen Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org If we detect a corrupted x18, restore the register before jumping back to potentially SCS instrumented code. This is safe, because the wrapper is called with preemption disabled and a separate shadow stack is used for interrupt handling. Signed-off-by: Sami Tolvanen Reviewed-by: Kees Cook Acked-by: Will Deacon --- arch/arm64/kernel/efi-rt-wrapper.S | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/arch/arm64/kernel/efi-rt-wrapper.S b/arch/arm64/kernel/efi-rt-wrapper.S index 3fc71106cb2b..6ca6c0dc11a1 100644 --- a/arch/arm64/kernel/efi-rt-wrapper.S +++ b/arch/arm64/kernel/efi-rt-wrapper.S @@ -34,5 +34,14 @@ ENTRY(__efi_rt_asm_wrapper) ldp x29, x30, [sp], #32 b.ne 0f ret -0: b efi_handle_corrupted_x18 // tail call +0: + /* + * With CONFIG_SHADOW_CALL_STACK, the kernel uses x18 to store a + * shadow stack pointer, which we need to restore before returning to + * potentially instrumented code. This is safe because the wrapper is + * called with preemption disabled and a separate shadow stack is used + * for interrupts. + */ + mov x18, x2 + b efi_handle_corrupted_x18 // tail call ENDPROC(__efi_rt_asm_wrapper) -- 2.26.1.301.g55bc3eb7cb9-goog