Received: by 2002:a05:6a10:9848:0:0:0:0 with SMTP id x8csp732837pxf; Thu, 8 Apr 2021 11:30:44 -0700 (PDT) X-Google-Smtp-Source: ABdhPJxXlsm5h+GVJgIcJRJFdjjv5UFSkeym5p+4IuIFui24gsfkopqikhof7zlyrwWLhzrAH+vT X-Received: by 2002:a17:90a:9f48:: with SMTP id q8mr9912823pjv.53.1617906643975; Thu, 08 Apr 2021 11:30:43 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1617906643; cv=none; d=google.com; s=arc-20160816; b=eBFNWal6NTOgd7PWeak7Re64YTdkNsocQxS/GADWBmczTdeRQ7qycuo2wdmcmeR3pP 8cLt/q4P0I7eGW+QcpKo+Bb2lmDCShN/lLYR8OJ1bnzWsTEA0sF67xLQuOtVF6NaYAV8 +O5LwJKM3AJl2VR5mrgL144QiT1oRSEHI5JjHRa9Qs3JMk9MNPqWFR2dSk1BBQiIQthF gKp2VZMW0HSsrVJZ1i8inZhPEW/GsVgtWT619EBk5C3CaL84Ngwky8XVJkOx2kD1G4Wk t4EuPejfWOMToSLfXe1kve3dSTB9mC+UvFkxrxmD8qn86uRyEndZGTDXsFT8GO8iuEqc jKaA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:from:subject:references:mime-version :message-id:in-reply-to:date:dkim-signature; bh=sqe+SRM2tt54QgMNprHB5Ltl/JmQ4l0M9EfeayUX7cA=; b=BsV3EjMBU0S1LJJ/y5Rf0SdSENZ1QYX6bxHA0dHuPZsHecEQJ13y72+3HNpAAUGfku p4Iq9ETniqoRvfpgezGQoB8UPXzA5eA20RnOkTxGfF9FMXEOXhlGt/obVas0LkZb69l3 dkwXOtn+QSeL2DDRlaZW0620gPflq6vjOE/fIXqwFOk3pkOv2vi/ps3F5TTGwvBmsLx2 49ND88FnsYwM1+b9WGpDm5j3U04J7eV7J62stRUZvLwrN5msUqiVyHuLxaUNiGrQErTe tmyi6kQvtuW+GXm3BYzgJ1pS276VVOIV+Khes6/ThqrjQiDVxBpI5RFxwtSVI1IhUH6N lLaQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=prCsiu3t; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id y1si15226pgl.294.2021.04.08.11.30.29; Thu, 08 Apr 2021 11:30:43 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=prCsiu3t; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232859AbhDHS3S (ORCPT + 99 others); Thu, 8 Apr 2021 14:29:18 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48672 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232870AbhDHS3F (ORCPT ); Thu, 8 Apr 2021 14:29:05 -0400 Received: from mail-yb1-xb49.google.com (mail-yb1-xb49.google.com [IPv6:2607:f8b0:4864:20::b49]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 3EDE5C0613D8 for ; Thu, 8 Apr 2021 11:28:52 -0700 (PDT) Received: by mail-yb1-xb49.google.com with SMTP id i6so2882910ybk.2 for ; Thu, 08 Apr 2021 11:28:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=date:in-reply-to:message-id:mime-version:references:subject:from:to :cc; bh=sqe+SRM2tt54QgMNprHB5Ltl/JmQ4l0M9EfeayUX7cA=; b=prCsiu3tjKJFc4pP0/+ujOO/HtNJYS943pILJiCXrDbIUQY4DwftcDzmjbqU8Znqzs ReSZn865iFbsu11kWjfPBjM/AAiEJpAQQHUMwHxVVAeHXhQN1OHlhomroaYK7Vaim+wi us6bUks8K563fMiSGiRf7cDSFVVRsSPVT9Kp3Y6HKLvXNYAASpNp0uCsZPUmsVI2RO78 7etrNqjlHs2AhheD8vpQrc/1+H0Q9t7QljuufEgx8rL0gFyVyX8i17OaiFy0DvugM8k8 kC3kVB6YoMV5Pfl80tgCca3MJ2B4VTCYyxzgyxEgHMcv4rScjHAd8A0N7P1fnaJc+bQt ykzg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=sqe+SRM2tt54QgMNprHB5Ltl/JmQ4l0M9EfeayUX7cA=; b=U8f1KulAu5elSx39OpLcM6ub8UEAfslfeGdUn9tafu3XqLorSDQj8oPcFt3B0H7vQK 3KgXaiILQPd5N6ivex30n+9kAg2F0gn1v514MqTrgO/TDTGq+XtQZ8zGSy02CjTtm7Rx WDO5IfT7Q1bAfbIgRNSWTjI7Prl78FWlmTkFljMbUrwWnfUECCAwILXViSXVDKlm8O3b INyaQZH0aI6GxLN0w3jHBEK7bg1DXxFwFaSr0QkjiSTPkxIvn5fd9uJfWEv6YkuVkH8c y1tsf2bQWkmJdNI8drTa0sJp6e+QzizOlG431lulS4wL/rRT82VxhtgtRIBPFse1I8OX q6Ng== X-Gm-Message-State: AOAM531915ftmT9rCuceVfP/esWxITdDchJEdyjRa65AX/E41toDJe6+ FX9BUvYWxwDZAnoRlkRvurZHmAdwsSkt80UekjE= X-Received: from samitolvanen1.mtv.corp.google.com ([2620:15c:201:2:3560:8505:40a2:e021]) (user=samitolvanen job=sendgmr) by 2002:a25:ae03:: with SMTP id a3mr14172639ybj.118.1617906531475; Thu, 08 Apr 2021 11:28:51 -0700 (PDT) Date: Thu, 8 Apr 2021 11:28:28 -0700 In-Reply-To: <20210408182843.1754385-1-samitolvanen@google.com> Message-Id: <20210408182843.1754385-4-samitolvanen@google.com> Mime-Version: 1.0 References: <20210408182843.1754385-1-samitolvanen@google.com> X-Mailer: git-send-email 2.31.1.295.g9ea45b61b8-goog Subject: [PATCH v6 03/18] mm: add generic function_nocfi macro From: Sami Tolvanen To: Kees Cook Cc: Nathan Chancellor , Nick Desaulniers , Masahiro Yamada , Will Deacon , Jessica Yu , Arnd Bergmann , Tejun Heo , "Paul E. McKenney" , Christoph Hellwig , Peter Zijlstra , Sedat Dilek , Mark Rutland , Catalin Marinas , bpf@vger.kernel.org, linux-hardening@vger.kernel.org, linux-arch@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kbuild@vger.kernel.org, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, clang-built-linux@googlegroups.com, Sami Tolvanen Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org With CONFIG_CFI_CLANG, the compiler replaces function addresses in instrumented C code with jump table addresses. This means that __pa_symbol(function) returns the physical address of the jump table entry instead of the actual function, which may not work as the jump table code will immediately jump to a virtual address that may not be mapped. To avoid this address space confusion, this change adds a generic definition for function_nocfi(), which architectures that support CFI can override. The typical implementation of would use inline assembly to take the function address, which avoids compiler instrumentation. Signed-off-by: Sami Tolvanen Reviewed-by: Kees Cook Acked-by: Mark Rutland Tested-by: Nathan Chancellor --- include/linux/mm.h | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/include/linux/mm.h b/include/linux/mm.h index 8ba434287387..22cce9c7dd05 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -124,6 +124,16 @@ extern int mmap_rnd_compat_bits __read_mostly; #define lm_alias(x) __va(__pa_symbol(x)) #endif +/* + * With CONFIG_CFI_CLANG, the compiler replaces function addresses in + * instrumented C code with jump table addresses. Architectures that + * support CFI can define this macro to return the actual function address + * when needed. + */ +#ifndef function_nocfi +#define function_nocfi(x) (x) +#endif + /* * To prevent common memory management code establishing * a zero page mapping on a read fault. -- 2.31.1.295.g9ea45b61b8-goog