Received: by 2002:a05:6a10:22f:0:0:0:0 with SMTP id 15csp676291pxk; Thu, 24 Sep 2020 15:53:53 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz6MIKbMFuHgvpauXJjHVI0VmAFTTn6RN6cx1gNvIg0UCTzlMdSfzdxBLJTiJUG2VDOQJUT X-Received: by 2002:a17:906:841a:: with SMTP id n26mr848591ejx.213.1600988033653; Thu, 24 Sep 2020 15:53:53 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1600988033; cv=none; d=google.com; s=arc-20160816; b=TVSfyDOxthrroGCi28bRp3JKjrLOjEMTlzlW3NMiHuZiuozJCkEcN9wJWcN20HOadZ HlOIQTrXAB/faOpODAWrvGLdjGFgqm7yXphtjdGjRkqeYfQGkfKjjwF7fLCoKONEdKbG 6Dg/mCp4gYG8tvdZ332eanCSo8Rv4B8/Bkm8ups0iRzVCtRTBfn0JkWVq2HDd34U/iH1 zeE/nC5BZo++BTw0oicXuWTBuO0jVBbrf9OPaA8NilaAwW5yZcpDC0tvzq2pzgr5XiWb cj/XXyn8GNUQpN3LZB7nVugANzGpbYO3fxH1oMl4QhUqbuKQiJRN1YLhzvnpJnaWnXBB apnA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:from:subject:references:mime-version :message-id:in-reply-to:date:sender:dkim-signature; bh=/ayGZYJKDcGk7zFWFRfetLIXrgdYrCw7jhhhvhwkhIs=; b=iVfw7LEAAUSU6smtHkbyJvYhiDDAtoYYu3OkM18bLc0+2YeCOz/Anon4MQvuLdppPV uj0Tln29k4e1nUW3XyaSUokFRtzWFVylnnV8Xeel5VDyhe2idgS0T1r8qmDT1BxFQLdq jNwWeHkjCmKa+VoMbecRMMPVSDmA6LZVAuAgfemrmXlL8zQVUIY7noYkBW5EKAvqo/rB uvKUWtfxXffA1QZCl/9no5DrNLAIgqGVKyo2aaV3oAbcRs84+y/Kt6iUjKLKVLPYCCPd RaD9W87qGRUAeBXvUlquzDnzNJfh+PUikAKF31iTV6f795xqoBHhnJcS01S/oQ71J5wH U9gg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=LE0TJrR9; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id b21si560114edx.329.2020.09.24.15.53.30; Thu, 24 Sep 2020 15:53:53 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=LE0TJrR9; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726984AbgIXWv4 (ORCPT + 99 others); Thu, 24 Sep 2020 18:51:56 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50650 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726925AbgIXWvq (ORCPT ); Thu, 24 Sep 2020 18:51:46 -0400 Received: from mail-qt1-x84a.google.com (mail-qt1-x84a.google.com [IPv6:2607:f8b0:4864:20::84a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CED4AC0613D6 for ; Thu, 24 Sep 2020 15:51:45 -0700 (PDT) Received: by mail-qt1-x84a.google.com with SMTP id g10so533025qto.1 for ; Thu, 24 Sep 2020 15:51:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=sender:date:in-reply-to:message-id:mime-version:references:subject :from:to:cc; bh=/ayGZYJKDcGk7zFWFRfetLIXrgdYrCw7jhhhvhwkhIs=; b=LE0TJrR9mtBDfzSDd0Lwk+HdkS+mpzPaBLp+3wvfuhEmdBFl9Oj0X8UzhcEBbQvxsC LQryv6m/Xz8Tr2GZrKKUD1YL2ZkpK5cMTdLkbf1+S6LQXrM9YTDBbSU3o2RVpYR+gQ53 D+tDYy9j5cb6tI/FXcqNJAY+e2P44xEq28z4Zx/N2cRjWDsbAFFjAaIDz6h2C+sQxnt+ RLlRluVj135V+YeOIVQUYHTOvktG+AvuvHeV8AWZJ+nCGXz9orcqkSCvJspJVLpBrW/2 1FTipuqshA+DbrDESvFBSUEeE/bL+8idQnxuONWFbf3L6d592rJpIfrmGKzrey5IiMA+ wc5Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:in-reply-to:message-id:mime-version :references:subject:from:to:cc; bh=/ayGZYJKDcGk7zFWFRfetLIXrgdYrCw7jhhhvhwkhIs=; b=imTS37muu7a1dpl8gfQWnZcEX2nWT+10kBOpqAecq62YI/x4HsZnDnL9nwpLw2U/U+ rxlrwRK6e1D+wAXvwRVFy5yA1LyTxYFPl3Who3jbwoUkr5DyeUUoAJkscOZYhvAlx1rX HSYSIlYvArdQe2nmT2EuDbMs+tDGhTi3PnrkrQFRh8fW3Cy/NHeakrBIDNGPBM2g0X/w aKwndjTlVHyQTyMHqmPMVu7mWVaYhgyFiFlnZJshLCWKkmO3DlCMxbKWXqwzpIb3QVpI niTxWO6djuOlC8cJMCN5VyZEtE0FFK33sfcwTCDwX1XivNVaA2GnTfUD+RjNOwcwTIB/ FRPw== X-Gm-Message-State: AOAM533nm/e89JAG5s0mLNRKJ/UryFrXG/yEzJOJz3Vwp9PoxoMiqBle Cr9SJ5k0zgSYc0gLKT+mj4n7Eet8278/e+fT Sender: "andreyknvl via sendgmr" X-Received: from andreyknvl3.muc.corp.google.com ([2a00:79e0:15:13:7220:84ff:fe09:7e9d]) (user=andreyknvl job=sendgmr) by 2002:ad4:47cc:: with SMTP id p12mr1635316qvw.22.1600987904911; Thu, 24 Sep 2020 15:51:44 -0700 (PDT) Date: Fri, 25 Sep 2020 00:50:29 +0200 In-Reply-To: Message-Id: <76937ee6e88d0d1fc98003e503f31fe7b14a6a52.1600987622.git.andreyknvl@google.com> Mime-Version: 1.0 References: X-Mailer: git-send-email 2.28.0.681.g6f77f65b4e-goog Subject: [PATCH v3 22/39] kasan: introduce CONFIG_KASAN_HW_TAGS From: Andrey Konovalov To: Dmitry Vyukov , Vincenzo Frascino , Catalin Marinas , kasan-dev@googlegroups.com Cc: Andrey Ryabinin , Alexander Potapenko , Marco Elver , Evgenii Stepanov , Elena Petrova , Branislav Rankov , Kevin Brodsky , Will Deacon , Andrew Morton , linux-arm-kernel@lists.infradead.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, Andrey Konovalov Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This patch adds a configuration option for a new KASAN mode called hardware tag-based KASAN. This mode uses the memory tagging approach like the software tag-based mode, but relies on arm64 Memory Tagging Extension feature for tag management and access checking. Signed-off-by: Andrey Konovalov Signed-off-by: Vincenzo Frascino --- Change-Id: I246c2def9fffa6563278db1bddfbe742ca7bdefe --- lib/Kconfig.kasan | 59 ++++++++++++++++++++++++++++++++--------------- 1 file changed, 41 insertions(+), 18 deletions(-) diff --git a/lib/Kconfig.kasan b/lib/Kconfig.kasan index b4cf6c519d71..516d3a24f7d7 100644 --- a/lib/Kconfig.kasan +++ b/lib/Kconfig.kasan @@ -6,7 +6,10 @@ config HAVE_ARCH_KASAN config HAVE_ARCH_KASAN_SW_TAGS bool -config HAVE_ARCH_KASAN_VMALLOC +config HAVE_ARCH_KASAN_HW_TAGS + bool + +config HAVE_ARCH_KASAN_VMALLOC bool config CC_HAS_KASAN_GENERIC @@ -20,11 +23,11 @@ config CC_HAS_WORKING_NOSANITIZE_ADDRESS menuconfig KASAN bool "KASAN: runtime memory debugger" - depends on (HAVE_ARCH_KASAN && CC_HAS_KASAN_GENERIC) || \ - (HAVE_ARCH_KASAN_SW_TAGS && CC_HAS_KASAN_SW_TAGS) + depends on (((HAVE_ARCH_KASAN && CC_HAS_KASAN_GENERIC) || \ + (HAVE_ARCH_KASAN_SW_TAGS && CC_HAS_KASAN_SW_TAGS)) && \ + CC_HAS_WORKING_NOSANITIZE_ADDRESS) || \ + HAVE_ARCH_KASAN_HW_TAGS depends on (SLUB && SYSFS) || (SLAB && !DEBUG_SLAB) - depends on CC_HAS_WORKING_NOSANITIZE_ADDRESS - select SLUB_DEBUG if SLUB select CONSTRUCTORS select STACKDEPOT help @@ -38,17 +41,23 @@ choice prompt "KASAN mode" default KASAN_GENERIC help - KASAN has two modes: generic KASAN (similar to userspace ASan, - x86_64/arm64/xtensa, enabled with CONFIG_KASAN_GENERIC) and - software tag-based KASAN (a version based on software memory - tagging, arm64 only, similar to userspace HWASan, enabled with - CONFIG_KASAN_SW_TAGS). + KASAN has three modes: + 1. generic KASAN (similar to userspace ASan, + x86_64/arm64/xtensa, enabled with CONFIG_KASAN_GENERIC), + 2. software tag-based KASAN (arm64 only, based on software + memory tagging (similar to userspace HWASan), enabled with + CONFIG_KASAN_SW_TAGS), and + 3. hardware tag-based KASAN (arm64 only, based on hardware + memory tagging, enabled with CONFIG_KASAN_HW_TAGS). + + All KASAN modes are strictly debugging features. - Both generic and tag-based KASAN are strictly debugging features. + For better error reports enable CONFIG_STACKTRACE. config KASAN_GENERIC bool "Generic mode" depends on HAVE_ARCH_KASAN && CC_HAS_KASAN_GENERIC + select SLUB_DEBUG if SLUB help Enables generic KASAN mode. @@ -61,20 +70,21 @@ config KASAN_GENERIC and introduces an overhead of ~x1.5 for the rest of the allocations. The performance slowdown is ~x3. - For better error detection enable CONFIG_STACKTRACE. - Currently CONFIG_KASAN_GENERIC doesn't work with CONFIG_DEBUG_SLAB (the resulting kernel does not boot). config KASAN_SW_TAGS bool "Software tag-based mode" depends on HAVE_ARCH_KASAN_SW_TAGS && CC_HAS_KASAN_SW_TAGS + select SLUB_DEBUG if SLUB help Enables software tag-based KASAN mode. - This mode requires Top Byte Ignore support by the CPU and therefore - is only supported for arm64. This mode requires Clang version 7.0.0 - or later. + This mode require software memory tagging support in the form of + HWASan-like compiler instrumentation. + + Currently this mode is only implemented for arm64 CPUs and relies on + Top Byte Ignore. This mode requires Clang version 7.0.0 or later. This mode consumes about 1/16th of available memory at kernel start and introduces an overhead of ~20% for the rest of the allocations. @@ -82,15 +92,27 @@ config KASAN_SW_TAGS casting and comparison, as it embeds tags into the top byte of each pointer. - For better error detection enable CONFIG_STACKTRACE. - Currently CONFIG_KASAN_SW_TAGS doesn't work with CONFIG_DEBUG_SLAB (the resulting kernel does not boot). +config KASAN_HW_TAGS + bool "Hardware tag-based mode" + depends on HAVE_ARCH_KASAN_HW_TAGS + depends on SLUB + help + Enables hardware tag-based KASAN mode. + + This mode requires hardware memory tagging support, and can be used + by any architecture that provides it. + + Currently this mode is only implemented for arm64 CPUs starting from + ARMv8.5 and relies on Memory Tagging Extension and Top Byte Ignore. + endchoice choice prompt "Instrumentation type" + depends on KASAN_GENERIC || KASAN_SW_TAGS default KASAN_OUTLINE config KASAN_OUTLINE @@ -114,6 +136,7 @@ endchoice config KASAN_STACK_ENABLE bool "Enable stack instrumentation (unsafe)" if CC_IS_CLANG && !COMPILE_TEST + depends on KASAN_GENERIC || KASAN_SW_TAGS help The LLVM stack address sanitizer has a know problem that causes excessive stack usage in a lot of functions, see -- 2.28.0.681.g6f77f65b4e-goog