Received: by 2002:ab2:1149:0:b0:1f3:1f8c:d0c6 with SMTP id z9csp2767335lqz; Wed, 3 Apr 2024 08:06:07 -0700 (PDT) X-Forwarded-Encrypted: i=3; AJvYcCVP3RVxBpdENncSre3fXTCpzR8b+uByljg2yp10U2Yf++yuovNhVVVb3ALRy7odKz79teNlwFvbzqmcO06RW0nzxNYXIrxTk1FXKwr7gg== X-Google-Smtp-Source: AGHT+IFCp7egjOFgJrdzGpd30DaLVeJN8xuBW8etmug0cPsMk91mudEp9/D29ywNFmRH7eZ7swr1 X-Received: by 2002:a05:6808:4095:b0:3c1:c124:6d4d with SMTP id db21-20020a056808409500b003c1c1246d4dmr14277525oib.56.1712156767084; Wed, 03 Apr 2024 08:06:07 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712156767; cv=pass; d=google.com; s=arc-20160816; b=t7VYWcX6Ak52gGY+mzYEB+Ns4e+pbr+yct3aD5nXnuuClLoFyMAMEfxJV0P0+tyZOJ qcKkqvwPfKdQDIgl4BY4red7hBbe8VLXap5a9UtWrFlVx5KE8PNr2/YGjDGGy5TjWmVM Ak3gT0F2XlixzkMF+8XV4SaqVWk6vHW5gqrrnCAFz/rf8tvNnncdB73FzqyXz6Q5JrE7 D7WhXIlE53+evPK8/GJHsN7hVTP7+tTzbKsORfd/HRRK/EOWQLBB0YH/sBTnlcdD7sR2 EuiZClhRcKFDK0KMgxMTmACriHngqfq3ThO8+ekq8bk8MdUp90WqdtnIuvdfYaOyv0Zp uSgQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:in-reply-to:message-id :date:subject:cc:to:from; bh=vT6v60V5RxG6hEm3mlTJznzhgvAP+aZkoSJ2wF7NkFM=; fh=z7ZRrDPBADio5T1CPFQ6tJ06RN6yiH68llup+QFYIJc=; b=KGVo1pzOo5vZUm5itBvmUgtcRNMbug3NYb/EBdj0iKRzGWW7BGO5YV7MssJ6hvfF2k clSdIGcJhDffxSMB2wC8P2ePj4eFgYXYZsr3pjUS4VvaciqEdO1AXHzJilEHkqOfiNSE 3tOI1nJuex8dIUwVb1CDRl5PtDcXqx/PS5yleEt33DlqY96XPrrZeZR7hOF+wNNj26oX ZjfQ8morEpjKS9hf2MYI/AN9ga9NngacQyRNICmPwZTYzkMZQrVHUod0EDe6i5SZTnVI ubheWWOu1yKcc7RKRyBcoMTEQZ1q9tUvnod8/4kdlx3EkJZiGrxYI/JD8HeUUHJm0XhZ /t1g==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; arc=pass (i=1 spf=pass spfdomain=arm.com dmarc=pass fromdomain=arm.com); spf=pass (google.com: domain of linux-kernel+bounces-130020-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-130020-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=arm.com Return-Path: Received: from ny.mirrors.kernel.org (ny.mirrors.kernel.org. [147.75.199.223]) by mx.google.com with ESMTPS id g9-20020ab01049000000b007e3eecc74bcsi80133uab.16.2024.04.03.08.06.06 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 03 Apr 2024 08:06:07 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel+bounces-130020-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) client-ip=147.75.199.223; Authentication-Results: mx.google.com; arc=pass (i=1 spf=pass spfdomain=arm.com dmarc=pass fromdomain=arm.com); spf=pass (google.com: domain of linux-kernel+bounces-130020-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.199.223 as permitted sender) smtp.mailfrom="linux-kernel+bounces-130020-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=arm.com Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ny.mirrors.kernel.org (Postfix) with ESMTPS id 7B69D1C27A6E for ; Wed, 3 Apr 2024 15:02:53 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 57B0114A607; Wed, 3 Apr 2024 15:02:12 +0000 (UTC) Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by smtp.subspace.kernel.org (Postfix) with ESMTP id A85C514A4D9 for ; Wed, 3 Apr 2024 15:02:09 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=217.140.110.172 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712156531; cv=none; b=TsogmLoRYkctMDwNic2lhYpahegzq/QSG0G7uuoKpG8e5GjNehnqWr/qJdbLvFzEVj5rRaNaTe3B9ilZ4cRfF9f91i9y6BgEk5PgTmyEDy9ueVnmiS+L/zXJpNQf74PYxV8mZ8qWqEm64ogXF3YrIe7kLrRHYTRFoKVqog7edOE= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1712156531; c=relaxed/simple; bh=V9CTkZOx/tGYPNlc61sl/gWZULplYRl65rJqks9cElo=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=bIXkgp6Lx0cUO8id9bcWt15wC9fbVpSXYpD9iLiL5cbXK+4YtXuoNrqJKvwFGtcXStPzRCt4eWR161BD0o0CEtHuA6kXgbFMIsTUtm5i+WYMQMaVRlca0bYqIyxUEmRoSAbGQwFUV81MjUi1CLI4trmX7QzkNPZ0ncbtxd3dYm4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arm.com; spf=pass smtp.mailfrom=arm.com; arc=none smtp.client-ip=217.140.110.172 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=arm.com Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 2C7C21007; Wed, 3 Apr 2024 08:02:40 -0700 (PDT) Received: from lakrids.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 7DE443F7B4; Wed, 3 Apr 2024 08:02:07 -0700 (PDT) From: Mark Rutland To: linux-kernel@vger.kernel.org Cc: anil.s.keshavamurthy@intel.com, aou@eecs.berkeley.edu, catalin.marinas@arm.com, davem@davemloft.net, jarkko@kernel.org, linux-arm-kernel@lists.infradead.org, mark.rutland@arm.com, mhiramat@kernel.org, naveen.n.rao@linux.ibm.com, palmer@dabbelt.com, paul.walmsley@sifive.com, will@kernel.org Subject: [PATCH v2 3/4] kprobes/treewide: Explicitly override alloc/free functions Date: Wed, 3 Apr 2024 16:01:53 +0100 Message-Id: <20240403150154.667649-4-mark.rutland@arm.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20240403150154.667649-1-mark.rutland@arm.com> References: <20240403150154.667649-1-mark.rutland@arm.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Currently architectures can override kprobes_alloc_insn_page(), but kprobes_free_insn_page() is always implemented using module_memfree(), which might not be what an architecture needs, especially as we'd like to make it possible to use kprobes without requiring MODULES. It would be nicer if architectures either: (a) Used only the generic kprobes_alloc_insn_page() and kprobes_free_insn_page(), implicitly depending on MODULES. (b) Provided their own implementation of both kprobes_alloc_insn_page() and kprobes_free_insn_page(), handling the relevant dependencies themselves. This patch applies that split treewide: (a) Architectures using the generic kprobes_free_insn_page() and kprobes_free_insn_page() are left as-is. The __weak annotation is removed from the generic implementations so that accidental overrides/misuse can be detected easily. (b) Architectures which provide their own kprobes_free_insn_page() are given a matching implementation of kprobes_free_insn_page(), and select HAVE_KPROBES_ALLOC. This new Kconfig symbol will allow subsequent patches to relax the dependency on MODULES to (MODULES || HAVE_KPROBES_ALLOC) once other module dependencies in the core kprobes code are cleaned up. Architectures which use module_alloc() are given an implementation using module_memfree() along with an explicit dependency on MODULES. Architectures using __vmalloc_node_range() are given an implementation using vfree(). This loses the warning for in_interrupt(), but vfree() can handle this via vfree_atomic(), so the warning isn't necessary. On riscv, the allocator depends on !XIP_KERNEL, which is already a dependency for HAVE_KPROBES in arch/riscv/Kconfig. As of this patch arm64 and riscv have kprobe allocation functions which do not explicitly depend on MODULES. The core kprobes code still depends on MODULES. Signed-off-by: Mark Rutland Cc: Albert Ou Cc: Anil S Keshavamurthy Cc: Catalin Marinas Cc: David S. Miller Cc: Jarkko Sakkinen Cc: Masami Hiramatsu Cc: Naveen N. Rao Cc: Palmer Dabbelt Cc: Paul Walmsley Cc: Will Deacon --- arch/Kconfig | 3 +++ arch/arm64/Kconfig | 1 + arch/arm64/kernel/probes/kprobes.c | 5 +++++ arch/powerpc/Kconfig | 3 ++- arch/powerpc/kernel/kprobes.c | 5 +++++ arch/riscv/Kconfig | 1 + arch/riscv/kernel/probes/kprobes.c | 5 +++++ arch/s390/Kconfig | 3 ++- arch/s390/kernel/kprobes.c | 5 +++++ arch/x86/Kconfig | 3 ++- arch/x86/kernel/kprobes/core.c | 5 +++++ include/linux/kprobes.h | 1 + kernel/kprobes.c | 6 ++++-- 13 files changed, 41 insertions(+), 5 deletions(-) diff --git a/arch/Kconfig b/arch/Kconfig index 9f066785bb71d..85bb59f7b8c07 100644 --- a/arch/Kconfig +++ b/arch/Kconfig @@ -206,6 +206,9 @@ config HAVE_IOREMAP_PROT config HAVE_KPROBES bool +config HAVE_KPROBES_ALLOC + bool + config HAVE_KRETPROBES bool diff --git a/arch/arm64/Kconfig b/arch/arm64/Kconfig index 7b11c98b3e84b..bda7913d6c9b8 100644 --- a/arch/arm64/Kconfig +++ b/arch/arm64/Kconfig @@ -233,6 +233,7 @@ config ARM64 select HAVE_STACKPROTECTOR select HAVE_SYSCALL_TRACEPOINTS select HAVE_KPROBES + select HAVE_KPROBES_ALLOC select HAVE_KRETPROBES select HAVE_GENERIC_VDSO select HOTPLUG_CORE_SYNC_DEAD if HOTPLUG_CPU diff --git a/arch/arm64/kernel/probes/kprobes.c b/arch/arm64/kernel/probes/kprobes.c index 4b6ab7b1fa211..69d19a390cd48 100644 --- a/arch/arm64/kernel/probes/kprobes.c +++ b/arch/arm64/kernel/probes/kprobes.c @@ -136,6 +136,11 @@ void *kprobes_alloc_insn_page(void) NUMA_NO_NODE, __builtin_return_address(0)); } +void kprobes_free_insn_page(void *page) +{ + vfree(page); +} + /* arm kprobe: install breakpoint in text */ void __kprobes arch_arm_kprobe(struct kprobe *p) { diff --git a/arch/powerpc/Kconfig b/arch/powerpc/Kconfig index 1c4be33736860..13e0fc51dcdcf 100644 --- a/arch/powerpc/Kconfig +++ b/arch/powerpc/Kconfig @@ -254,7 +254,8 @@ config PPC select HAVE_KERNEL_LZMA if DEFAULT_UIMAGE select HAVE_KERNEL_LZO if DEFAULT_UIMAGE select HAVE_KERNEL_XZ if PPC_BOOK3S || 44x - select HAVE_KPROBES + select HAVE_KPROBES if MODULES + select HAVE_KPROBES_ALLOC select HAVE_KPROBES_ON_FTRACE select HAVE_KRETPROBES select HAVE_LD_DEAD_CODE_DATA_ELIMINATION if HAVE_OBJTOOL_MCOUNT && (!ARCH_USING_PATCHABLE_FUNCTION_ENTRY || (!CC_IS_GCC || GCC_VERSION >= 110100)) diff --git a/arch/powerpc/kernel/kprobes.c b/arch/powerpc/kernel/kprobes.c index 0b297718d5de6..d0332aaebab09 100644 --- a/arch/powerpc/kernel/kprobes.c +++ b/arch/powerpc/kernel/kprobes.c @@ -146,6 +146,11 @@ void *kprobes_alloc_insn_page(void) return NULL; } +void kprobes_free_insn_page(void *page) +{ + module_memfree(page); +} + int arch_prepare_kprobe(struct kprobe *p) { int ret = 0; diff --git a/arch/riscv/Kconfig b/arch/riscv/Kconfig index be09c8836d56b..4e22549a522a5 100644 --- a/arch/riscv/Kconfig +++ b/arch/riscv/Kconfig @@ -139,6 +139,7 @@ config RISCV select HAVE_GENERIC_VDSO if MMU && 64BIT select HAVE_IRQ_TIME_ACCOUNTING select HAVE_KPROBES if !XIP_KERNEL + select HAVE_KPROBES_ALLOC select HAVE_KPROBES_ON_FTRACE if !XIP_KERNEL select HAVE_KRETPROBES if !XIP_KERNEL # https://github.com/ClangBuiltLinux/linux/issues/1881 diff --git a/arch/riscv/kernel/probes/kprobes.c b/arch/riscv/kernel/probes/kprobes.c index 75201ce721057..37fdfa952d999 100644 --- a/arch/riscv/kernel/probes/kprobes.c +++ b/arch/riscv/kernel/probes/kprobes.c @@ -112,6 +112,11 @@ void *kprobes_alloc_insn_page(void) VM_FLUSH_RESET_PERMS, NUMA_NO_NODE, __builtin_return_address(0)); } + +void kprobes_free_insn_page(void *page) +{ + vfree(page); +} #endif /* install breakpoint in text */ diff --git a/arch/s390/Kconfig b/arch/s390/Kconfig index 8f01ada6845e3..635eddc3fce80 100644 --- a/arch/s390/Kconfig +++ b/arch/s390/Kconfig @@ -193,7 +193,8 @@ config S390 select HAVE_KERNEL_UNCOMPRESSED select HAVE_KERNEL_XZ select HAVE_KERNEL_ZSTD - select HAVE_KPROBES + select HAVE_KPROBES if MODULES + select HAVE_KPROBES_ALLOC select HAVE_KPROBES_ON_FTRACE select HAVE_KRETPROBES select HAVE_LIVEPATCH diff --git a/arch/s390/kernel/kprobes.c b/arch/s390/kernel/kprobes.c index 91ca4d501d4ef..a5b142b8eb0f7 100644 --- a/arch/s390/kernel/kprobes.c +++ b/arch/s390/kernel/kprobes.c @@ -45,6 +45,11 @@ void *kprobes_alloc_insn_page(void) return page; } +void kprobes_free_insn_page(void *page) +{ + module_memfree(page); +} + static void *alloc_s390_insn_page(void) { if (xchg(&insn_page_in_use, 1) == 1) diff --git a/arch/x86/Kconfig b/arch/x86/Kconfig index 4fff6ed46e902..0810cd0bdeca9 100644 --- a/arch/x86/Kconfig +++ b/arch/x86/Kconfig @@ -240,7 +240,8 @@ config X86 select HAVE_KERNEL_LZO select HAVE_KERNEL_XZ select HAVE_KERNEL_ZSTD - select HAVE_KPROBES + select HAVE_KPROBES if MODULES + select HAVE_KPROBES_ALLOC select HAVE_KPROBES_ON_FTRACE select HAVE_FUNCTION_ERROR_INJECTION select HAVE_KRETPROBES diff --git a/arch/x86/kernel/kprobes/core.c b/arch/x86/kernel/kprobes/core.c index 7f01bbbfa9e2a..5f093b94d9b40 100644 --- a/arch/x86/kernel/kprobes/core.c +++ b/arch/x86/kernel/kprobes/core.c @@ -508,6 +508,11 @@ void *kprobes_alloc_insn_page(void) return page; } +void kprobes_free_insn_page(void *page) +{ + module_memfree(page); +} + /* Kprobe x86 instruction emulation - only regs->ip or IF flag modifiers */ static void kprobe_emulate_ifmodifiers(struct kprobe *p, struct pt_regs *regs) diff --git a/include/linux/kprobes.h b/include/linux/kprobes.h index ad4b561100f9e..651c807727bea 100644 --- a/include/linux/kprobes.h +++ b/include/linux/kprobes.h @@ -431,6 +431,7 @@ int enable_kprobe(struct kprobe *kp); void dump_kprobe(struct kprobe *kp); void *kprobes_alloc_insn_page(void); +void kprobes_free_insn_page(void *page); void *kprobes_alloc_optinsn_page(void); void kprobes_free_optinsn_page(void *page); diff --git a/kernel/kprobes.c b/kernel/kprobes.c index 35adf56430c9b..fa2ee4e59eca2 100644 --- a/kernel/kprobes.c +++ b/kernel/kprobes.c @@ -110,7 +110,8 @@ enum kprobe_slot_state { SLOT_USED = 2, }; -void __weak *kprobes_alloc_insn_page(void) +#ifndef CONFIG_HAVE_KPROBES_ALLOC +void *kprobes_alloc_insn_page(void) { /* * Use module_alloc() so this page is within +/- 2GB of where the @@ -121,10 +122,11 @@ void __weak *kprobes_alloc_insn_page(void) return module_alloc(PAGE_SIZE); } -static void kprobes_free_insn_page(void *page) +void kprobes_free_insn_page(void *page) { module_memfree(page); } +#endif struct kprobe_insn_cache kprobe_insn_slots = { .mutex = __MUTEX_INITIALIZER(kprobe_insn_slots.mutex), -- 2.30.2