Received: by 2002:a05:6359:c8b:b0:c7:702f:21d4 with SMTP id go11csp3309798rwb; Fri, 30 Sep 2022 01:25:50 -0700 (PDT) X-Google-Smtp-Source: AMsMyM6AunEYwYdtopsSkQ8vfcWh1g3RCGilYz6Lwro26H3u7z9CI/4W7dDg06yv3ic76mlqSovo X-Received: by 2002:a17:907:3f13:b0:782:1266:8c10 with SMTP id hq19-20020a1709073f1300b0078212668c10mr5667650ejc.197.1664526350451; Fri, 30 Sep 2022 01:25:50 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1664526350; cv=none; d=google.com; s=arc-20160816; b=nv9+HuiC3xI1wAOE7v1sf2UaGFCK0fKtiMqjxuOPSrPyLD9I5/Q5VpN9Bc2YGUnFww r7RDqHBDUx3A1jutHo3s57D+HZI8o+99aMZSH7NOoAMavxEmD7iUwkiCtCP4GD5pwXdS ZruFEA1AfiIB8GHtSlUy1pDa9M5wLdKnsUfby9K5QQGWvoJ0A+WLAGeHmWbvGYTzXNta 6qJDSoNxP3n4557+GIuAHHcUQ5PQ6J5TBDPJvkgzlFTUyBScHWw8p/oJv89g8rvOQmod IRt7LBa+1bcDFtgvuQxIylHe2JplFBoYBzYOa88EsuHN+KS6mvNIZWEyvEQjcNXSHSqc rflA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=EyMhbdcoCnd7nyiVH5VQAszJwrQE+nYROXNJQfleck8=; b=acI7pB6tJlk2jgk86tfZCo9CZv32HFmVv62b0k/F5Id2JaBSAOG0mw1dbxWBTb3fxn ZKd64iper3AIj+bFPu32pnm2mUiI86n9X634sKtU0Q6WatJoyIr7ED9i6lm4/g50xhva zt5myCpLdxlfGyaQzoe258hYhOcwE6zOz47fqJz9hy0bKtaoslUcDFGUWCj7yQOIIyWp bAOa7VtKNFQKoHZpepE2HKNm4Qh7odQHRLQf8XCpe2P5sDHq0+g24C3TuNBto4C58EPy 2K+ir+mmVFZGohmlUnjFYLEaK2QILd4E18GQEo6oGzEsenFQymLAhAwNoklfSf9yGSbo ySUg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=O2O90zAe; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id dd14-20020a1709069b8e00b007721f88d3e0si1606096ejc.554.2022.09.30.01.25.24; Fri, 30 Sep 2022 01:25:50 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=O2O90zAe; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230382AbiI3IHA (ORCPT + 99 others); Fri, 30 Sep 2022 04:07:00 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:37644 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229689AbiI3IG6 (ORCPT ); Fri, 30 Sep 2022 04:06:58 -0400 Received: from mail-pj1-x1035.google.com (mail-pj1-x1035.google.com [IPv6:2607:f8b0:4864:20::1035]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 568A5120866 for ; Fri, 30 Sep 2022 01:06:57 -0700 (PDT) Received: by mail-pj1-x1035.google.com with SMTP id c6-20020a17090a4d0600b0020958fcd9acso2302557pjg.4 for ; Fri, 30 Sep 2022 01:06:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date; bh=EyMhbdcoCnd7nyiVH5VQAszJwrQE+nYROXNJQfleck8=; b=O2O90zAeIuFYyG62iQQibTBwDvEVS3Jn9RDsylTH+BF+2LSJINhkzwpSd00EwA/PL6 J2Q8qKa77MT/uawOar1QKH7eBC34/0ZbPLDQ6RRqGiwW/e7oT0sTZDsLcT1OlvcleQke eWVk/4s1UBPArTXJJEsl1X3UznAyuaAea3A91/Eaq4b1NVlSQFVT2w1k3GlZWFgLqhud DIDcfAduuQIGDO50maIMtDke2ihPhddhZDttBCPuVDnb9md5X6PPw258kYGFt/SO4iRK smH9MBUpnJ0Iys8sKngG40ZqCwE0WKSJ+yEj0g0O82idZ7BYMZb+n/IE0+X3GC1G5rCJ SZmw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date; bh=EyMhbdcoCnd7nyiVH5VQAszJwrQE+nYROXNJQfleck8=; b=nlO+v0CFSy3x6yJvHxy7x7FEaTXlX8i3z+8Y7jU0bcAFDp8KXsJ9OTOIz3gKMH4IDu wjydoY4zWonZzLosrMfxSKy0dHMP5kfI+cq14kJ/26Ldm75DbZCdkpqeB/8NaKStIX/Q Tn4zg1VuCLExtvBgyDXFNOzkvmrJ+KB3+DMdmzS33bS4bIIgoyHqFQ5AR69SicWgBtOB zf5djF1Q1/DuNy9FgX02gGN85waBO1mWhZcT2fMqAj4iwPWmd+FIzJO6THHR4b4nlEW7 4NM2aw8HNGfHW33iYTG5IWl7Sk+0UlHn/ctMRY7CNuTDmZEdqogasFFa2ELdYfTn2zXq Ge+Q== X-Gm-Message-State: ACrzQf1dvePAmfeU2f4DHoJYV1IsuhdtR0KYRtFtq9X2WI3ArnS8DMq4 dumkBDShnmxRgrmHOurzJ8U= X-Received: by 2002:a17:902:7887:b0:178:5e8a:e84e with SMTP id q7-20020a170902788700b001785e8ae84emr7784938pll.64.1664525216726; Fri, 30 Sep 2022 01:06:56 -0700 (PDT) Received: from localhost.localdomain (l3b2w1.cn. [159.138.1.25]) by smtp.gmail.com with ESMTPSA id kb16-20020a17090ae7d000b001f8c532b93dsm1089432pjb.15.2022.09.30.01.06.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 30 Sep 2022 01:06:56 -0700 (PDT) From: Binglei Wang X-Google-Original-From: Binglei Wang To: paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, naveen.n.rao@linux.ibm.com, anil.s.keshavamurthy@intel.com, davem@davemloft.net, mhiramat@kernel.org Cc: linux-riscv@lists.infradead.org, linux-kernel@vger.kernel.org, Binglei Wang Subject: [PATCH v7] rethook: add riscv rethook implementation Date: Fri, 30 Sep 2022 16:06:50 +0800 Message-Id: <20220930080650.651587-1-l3b2w1@gmail.com> X-Mailer: git-send-email 2.27.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.0 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Binglei Wang Implement the kretprobes on riscv arch by using rethook machenism which abstracts general kretprobe info into a struct rethook_node to be embedded in the struct kretprobe_instance. Signed-off-by: Binglei Wang --- Notes: v7: Add the changelog. v6: Remove the kretprobes trampoline. v5: Trt to fix robot compiling error and warnings. v4: Add patch version number. v3: Trt to fix robot compiling error and warnings. v2: Add comit log to explain reasons behind changes. Use my personal email instead of work email to avoid the attachments of company informaton. Make the kprobes_trampoline.S code to be shared. v1: Add riscv rethook implementation. arch/riscv/Kconfig | 1 + arch/riscv/include/asm/kprobes.h | 2 -- arch/riscv/kernel/probes/Makefile | 2 +- arch/riscv/kernel/probes/kprobes.c | 13 --------- arch/riscv/kernel/probes/rethook.c | 27 +++++++++++++++++++ ...obes_trampoline.S => rethook_trampoline.S} | 6 ++--- 6 files changed, 32 insertions(+), 19 deletions(-) create mode 100644 arch/riscv/kernel/probes/rethook.c rename arch/riscv/kernel/probes/{kprobes_trampoline.S => rethook_trampoline.S} (94%) diff --git a/arch/riscv/Kconfig b/arch/riscv/Kconfig index 59d18881f..bfb66cdc5 100644 --- a/arch/riscv/Kconfig +++ b/arch/riscv/Kconfig @@ -97,6 +97,7 @@ config RISCV select HAVE_KPROBES if !XIP_KERNEL select HAVE_KPROBES_ON_FTRACE if !XIP_KERNEL select HAVE_KRETPROBES if !XIP_KERNEL + select HAVE_RETHOOK if !XIP_KERNEL select HAVE_MOVE_PMD select HAVE_MOVE_PUD select HAVE_PCI diff --git a/arch/riscv/include/asm/kprobes.h b/arch/riscv/include/asm/kprobes.h index 217ef89f2..e7882ccb0 100644 --- a/arch/riscv/include/asm/kprobes.h +++ b/arch/riscv/include/asm/kprobes.h @@ -40,8 +40,6 @@ void arch_remove_kprobe(struct kprobe *p); int kprobe_fault_handler(struct pt_regs *regs, unsigned int trapnr); bool kprobe_breakpoint_handler(struct pt_regs *regs); bool kprobe_single_step_handler(struct pt_regs *regs); -void __kretprobe_trampoline(void); -void __kprobes *trampoline_probe_handler(struct pt_regs *regs); #endif /* CONFIG_KPROBES */ #endif /* _ASM_RISCV_KPROBES_H */ diff --git a/arch/riscv/kernel/probes/Makefile b/arch/riscv/kernel/probes/Makefile index 7f0840dcc..c40139e9c 100644 --- a/arch/riscv/kernel/probes/Makefile +++ b/arch/riscv/kernel/probes/Makefile @@ -1,6 +1,6 @@ # SPDX-License-Identifier: GPL-2.0 obj-$(CONFIG_KPROBES) += kprobes.o decode-insn.o simulate-insn.o -obj-$(CONFIG_KPROBES) += kprobes_trampoline.o +obj-$(CONFIG_RETHOOK) += rethook.o rethook_trampoline.o obj-$(CONFIG_KPROBES_ON_FTRACE) += ftrace.o obj-$(CONFIG_UPROBES) += uprobes.o decode-insn.o simulate-insn.o CFLAGS_REMOVE_simulate-insn.o = $(CC_FLAGS_FTRACE) diff --git a/arch/riscv/kernel/probes/kprobes.c b/arch/riscv/kernel/probes/kprobes.c index e6e950b7c..f21592d20 100644 --- a/arch/riscv/kernel/probes/kprobes.c +++ b/arch/riscv/kernel/probes/kprobes.c @@ -345,19 +345,6 @@ int __init arch_populate_kprobe_blacklist(void) return ret; } -void __kprobes __used *trampoline_probe_handler(struct pt_regs *regs) -{ - return (void *)kretprobe_trampoline_handler(regs, NULL); -} - -void __kprobes arch_prepare_kretprobe(struct kretprobe_instance *ri, - struct pt_regs *regs) -{ - ri->ret_addr = (kprobe_opcode_t *)regs->ra; - ri->fp = NULL; - regs->ra = (unsigned long) &__kretprobe_trampoline; -} - int __kprobes arch_trampoline_kprobe(struct kprobe *p) { return 0; diff --git a/arch/riscv/kernel/probes/rethook.c b/arch/riscv/kernel/probes/rethook.c new file mode 100644 index 000000000..cbd0da059 --- /dev/null +++ b/arch/riscv/kernel/probes/rethook.c @@ -0,0 +1,27 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* + * Generic return hook for riscv. + */ + +#include +#include +#include "rethook.h" + +/* This is called from arch_rethook_trampoline() */ +unsigned long __used arch_rethook_trampoline_callback(struct pt_regs *regs) +{ + return rethook_trampoline_handler(regs, regs->s0); +} +NOKPROBE_SYMBOL(arch_rethook_trampoline_callback); + + +void arch_rethook_prepare(struct rethook_node *rhn, struct pt_regs *regs, bool mcount) +{ + rhn->ret_addr = regs->ra; + rhn->frame = regs->s0; + + /* replace return addr with trampoline */ + regs->ra = (unsigned long)arch_rethook_trampoline; +} +NOKPROBE_SYMBOL(arch_rethook_prepare); + diff --git a/arch/riscv/kernel/probes/kprobes_trampoline.S b/arch/riscv/kernel/probes/rethook_trampoline.S similarity index 94% rename from arch/riscv/kernel/probes/kprobes_trampoline.S rename to arch/riscv/kernel/probes/rethook_trampoline.S index 7bdb09ded..21bac92a1 100644 --- a/arch/riscv/kernel/probes/kprobes_trampoline.S +++ b/arch/riscv/kernel/probes/rethook_trampoline.S @@ -75,13 +75,13 @@ REG_L x31, PT_T6(sp) .endm -ENTRY(__kretprobe_trampoline) +ENTRY(arch_rethook_trampoline) addi sp, sp, -(PT_SIZE_ON_STACK) save_all_base_regs move a0, sp /* pt_regs */ - call trampoline_probe_handler + call arch_rethook_trampoline_callback /* use the result as the return-address */ move ra, a0 @@ -90,4 +90,4 @@ ENTRY(__kretprobe_trampoline) addi sp, sp, PT_SIZE_ON_STACK ret -ENDPROC(__kretprobe_trampoline) +ENDPROC(arch_rethook_trampoline) -- 2.27.0