Received: by 2002:a05:6a10:6006:0:0:0:0 with SMTP id w6csp1862815pxa; Sat, 29 Aug 2020 06:03:51 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwjJMCaCv9opeTU2oQ7U3pHN3R27YT8CUOZ8QWPgUXp6KIPwmZPDxOYeDE3d51hkXBZswFJ X-Received: by 2002:a50:cd44:: with SMTP id d4mr3454204edj.37.1598706231078; Sat, 29 Aug 2020 06:03:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1598706231; cv=none; d=google.com; s=arc-20160816; b=YNYBif8WUCMH5sWWWnCEiJuDBUdGvFBRvn5yzETBE/KFV57/jaWVTtXT9Wvbanv9fh iLbDNj2k3PddOAHMjhf9DkcJQAt2zukcpjUreaD9PebT8AetGGIWt0AZdfoicVhzVNBB Hy1vz8yzouagPt5Jy2lm94CEOVsUOI/z2I7jomYG8v0Ioou/NDPJkEMqliGL4Vml1w2x 4gvc1llpty8Gs4FybOBJoLL8L1YK+kFzoekMKBPC9C1xu+88/Y7ElsdBqK8dw7lTo62t IFbi6CQxxBlaAfncZtNOuEra35mxVjKmMHjKd6/AdNKrpffqDnHtvGPctXI4+gvwzAiq t5EA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:mime-version :user-agent:references:in-reply-to:message-id:date:subject:cc:to :from:dkim-signature; bh=j/c6WjrNynfkOygwLuDh/infYr1YeFtOO5CCh5vNDd4=; b=eax3me3ocr8OiKT+eOqDkq8QuIUATmk7dmhP5mOMucFUotB+zxqHgRpSeeZg7oAHSm 89LWeg0oWjnA+4bc7yeR3I1ngtRPG77vH86L9gRpNa4OUjni2qmmUQEO4eIlPy4jnyTn qQ/icA6ByjiUVcsiXqV+eqXcnbyqLtVwJ4avv1ZdkcWIt/E+Vl4eEUbm45DzRFQWpnuk 2K7N6PKtK0UHeaxbhrlMXx7UZRIf8HIkiNsDkfA104sFWkV9ZY0EfAfQmzsla6KGRQB7 hU6/u1XnyR/3YvInH1luXZwOwXA49/DNEn7Ih3uEi1yI/2SFvP257fGYYFZ9Nq6fS6ep AGRA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=dL5TYdym; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id cz21si1398334edb.510.2020.08.29.06.03.27; Sat, 29 Aug 2020 06:03:51 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel.org header.s=default header.b=dL5TYdym; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728169AbgH2NCR (ORCPT + 99 others); Sat, 29 Aug 2020 09:02:17 -0400 Received: from mail.kernel.org ([198.145.29.99]:52216 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728050AbgH2NAa (ORCPT ); Sat, 29 Aug 2020 09:00:30 -0400 Received: from localhost.localdomain (NE2965lan1.rev.em-net.ne.jp [210.141.244.193]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id C42222076D; Sat, 29 Aug 2020 13:00:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1598706030; bh=VNO9KYZNfPnRAvmpq+O3OW8CvDGM43ULGiTu4X+0Kw4=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=dL5TYdymZE5rW5d7CBE4yR5Z4R53he+6r+rUa7WBIIhlnYzY4WFxCM4Bn8/ujyuWJ Q2+yKVFv0ReUUEZ1J97H259NwEgPIj1U9Q2UAKAFRMcd7QRljoVzE6NDVdxaEVvwGo K3GerjCmGYTYe/Vy3+wsuY2BkxwuHDouzhneHFVU= From: Masami Hiramatsu To: linux-kernel@vger.kernel.org, Peter Zijlstra Cc: Eddy_Wu@trendmicro.com, x86@kernel.org, davem@davemloft.net, rostedt@goodmis.org, naveen.n.rao@linux.ibm.com, anil.s.keshavamurthy@intel.com, linux-arch@vger.kernel.org, cameron@moodycamel.com, oleg@redhat.com, will@kernel.org, paulmck@kernel.org, mhiramat@kernel.org Subject: [PATCH v5 03/21] arm: kprobes: Use generic kretprobe trampoline handler Date: Sat, 29 Aug 2020 22:00:24 +0900 Message-Id: <159870602406.1229682.10496730247473708592.stgit@devnote2> X-Mailer: git-send-email 2.25.1 In-Reply-To: <159870598914.1229682.15230803449082078353.stgit@devnote2> References: <159870598914.1229682.15230803449082078353.stgit@devnote2> User-Agent: StGit/0.19 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Use the generic kretprobe trampoline handler. Use regs->ARM_fp for framepointer verification. Signed-off-by: Masami Hiramatsu --- Changes in v2: - Fix to cast frame_pointer type to void *. --- arch/arm/probes/kprobes/core.c | 78 ++-------------------------------------- 1 file changed, 3 insertions(+), 75 deletions(-) diff --git a/arch/arm/probes/kprobes/core.c b/arch/arm/probes/kprobes/core.c index feefa2055eba..a9653117ca0d 100644 --- a/arch/arm/probes/kprobes/core.c +++ b/arch/arm/probes/kprobes/core.c @@ -413,87 +413,15 @@ void __naked __kprobes kretprobe_trampoline(void) /* Called from kretprobe_trampoline */ static __used __kprobes void *trampoline_handler(struct pt_regs *regs) { - struct kretprobe_instance *ri = NULL; - struct hlist_head *head, empty_rp; - struct hlist_node *tmp; - unsigned long flags, orig_ret_address = 0; - unsigned long trampoline_address = (unsigned long)&kretprobe_trampoline; - kprobe_opcode_t *correct_ret_addr = NULL; - - INIT_HLIST_HEAD(&empty_rp); - kretprobe_hash_lock(current, &head, &flags); - - /* - * It is possible to have multiple instances associated with a given - * task either because multiple functions in the call path have - * a return probe installed on them, and/or more than one return - * probe was registered for a target function. - * - * We can handle this because: - * - instances are always inserted at the head of the list - * - when multiple return probes are registered for the same - * function, the first instance's ret_addr will point to the - * real return address, and all the rest will point to - * kretprobe_trampoline - */ - hlist_for_each_entry_safe(ri, tmp, head, hlist) { - if (ri->task != current) - /* another task is sharing our hash bucket */ - continue; - - orig_ret_address = (unsigned long)ri->ret_addr; - - if (orig_ret_address != trampoline_address) - /* - * This is the real return address. Any other - * instances associated with this task are for - * other calls deeper on the call stack - */ - break; - } - - kretprobe_assert(ri, orig_ret_address, trampoline_address); - - correct_ret_addr = ri->ret_addr; - hlist_for_each_entry_safe(ri, tmp, head, hlist) { - if (ri->task != current) - /* another task is sharing our hash bucket */ - continue; - - orig_ret_address = (unsigned long)ri->ret_addr; - if (ri->rp && ri->rp->handler) { - __this_cpu_write(current_kprobe, &ri->rp->kp); - get_kprobe_ctlblk()->kprobe_status = KPROBE_HIT_ACTIVE; - ri->ret_addr = correct_ret_addr; - ri->rp->handler(ri, regs); - __this_cpu_write(current_kprobe, NULL); - } - - recycle_rp_inst(ri, &empty_rp); - - if (orig_ret_address != trampoline_address) - /* - * This is the real return address. Any other - * instances associated with this task are for - * other calls deeper on the call stack - */ - break; - } - - kretprobe_hash_unlock(current, &flags); - - hlist_for_each_entry_safe(ri, tmp, &empty_rp, hlist) { - hlist_del(&ri->hlist); - kfree(ri); - } - - return (void *)orig_ret_address; + return (void *)kretprobe_trampoline_handler(regs, &kretprobe_trampoline, + (void *)regs->ARM_fp); } void __kprobes arch_prepare_kretprobe(struct kretprobe_instance *ri, struct pt_regs *regs) { ri->ret_addr = (kprobe_opcode_t *)regs->ARM_lr; + ri->fp = (void *)regs->ARM_fp; /* Replace the return addr with trampoline addr. */ regs->ARM_lr = (unsigned long)&kretprobe_trampoline;