Received: by 2002:a05:6a10:8c0a:0:0:0:0 with SMTP id go10csp4365405pxb; Tue, 2 Mar 2021 13:16:14 -0800 (PST) X-Google-Smtp-Source: ABdhPJyX1KNMSBiPfONZmOTb72fa8jTIql3d3xm1HmtKvm0MjAUe7exqkFZKo5YYhJ/fByP4qkhH X-Received: by 2002:a17:906:b159:: with SMTP id bt25mr22671296ejb.364.1614719774303; Tue, 02 Mar 2021 13:16:14 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1614719774; cv=none; d=google.com; s=arc-20160816; b=a25U71uNRCldTW2uFrdyqftOkKP12OmN59CR22uLxKbF/yxhhKpPezI/7+uHnNeqQb LvXNTaBSnFO9BYCR3Z1VwhwSziZBbWif+9yinjyzrkkSTeZpr63Ifivf73Wm7LvocHSf ZiUdjnvuHG89Q2Sj89OFdHYY1fQ/FztgoQmBXFPGQVB3uiB1rpVKbb+NTV+eZ83n4FTb BDyI4j3lKm3CbS0JUq0N/iTW3gO5jMcUyRMcCA9A2k2/EQq9L+OgzB1uJJd63e0iEicG uBYq4LGKR6gF/wBrv9BFXTbCC9f3cwWRZUqmJxF3ua2TGaom0xV9ypAFdzHzksT9W0mb 7rbA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:in-reply-to:content-disposition:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=B2uxy1bwNxSU4n2K73C/8k0RDLVwTozVSoB5orcja+U=; b=cExWmoAU9WBZJkL5A6APqr/9IpWFnTqdl3MM7HJeaNmBlsBIgjoCoIPSQlfSuusSvn GFdZOuQMqHVMOW2etHmm326XwPXwgZRzhJg5tuNXzoXTTOH3YbKZRJtdZeJaAlgvFHms gL8rEbcMxbgg8bxS102usbWEiKcwh6E8diMMncycKHRSPBYPh09NBPDxeJxZSzadC90d I6xUFqRx8NA3D0x+bhiScWjWXFGBs7zAs/OTe1tUcSNrEKSVifDinNA0P1lE4CXn8ELa KaZ62jHbcuuRPEaX/IpY5u0bMRz2bUO3TAGyK3m+CVx5jIIdJ8R/LoFWLM7AVQjw/cBp y4zg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@infradead.org header.s=casper.20170209 header.b=RNCajY9L; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id a2si6764183edy.86.2021.03.02.13.15.50; Tue, 02 Mar 2021 13:16:14 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@infradead.org header.s=casper.20170209 header.b=RNCajY9L; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1835934AbhCBJIt (ORCPT + 99 others); Tue, 2 Mar 2021 04:08:49 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50686 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1382106AbhCBIz4 (ORCPT ); Tue, 2 Mar 2021 03:55:56 -0500 Received: from casper.infradead.org (casper.infradead.org [IPv6:2001:8b0:10b:1236::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id E18B4C061756 for ; Tue, 2 Mar 2021 00:55:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=B2uxy1bwNxSU4n2K73C/8k0RDLVwTozVSoB5orcja+U=; b=RNCajY9Lj/jTQ3z+PlaeR9KoeE EzLWwamI7RjsGTrEEmGgmDAz0rrgqnOEhXAfT7aARIA4IHYByFM2ItLBw+E2oF6kyk7NdVqlreGrz m+YdWmmMCVmk+MT/34sIOayuS8fT87pjvr1vhE5wg/JtvOps/qnez9kb+78fkX8Rax3zUUHnI8qUP R74G0nyMNkaqA2gB7JQ4dhKS5kA+t2wf6aWuHrNS11Hv3tfoEQG6bXSMLPGHWCOzQwCEEBLEm8h9x eCa2uugkqw+KkZSOBomPPn4IEUZfbuZxEnGEMgZt6zgLYs95VNmSjQ5KVr7kmCSIHB8hSJZSBZBpG QWWa3inw==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=noisy.programming.kicks-ass.net) by casper.infradead.org with esmtpsa (Exim 4.94 #2 (Red Hat Linux)) id 1lH0nk-00GqPJ-Kt; Tue, 02 Mar 2021 08:54:46 +0000 Received: from hirez.programming.kicks-ass.net (hirez.programming.kicks-ass.net [192.168.1.225]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by noisy.programming.kicks-ass.net (Postfix) with ESMTPS id 9FF1F30011C; Tue, 2 Mar 2021 09:54:43 +0100 (CET) Received: by hirez.programming.kicks-ass.net (Postfix, from userid 1000) id 8B34B2BCE3622; Tue, 2 Mar 2021 09:54:43 +0100 (CET) Date: Tue, 2 Mar 2021 09:54:43 +0100 From: Peter Zijlstra To: Masami Hiramatsu Cc: Andy Lutomirski , Ingo Molnar , Oleg Nesterov , LKML , Anil S Keshavamurthy , "David S . Miller" , X86 ML , Andrew Cooper , Steven Rostedt Subject: Re: [RFC PATCH 1/1] x86/kprobes: Use int3 instead of debug trap for single-step Message-ID: References: <161460768474.430263.18425867006584111900.stgit@devnote2> <161460769556.430263.12936080446789384938.stgit@devnote2> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Mar 02, 2021 at 09:41:32AM +0100, Peter Zijlstra wrote: > Aside of a few nits: something like so.. --- a/arch/x86/kernel/kprobes/core.c +++ b/arch/x86/kernel/kprobes/core.c @@ -457,13 +457,20 @@ static void kprobe_emulate_call(struct k } NOKPROBE_SYMBOL(kprobe_emulate_call); -static void kprobe_emulate_jmp(struct kprobe *p, struct pt_regs *regs) +static __always_inline +void __kprobe_emulate_jmp(struct kprobe *p, struct pt_regs *regs, bool cond) { unsigned long ip = regs->ip - INT3_INSN_SIZE + p->ainsn.size; - ip += p->ainsn.rel32; + if (cond) + ip += p->ainsn.rel32; int3_emulate_jmp(regs, ip); } + +static void kprobe_emulate_jmp(struct kprobe *p, struct pt_regs *regs) +{ + __kprobe_emulate_jmp(p, regs, true); +} NOKPROBE_SYMBOL(kprobe_emulate_jmp); static const unsigned long jcc_mask[6] = { @@ -488,10 +495,7 @@ static void kprobe_emulate_jcc(struct kp if (p->ainsn.jcc.type >= 0xe) match = match && (regs->flags & X86_EFLAGS_ZF); } - if ((match && !invert) || (!match && invert)) - kprobe_emulate_jmp(p, regs); - else - regs->ip = regs->ip - INT3_INSN_SIZE + p->ainsn.size; + __kprobe_emulate_jmp(p, regs, (match && !invert) || (!match && invert)); } NOKPROBE_SYMBOL(kprobe_emulate_jcc); @@ -524,10 +528,7 @@ static void kprobe_emulate_loop(struct k else if (p->ainsn.loop.type == 1) /* LOOPE */ match = match && (regs->flags & X86_EFLAGS_ZF); - if (match) - kprobe_emulate_jmp(p, regs); - else - regs->ip = regs->ip - INT3_INSN_SIZE + p->ainsn.size; + __kprobe_emulate_jmp(p, regs, match); } NOKPROBE_SYMBOL(kprobe_emulate_loop); @@ -613,6 +614,12 @@ static int prepare_emulation(struct kpro else p->ainsn.rel32 = *(s32 *)&insn->immediate.value; break; + case 0x70 ... 0x7f: + /* 1 byte conditional jump */ + p->ainsn.emulate_op = kprobe_emulate_jcc; + p->ainsn.jcc.type = opcode & 0xf; + p->ainsn.rel32 = *(char *)insn->immediate.bytes; + break; case 0x0f: opcode = insn->opcode.bytes[1]; if ((opcode & 0xf0) == 0x80) { @@ -667,12 +674,7 @@ static int prepare_emulation(struct kpro #endif break; default: - if ((opcode & 0xf0) == 0x70) { - /* 1 byte conditional jump */ - p->ainsn.emulate_op = kprobe_emulate_jcc; - p->ainsn.jcc.type = opcode & 0xf; - p->ainsn.rel32 = *(char *)insn->immediate.bytes; - } + break; } p->ainsn.size = insn->length;