Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757303Ab1DAOmS (ORCPT ); Fri, 1 Apr 2011 10:42:18 -0400 Received: from e23smtp07.au.ibm.com ([202.81.31.140]:48285 "EHLO e23smtp07.au.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751434Ab1DAOmQ (ORCPT ); Fri, 1 Apr 2011 10:42:16 -0400 From: Srikar Dronamraju To: Peter Zijlstra , Ingo Molnar Cc: Steven Rostedt , Srikar Dronamraju , Linux-mm , Arnaldo Carvalho de Melo , Linus Torvalds , Jonathan Corbet , Masami Hiramatsu , Christoph Hellwig , Ananth N Mavinakayanahalli , Thomas Gleixner , Andi Kleen , Oleg Nesterov , Andrew Morton , Jim Keniston , Roland McGrath , SystemTap , LKML Date: Fri, 01 Apr 2011 20:02:23 +0530 Message-Id: <20110401143223.15455.19844.sendpatchset@localhost6.localdomain6> Subject: [PATCH v3 2.6.39-rc1-tip 0/26] 0: Uprobes patchset with perf probe support Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 7552 Lines: 164 This patchset implements Uprobes which enables you to dynamically break into any routine in a user space application and collect information non-disruptively. This patchset resolves most of the comments on the previous posting http://lkml.org/lkml/2011/3/14/171/. It also adds perf probe support for user space tracing. This patchset applies on top of tip commit acf359c95697. Uprobes Patches This patchset implements inode based uprobes which are specified as : where offset is the offset from start of the map. The probehit overhead is around 3X times the overhead from pid based patchset. When a uprobe is registered, Uprobes makes a copy of the probed instruction, replaces the first byte(s) of the probed instruction with a breakpoint instruction. (Uprobes uses background page replacement mechanism and ensures that the breakpoint affects only that process.) When a CPU hits the breakpoint instruction, Uprobes gets notified of trap and finds the associated uprobe. It then executes the associated handler. Uprobes single-steps its copy of the probed instruction and resumes execution of the probed process at the instruction following the probepoint. Instruction copies to be single-stepped are stored in a per-mm "execution out of line (XOL) area". Currently XOL area is allocated as one page vma. For previous postings: please refer: http://lkml.org/lkml/2010/12/16/65 http://lkml.org/lkml/2010/8/25/165 http://lkml.org/lkml/2010/7/27/121 http://lkml.org/lkml/2010/7/12/67 http://lkml.org/lkml/2010/7/8/239 http://lkml.org/lkml/2010/6/29/299 http://lkml.org/lkml/2010/6/14/41 http://lkml.org/lkml/2010/3/20/107 and http://lkml.org/lkml/2010/5/18/307 This patchset is a rework based on suggestions from discussions on lkml in September, March and January 2010 (http://lkml.org/lkml/2010/1/11/92, http://lkml.org/lkml/2010/1/27/19, http://lkml.org/lkml/2010/3/20/107 and http://lkml.org/lkml/2010/3/31/199 ). This implementation of uprobes doesnt depend on utrace. Advantages of uprobes over conventional debugging include: 1. Non-disruptive. Unlike current ptrace based mechanisms, uprobes tracing wouldnt involve signals, stopping threads and context switching between the tracer and tracee. 2. Much better handling of multithreaded programs because of XOL. Current ptrace based mechanisms use single stepping inline, i.e they copy back the original instruction on hitting a breakpoint. In such mechanisms tracers have to stop all the threads on a breakpoint hit or tracers will not be able to handle all hits to the location of interest. Uprobes uses execution out of line, where the instruction to be traced is analysed at the time of breakpoint insertion and a copy of instruction is stored at a different location. On breakpoint hit, uprobes jumps to that copied location and singlesteps the same instruction and does the necessary fixups post singlestepping. 3. Multiple tracers for an application. Multiple uprobes based tracer could work in unison to trace an application. There could one tracer that could be interested in generic events for a particular set of process. While there could be another tracer that is just interested in one specific event of a particular process thats part of the previous set of process. 4. Corelating events from kernels and userspace. Uprobes could be used with other tools like kprobes, tracepoints or as part of higher level tools like perf to give a consolidated set of events from kernel and userspace. In future we could look at a single backtrace showing application, library and kernel calls. Here is the list of TODO Items. - Breakpoint handling should co-exist with singlestep/blockstep from another tracer/debugger. - Queue and dequeue signals delivered from the singlestep till completion of postprocessing. - Prefiltering (i.e filtering at the time of probe insertion) - Return probes. - Support for other architectures. - Uprobes booster. - replace macro W with bits in inat table. To try please fetch using git fetch \ git://git.kernel.org/pub/scm/linux/kernel/git/srikar/linux-uprobes.git \ tip_inode_uprobes_010411:tip_inode_uprobes Please refer "[RFC] [PATCH 2.6.37-rc5-tip 20/20] 20: tracing: uprobes trace_event infrastructure" on how to use uprobe_tracer. Please do provide your valuable comments. Thanks in advance. Srikar Srikar Dronamraju(26) 0: Uprobes patchset with perf probe support 1: mm: replace_page() loses static attribute 2: mm: Move replace_page() to mm/memory.c 3: X86 specific breakpoint definitions. 4: uprobes: Breakground page replacement. 5: uprobes: Adding and remove a uprobe in a rb tree. 6: Uprobes: register/unregister probes. 7: x86: analyze instruction and determine fixups. 8: uprobes: store/restore original instruction. 9: uprobes: mmap and fork hooks. 10: x86: architecture specific task information. 11: uprobes: task specific information. 12: uprobes: slot allocation for uprobes 13: uprobes: get the breakpoint address. 14: x86: x86 specific probe handling 15: uprobes: Handing int3 and singlestep exception. 16: x86: uprobes exception notifier for x86. 17: uprobes: register a notifier for uprobes. 18: uprobes: commonly used filters. 19: tracing: Extract out common code for kprobes/uprobes traceevents. 20: tracing: uprobes trace_event interface 21: Signed-off-by: Srikar Dronamraju 22: perf: rename target_module to target 23: perf: show possible probes in a given executable file or library. 24: perf: perf interface for uprobes 25: perf: Documentation for perf uprobes 26: uprobes: filter chain Documentation/trace/uprobetrace.txt | 94 ++ arch/Kconfig | 4 + arch/x86/Kconfig | 3 + arch/x86/include/asm/thread_info.h | 2 + arch/x86/include/asm/uprobes.h | 55 ++ arch/x86/kernel/Makefile | 1 + arch/x86/kernel/signal.c | 14 + arch/x86/kernel/uprobes.c | 614 +++++++++++++ include/linux/mm.h | 2 + include/linux/mm_types.h | 9 + include/linux/sched.h | 3 + include/linux/uprobes.h | 197 ++++ kernel/Makefile | 1 + kernel/fork.c | 10 + kernel/trace/Kconfig | 20 + kernel/trace/Makefile | 2 + kernel/trace/trace.h | 5 + kernel/trace/trace_kprobe.c | 861 +------------------ kernel/trace/trace_probe.c | 753 ++++++++++++++++ kernel/trace/trace_probe.h | 160 ++++ kernel/trace/trace_uprobe.c | 803 +++++++++++++++++ kernel/uprobes.c | 1474 +++++++++++++++++++++++++++++++ mm/ksm.c | 62 -- mm/memory.c | 62 ++ mm/mmap.c | 6 + tools/perf/Documentation/perf-probe.txt | 21 +- tools/perf/builtin-probe.c | 26 +- tools/perf/util/probe-event.c | 431 ++++++++-- tools/perf/util/probe-event.h | 12 +- tools/perf/util/symbol.c | 8 + tools/perf/util/symbol.h | 1 + 31 files changed, 4714 insertions(+), 1002 deletions(-) -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/