blob: 98cde99939d73f651bf6e7ae1b9f0a4722e083b0 [file] [log] [blame]
Changbin Du00b27da2018-02-17 13:39:40 +08001=========================================
2Uprobe-tracer: Uprobe-based Event Tracing
3=========================================
Anton Arapovdecc6bf2013-04-03 18:00:39 +02004
Changbin Du00b27da2018-02-17 13:39:40 +08005:Author: Srikar Dronamraju
Anton Arapovdecc6bf2013-04-03 18:00:39 +02006
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +05307
8Overview
9--------
10Uprobe based trace events are similar to kprobe based trace events.
Anton Blanchard6b0b7552017-02-16 17:00:50 +110011To enable this feature, build your kernel with CONFIG_UPROBE_EVENTS=y.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053012
13Similar to the kprobe-event tracer, this doesn't need to be activated via
14current_tracer. Instead of that, add probe points via
15/sys/kernel/debug/tracing/uprobe_events, and enable it via
Andreas Zieglere50891d2018-07-16 13:05:57 +020016/sys/kernel/debug/tracing/events/uprobes/<EVENT>/enable.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053017
18However unlike kprobe-event tracer, the uprobe event interface expects the
Anton Arapovdecc6bf2013-04-03 18:00:39 +020019user to calculate the offset of the probepoint in the object.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053020
Masami Hiramatsu0597c492018-11-05 18:03:04 +090021You can also use /sys/kernel/debug/tracing/dynamic_events instead of
22uprobe_events. That interface will provide unified access to other
23dynamic events too.
24
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053025Synopsis of uprobe_tracer
26-------------------------
Changbin Du00b27da2018-02-17 13:39:40 +080027::
28
Namhyung Kim306cfe22013-07-03 16:44:46 +090029 p[:[GRP/]EVENT] PATH:OFFSET [FETCHARGS] : Set a uprobe
30 r[:[GRP/]EVENT] PATH:OFFSET [FETCHARGS] : Set a return uprobe (uretprobe)
31 -:[GRP/]EVENT : Clear uprobe or uretprobe event
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053032
Anton Arapovdecc6bf2013-04-03 18:00:39 +020033 GRP : Group name. If omitted, "uprobes" is the default value.
34 EVENT : Event name. If omitted, the event name is generated based
Namhyung Kim306cfe22013-07-03 16:44:46 +090035 on PATH+OFFSET.
Anton Arapovdecc6bf2013-04-03 18:00:39 +020036 PATH : Path to an executable or a library.
Namhyung Kim306cfe22013-07-03 16:44:46 +090037 OFFSET : Offset where the probe is inserted.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053038
Anton Arapovdecc6bf2013-04-03 18:00:39 +020039 FETCHARGS : Arguments. Each probe can have up to 128 args.
40 %REG : Fetch register REG
Namhyung Kimb079d372013-07-03 18:34:23 +090041 @ADDR : Fetch memory at ADDR (ADDR should be in userspace)
Namhyung Kimb7e0bf32013-11-25 13:42:47 +090042 @+OFFSET : Fetch memory at OFFSET (OFFSET from same file as PATH)
Namhyung Kimb079d372013-07-03 18:34:23 +090043 $stackN : Fetch Nth entry of stack (N >= 0)
44 $stack : Fetch stack address.
Masami Hiramatsue65f7ae2019-05-15 14:38:42 +090045 $retval : Fetch return value.(\*1)
Omar Sandoval35abb672016-06-08 18:38:02 -070046 $comm : Fetch current task comm.
Masami Hiramatsue65f7ae2019-05-15 14:38:42 +090047 +|-[u]OFFS(FETCHARG) : Fetch memory at FETCHARG +|- OFFS address.(\*2)(\*3)
Masami Hiramatsu6218bf92019-06-20 00:08:27 +090048 \IMM : Store an immediate value to the argument.
Namhyung Kimb079d372013-07-03 18:34:23 +090049 NAME=FETCHARG : Set NAME as the argument name of FETCHARG.
50 FETCHARG:TYPE : Set TYPE as the type of FETCHARG. Currently, basic types
Masami Hiramatsu17ce3dc2016-08-18 17:57:50 +090051 (u8/u16/u32/u64/s8/s16/s32/s64), hexadecimal types
52 (x8/x16/x32/x64), "string" and bitfield are supported.
Namhyung Kimb079d372013-07-03 18:34:23 +090053
Masami Hiramatsue65f7ae2019-05-15 14:38:42 +090054 (\*1) only for return probe.
55 (\*2) this is useful for fetching a field of data structures.
56 (\*3) Unlike kprobe event, "u" prefix will just be ignored, becuse uprobe
57 events can access only user-space memory.
Namhyung Kimb079d372013-07-03 18:34:23 +090058
59Types
60-----
61Several types are supported for fetch-args. Uprobe tracer will access memory
62by given type. Prefix 's' and 'u' means those types are signed and unsigned
Masami Hiramatsubdca79c22016-08-18 17:59:21 +090063respectively. 'x' prefix implies it is unsigned. Traced arguments are shown
64in decimal ('s' and 'u') or hexadecimal ('x'). Without type casting, 'x32'
65or 'x64' is used depends on the architecture (e.g. x86-32 uses x32, and
66x86-64 uses x64).
Namhyung Kimb079d372013-07-03 18:34:23 +090067String type is a special type, which fetches a "null-terminated" string from
68user space.
69Bitfield is another special type, which takes 3 parameters, bit-width, bit-
Changbin Du00b27da2018-02-17 13:39:40 +080070offset, and container-size (usually 32). The syntax is::
Namhyung Kimb079d372013-07-03 18:34:23 +090071
72 b<bit-width>@<bit-offset>/<container-size>
73
Omar Sandoval35abb672016-06-08 18:38:02 -070074For $comm, the default type is "string"; any other type is invalid.
75
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053076
77Event Profiling
78---------------
Srikar Dronamrajub6892692019-02-19 11:49:28 +053079You can check the total number of probe hits per event via
80/sys/kernel/debug/tracing/uprobe_profile. The first column is the filename,
81the second is the event name, the third is the number of probe hits.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053082
83Usage examples
84--------------
Anton Arapovdecc6bf2013-04-03 18:00:39 +020085 * Add a probe as a new uprobe event, write a new definition to uprobe_events
Changbin Du00b27da2018-02-17 13:39:40 +080086 as below (sets a uprobe at an offset of 0x4245c0 in the executable /bin/bash)::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053087
Marcin Nowakowski70587632016-10-06 09:52:12 +020088 echo 'p /bin/bash:0x4245c0' > /sys/kernel/debug/tracing/uprobe_events
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053089
Changbin Du00b27da2018-02-17 13:39:40 +080090 * Add a probe as a new uretprobe event::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053091
Marcin Nowakowski70587632016-10-06 09:52:12 +020092 echo 'r /bin/bash:0x4245c0' > /sys/kernel/debug/tracing/uprobe_events
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053093
Changbin Du00b27da2018-02-17 13:39:40 +080094 * Unset registered event::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053095
Marcin Nowakowski70587632016-10-06 09:52:12 +020096 echo '-:p_bash_0x4245c0' >> /sys/kernel/debug/tracing/uprobe_events
Anton Arapovdecc6bf2013-04-03 18:00:39 +020097
Changbin Du00b27da2018-02-17 13:39:40 +080098 * Print out the events that are registered::
Anton Arapovdecc6bf2013-04-03 18:00:39 +020099
100 cat /sys/kernel/debug/tracing/uprobe_events
101
Changbin Du00b27da2018-02-17 13:39:40 +0800102 * Clear all events::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200103
104 echo > /sys/kernel/debug/tracing/uprobe_events
105
106Following example shows how to dump the instruction pointer and %ax register
Changbin Du00b27da2018-02-17 13:39:40 +0800107at the probed text address. Probe zfree function in /bin/zsh::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530108
109 # cd /sys/kernel/debug/tracing/
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200110 # cat /proc/`pgrep zsh`/maps | grep /bin/zsh | grep r-xp
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530111 00400000-0048a000 r-xp 00000000 08:03 130904 /bin/zsh
112 # objdump -T /bin/zsh | grep -w zfree
113 0000000000446420 g DF .text 0000000000000012 Base zfree
114
Changbin Du00b27da2018-02-17 13:39:40 +08001150x46420 is the offset of zfree in object /bin/zsh that is loaded at
1160x00400000. Hence the command to uprobe would be::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530117
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200118 # echo 'p:zfree_entry /bin/zsh:0x46420 %ip %ax' > uprobe_events
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530119
Changbin Du00b27da2018-02-17 13:39:40 +0800120And the same for the uretprobe would be::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200121
122 # echo 'r:zfree_exit /bin/zsh:0x46420 %ip %ax' >> uprobe_events
123
Changbin Du00b27da2018-02-17 13:39:40 +0800124.. note:: User has to explicitly calculate the offset of the probe-point
125 in the object.
126
127We can see the events that are registered by looking at the uprobe_events file.
128::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530129
130 # cat uprobe_events
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200131 p:uprobes/zfree_entry /bin/zsh:0x00046420 arg1=%ip arg2=%ax
132 r:uprobes/zfree_exit /bin/zsh:0x00046420 arg1=%ip arg2=%ax
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530133
Changbin Du00b27da2018-02-17 13:39:40 +0800134Format of events can be seen by viewing the file events/uprobes/zfree_entry/format.
135::
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530136
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200137 # cat events/uprobes/zfree_entry/format
138 name: zfree_entry
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530139 ID: 922
140 format:
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200141 field:unsigned short common_type; offset:0; size:2; signed:0;
142 field:unsigned char common_flags; offset:2; size:1; signed:0;
143 field:unsigned char common_preempt_count; offset:3; size:1; signed:0;
144 field:int common_pid; offset:4; size:4; signed:1;
145 field:int common_padding; offset:8; size:4; signed:1;
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530146
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200147 field:unsigned long __probe_ip; offset:12; size:4; signed:0;
148 field:u32 arg1; offset:16; size:4; signed:0;
149 field:u32 arg2; offset:20; size:4; signed:0;
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530150
151 print fmt: "(%lx) arg1=%lx arg2=%lx", REC->__probe_ip, REC->arg1, REC->arg2
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530152
153Right after definition, each event is disabled by default. For tracing these
Changbin Du00b27da2018-02-17 13:39:40 +0800154events, you need to enable it by::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530155
156 # echo 1 > events/uprobes/enable
157
Lecopzer Chen78a89462019-05-09 18:31:16 +0800158Lets start tracing, sleep for some time and stop tracing.
Changbin Du00b27da2018-02-17 13:39:40 +0800159::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200160
Lecopzer Chen78a89462019-05-09 18:31:16 +0800161 # echo 1 > tracing_on
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530162 # sleep 20
Lecopzer Chen78a89462019-05-09 18:31:16 +0800163 # echo 0 > tracing_on
164
165Also, you can disable the event by::
166
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530167 # echo 0 > events/uprobes/enable
168
169And you can see the traced information via /sys/kernel/debug/tracing/trace.
Changbin Du00b27da2018-02-17 13:39:40 +0800170::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530171
172 # cat trace
173 # tracer: nop
174 #
175 # TASK-PID CPU# TIMESTAMP FUNCTION
176 # | | | | |
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200177 zsh-24842 [006] 258544.995456: zfree_entry: (0x446420) arg1=446420 arg2=79
178 zsh-24842 [007] 258545.000270: zfree_exit: (0x446540 <- 0x446420) arg1=446540 arg2=0
179 zsh-24842 [002] 258545.043929: zfree_entry: (0x446420) arg1=446420 arg2=79
180 zsh-24842 [004] 258547.046129: zfree_exit: (0x446540 <- 0x446420) arg1=446540 arg2=0
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530181
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200182Output shows us uprobe was triggered for a pid 24842 with ip being 0x446420
183and contents of ax register being 79. And uretprobe was triggered with ip at
1840x446540 with counterpart function entry at 0x446420.