blob: a8e5938f609e29b35a1dce1e5722f976339340d7 [file] [log] [blame]
Changbin Du00b27da2018-02-17 13:39:40 +08001=========================================
2Uprobe-tracer: Uprobe-based Event Tracing
3=========================================
Anton Arapovdecc6bf2013-04-03 18:00:39 +02004
Changbin Du00b27da2018-02-17 13:39:40 +08005:Author: Srikar Dronamraju
Anton Arapovdecc6bf2013-04-03 18:00:39 +02006
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +05307
8Overview
9--------
10Uprobe based trace events are similar to kprobe based trace events.
Anton Blanchard6b0b7552017-02-16 17:00:50 +110011To enable this feature, build your kernel with CONFIG_UPROBE_EVENTS=y.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053012
13Similar to the kprobe-event tracer, this doesn't need to be activated via
14current_tracer. Instead of that, add probe points via
15/sys/kernel/debug/tracing/uprobe_events, and enable it via
Andreas Zieglere50891d2018-07-16 13:05:57 +020016/sys/kernel/debug/tracing/events/uprobes/<EVENT>/enable.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053017
18However unlike kprobe-event tracer, the uprobe event interface expects the
Anton Arapovdecc6bf2013-04-03 18:00:39 +020019user to calculate the offset of the probepoint in the object.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053020
Masami Hiramatsu0597c492018-11-05 18:03:04 +090021You can also use /sys/kernel/debug/tracing/dynamic_events instead of
22uprobe_events. That interface will provide unified access to other
23dynamic events too.
24
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053025Synopsis of uprobe_tracer
26-------------------------
Changbin Du00b27da2018-02-17 13:39:40 +080027::
28
Namhyung Kim306cfe22013-07-03 16:44:46 +090029 p[:[GRP/]EVENT] PATH:OFFSET [FETCHARGS] : Set a uprobe
30 r[:[GRP/]EVENT] PATH:OFFSET [FETCHARGS] : Set a return uprobe (uretprobe)
Masami Hiramatsu638e4762020-09-10 17:55:56 +090031 p[:[GRP/]EVENT] PATH:OFFSET%return [FETCHARGS] : Set a return uprobe (uretprobe)
Namhyung Kim306cfe22013-07-03 16:44:46 +090032 -:[GRP/]EVENT : Clear uprobe or uretprobe event
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053033
Anton Arapovdecc6bf2013-04-03 18:00:39 +020034 GRP : Group name. If omitted, "uprobes" is the default value.
35 EVENT : Event name. If omitted, the event name is generated based
Namhyung Kim306cfe22013-07-03 16:44:46 +090036 on PATH+OFFSET.
Anton Arapovdecc6bf2013-04-03 18:00:39 +020037 PATH : Path to an executable or a library.
Namhyung Kim306cfe22013-07-03 16:44:46 +090038 OFFSET : Offset where the probe is inserted.
Masami Hiramatsu638e4762020-09-10 17:55:56 +090039 OFFSET%return : Offset where the return probe is inserted.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053040
Anton Arapovdecc6bf2013-04-03 18:00:39 +020041 FETCHARGS : Arguments. Each probe can have up to 128 args.
42 %REG : Fetch register REG
Namhyung Kimb079d372013-07-03 18:34:23 +090043 @ADDR : Fetch memory at ADDR (ADDR should be in userspace)
Namhyung Kimb7e0bf32013-11-25 13:42:47 +090044 @+OFFSET : Fetch memory at OFFSET (OFFSET from same file as PATH)
Namhyung Kimb079d372013-07-03 18:34:23 +090045 $stackN : Fetch Nth entry of stack (N >= 0)
46 $stack : Fetch stack address.
Masami Hiramatsue65f7ae2019-05-15 14:38:42 +090047 $retval : Fetch return value.(\*1)
Omar Sandoval35abb672016-06-08 18:38:02 -070048 $comm : Fetch current task comm.
Masami Hiramatsue65f7ae2019-05-15 14:38:42 +090049 +|-[u]OFFS(FETCHARG) : Fetch memory at FETCHARG +|- OFFS address.(\*2)(\*3)
Masami Hiramatsu6218bf92019-06-20 00:08:27 +090050 \IMM : Store an immediate value to the argument.
Namhyung Kimb079d372013-07-03 18:34:23 +090051 NAME=FETCHARG : Set NAME as the argument name of FETCHARG.
52 FETCHARG:TYPE : Set TYPE as the type of FETCHARG. Currently, basic types
Masami Hiramatsu17ce3dc2016-08-18 17:57:50 +090053 (u8/u16/u32/u64/s8/s16/s32/s64), hexadecimal types
54 (x8/x16/x32/x64), "string" and bitfield are supported.
Namhyung Kimb079d372013-07-03 18:34:23 +090055
Masami Hiramatsue65f7ae2019-05-15 14:38:42 +090056 (\*1) only for return probe.
57 (\*2) this is useful for fetching a field of data structures.
58 (\*3) Unlike kprobe event, "u" prefix will just be ignored, becuse uprobe
59 events can access only user-space memory.
Namhyung Kimb079d372013-07-03 18:34:23 +090060
61Types
62-----
63Several types are supported for fetch-args. Uprobe tracer will access memory
64by given type. Prefix 's' and 'u' means those types are signed and unsigned
Masami Hiramatsubdca79c22016-08-18 17:59:21 +090065respectively. 'x' prefix implies it is unsigned. Traced arguments are shown
66in decimal ('s' and 'u') or hexadecimal ('x'). Without type casting, 'x32'
67or 'x64' is used depends on the architecture (e.g. x86-32 uses x32, and
68x86-64 uses x64).
Namhyung Kimb079d372013-07-03 18:34:23 +090069String type is a special type, which fetches a "null-terminated" string from
70user space.
71Bitfield is another special type, which takes 3 parameters, bit-width, bit-
Changbin Du00b27da2018-02-17 13:39:40 +080072offset, and container-size (usually 32). The syntax is::
Namhyung Kimb079d372013-07-03 18:34:23 +090073
74 b<bit-width>@<bit-offset>/<container-size>
75
Omar Sandoval35abb672016-06-08 18:38:02 -070076For $comm, the default type is "string"; any other type is invalid.
77
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053078
79Event Profiling
80---------------
Srikar Dronamrajub6892692019-02-19 11:49:28 +053081You can check the total number of probe hits per event via
82/sys/kernel/debug/tracing/uprobe_profile. The first column is the filename,
83the second is the event name, the third is the number of probe hits.
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053084
85Usage examples
86--------------
Anton Arapovdecc6bf2013-04-03 18:00:39 +020087 * Add a probe as a new uprobe event, write a new definition to uprobe_events
Changbin Du00b27da2018-02-17 13:39:40 +080088 as below (sets a uprobe at an offset of 0x4245c0 in the executable /bin/bash)::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053089
Marcin Nowakowski70587632016-10-06 09:52:12 +020090 echo 'p /bin/bash:0x4245c0' > /sys/kernel/debug/tracing/uprobe_events
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053091
Changbin Du00b27da2018-02-17 13:39:40 +080092 * Add a probe as a new uretprobe event::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053093
Marcin Nowakowski70587632016-10-06 09:52:12 +020094 echo 'r /bin/bash:0x4245c0' > /sys/kernel/debug/tracing/uprobe_events
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053095
Changbin Du00b27da2018-02-17 13:39:40 +080096 * Unset registered event::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +053097
Marcin Nowakowski70587632016-10-06 09:52:12 +020098 echo '-:p_bash_0x4245c0' >> /sys/kernel/debug/tracing/uprobe_events
Anton Arapovdecc6bf2013-04-03 18:00:39 +020099
Changbin Du00b27da2018-02-17 13:39:40 +0800100 * Print out the events that are registered::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200101
102 cat /sys/kernel/debug/tracing/uprobe_events
103
Changbin Du00b27da2018-02-17 13:39:40 +0800104 * Clear all events::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200105
106 echo > /sys/kernel/debug/tracing/uprobe_events
107
108Following example shows how to dump the instruction pointer and %ax register
Changbin Du00b27da2018-02-17 13:39:40 +0800109at the probed text address. Probe zfree function in /bin/zsh::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530110
111 # cd /sys/kernel/debug/tracing/
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200112 # cat /proc/`pgrep zsh`/maps | grep /bin/zsh | grep r-xp
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530113 00400000-0048a000 r-xp 00000000 08:03 130904 /bin/zsh
114 # objdump -T /bin/zsh | grep -w zfree
115 0000000000446420 g DF .text 0000000000000012 Base zfree
116
Changbin Du00b27da2018-02-17 13:39:40 +08001170x46420 is the offset of zfree in object /bin/zsh that is loaded at
1180x00400000. Hence the command to uprobe would be::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530119
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200120 # echo 'p:zfree_entry /bin/zsh:0x46420 %ip %ax' > uprobe_events
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530121
Changbin Du00b27da2018-02-17 13:39:40 +0800122And the same for the uretprobe would be::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200123
124 # echo 'r:zfree_exit /bin/zsh:0x46420 %ip %ax' >> uprobe_events
125
Changbin Du00b27da2018-02-17 13:39:40 +0800126.. note:: User has to explicitly calculate the offset of the probe-point
127 in the object.
128
129We can see the events that are registered by looking at the uprobe_events file.
130::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530131
132 # cat uprobe_events
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200133 p:uprobes/zfree_entry /bin/zsh:0x00046420 arg1=%ip arg2=%ax
134 r:uprobes/zfree_exit /bin/zsh:0x00046420 arg1=%ip arg2=%ax
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530135
Changbin Du00b27da2018-02-17 13:39:40 +0800136Format of events can be seen by viewing the file events/uprobes/zfree_entry/format.
137::
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530138
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200139 # cat events/uprobes/zfree_entry/format
140 name: zfree_entry
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530141 ID: 922
142 format:
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200143 field:unsigned short common_type; offset:0; size:2; signed:0;
144 field:unsigned char common_flags; offset:2; size:1; signed:0;
145 field:unsigned char common_preempt_count; offset:3; size:1; signed:0;
146 field:int common_pid; offset:4; size:4; signed:1;
147 field:int common_padding; offset:8; size:4; signed:1;
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530148
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200149 field:unsigned long __probe_ip; offset:12; size:4; signed:0;
150 field:u32 arg1; offset:16; size:4; signed:0;
151 field:u32 arg2; offset:20; size:4; signed:0;
Srikar Dronamrajuec83db02012-05-08 16:41:26 +0530152
153 print fmt: "(%lx) arg1=%lx arg2=%lx", REC->__probe_ip, REC->arg1, REC->arg2
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530154
155Right after definition, each event is disabled by default. For tracing these
Changbin Du00b27da2018-02-17 13:39:40 +0800156events, you need to enable it by::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530157
158 # echo 1 > events/uprobes/enable
159
Lecopzer Chen78a89462019-05-09 18:31:16 +0800160Lets start tracing, sleep for some time and stop tracing.
Changbin Du00b27da2018-02-17 13:39:40 +0800161::
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200162
Lecopzer Chen78a89462019-05-09 18:31:16 +0800163 # echo 1 > tracing_on
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530164 # sleep 20
Lecopzer Chen78a89462019-05-09 18:31:16 +0800165 # echo 0 > tracing_on
166
167Also, you can disable the event by::
168
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530169 # echo 0 > events/uprobes/enable
170
171And you can see the traced information via /sys/kernel/debug/tracing/trace.
Changbin Du00b27da2018-02-17 13:39:40 +0800172::
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530173
174 # cat trace
175 # tracer: nop
176 #
177 # TASK-PID CPU# TIMESTAMP FUNCTION
178 # | | | | |
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200179 zsh-24842 [006] 258544.995456: zfree_entry: (0x446420) arg1=446420 arg2=79
180 zsh-24842 [007] 258545.000270: zfree_exit: (0x446540 <- 0x446420) arg1=446540 arg2=0
181 zsh-24842 [002] 258545.043929: zfree_entry: (0x446420) arg1=446420 arg2=79
182 zsh-24842 [004] 258547.046129: zfree_exit: (0x446540 <- 0x446420) arg1=446540 arg2=0
Srikar Dronamrajuf3f096c2012-04-11 16:00:43 +0530183
Anton Arapovdecc6bf2013-04-03 18:00:39 +0200184Output shows us uprobe was triggered for a pid 24842 with ip being 0x446420
185and contents of ax register being 79. And uretprobe was triggered with ip at
1860x446540 with counterpart function entry at 0x446420.