Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 1 | # SPDX-License-Identifier: GPL-2.0-only |
| 2 | |
| 3 | config HAVE_ARCH_KCSAN |
| 4 | bool |
| 5 | |
Marco Elver | 0e1aa5b | 2020-05-21 16:20:42 +0200 | [diff] [blame] | 6 | config HAVE_KCSAN_COMPILER |
Marco Elver | e68dcd8 | 2020-06-18 11:31:16 +0200 | [diff] [blame] | 7 | def_bool (CC_IS_CLANG && $(cc-option,-fsanitize=thread -mllvm -tsan-distinguish-volatile=1)) || \ |
| 8 | (CC_IS_GCC && $(cc-option,-fsanitize=thread --param tsan-distinguish-volatile=1)) |
Marco Elver | 0e1aa5b | 2020-05-21 16:20:42 +0200 | [diff] [blame] | 9 | help |
| 10 | For the list of compilers that support KCSAN, please see |
| 11 | <file:Documentation/dev-tools/kcsan.rst>. |
| 12 | |
Arnd Bergmann | ea91a1d | 2020-05-21 16:20:37 +0200 | [diff] [blame] | 13 | config KCSAN_KCOV_BROKEN |
| 14 | def_bool KCOV && CC_HAS_SANCOV_TRACE_PC |
| 15 | depends on CC_IS_CLANG |
| 16 | depends on !$(cc-option,-Werror=unused-command-line-argument -fsanitize=thread -fsanitize-coverage=trace-pc) |
| 17 | help |
| 18 | Some versions of clang support either KCSAN and KCOV but not the |
| 19 | combination of the two. |
| 20 | See https://bugs.llvm.org/show_bug.cgi?id=45831 for the status |
| 21 | in newer releases. |
| 22 | |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 23 | menuconfig KCSAN |
Ingo Molnar | eba9c44 | 2020-04-13 11:03:05 +0200 | [diff] [blame] | 24 | bool "KCSAN: dynamic data race detector" |
Marco Elver | 0e1aa5b | 2020-05-21 16:20:42 +0200 | [diff] [blame] | 25 | depends on HAVE_ARCH_KCSAN && HAVE_KCSAN_COMPILER |
| 26 | depends on DEBUG_KERNEL && !KASAN |
Arnd Bergmann | ea91a1d | 2020-05-21 16:20:37 +0200 | [diff] [blame] | 27 | depends on !KCSAN_KCOV_BROKEN |
Marco Elver | 8cfbb04 | 2020-02-04 18:21:12 +0100 | [diff] [blame] | 28 | select STACKTRACE |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 29 | help |
Ingo Molnar | eba9c44 | 2020-04-13 11:03:05 +0200 | [diff] [blame] | 30 | The Kernel Concurrency Sanitizer (KCSAN) is a dynamic |
| 31 | data-race detector that relies on compile-time instrumentation. |
| 32 | KCSAN uses a watchpoint-based sampling approach to detect races. |
Marco Elver | d591ec3 | 2020-02-06 16:46:24 +0100 | [diff] [blame] | 33 | |
Ingo Molnar | eba9c44 | 2020-04-13 11:03:05 +0200 | [diff] [blame] | 34 | While KCSAN's primary purpose is to detect data races, it |
| 35 | also provides assertions to check data access constraints. |
| 36 | These assertions can expose bugs that do not manifest as |
| 37 | data races. |
Marco Elver | 8cfbb04 | 2020-02-04 18:21:12 +0100 | [diff] [blame] | 38 | |
| 39 | See <file:Documentation/dev-tools/kcsan.rst> for more details. |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 40 | |
| 41 | if KCSAN |
| 42 | |
Marco Elver | bec4a24 | 2020-07-24 09:00:05 +0200 | [diff] [blame] | 43 | config CC_HAS_TSAN_COMPOUND_READ_BEFORE_WRITE |
| 44 | def_bool (CC_IS_CLANG && $(cc-option,-fsanitize=thread -mllvm -tsan-compound-read-before-write=1)) || \ |
| 45 | (CC_IS_GCC && $(cc-option,-fsanitize=thread --param tsan-compound-read-before-write=1)) |
Marco Elver | eb32f9f | 2021-06-07 14:56:47 +0200 | [diff] [blame] | 46 | help |
| 47 | The compiler instruments plain compound read-write operations |
| 48 | differently (++, --, +=, -=, |=, &=, etc.), which allows KCSAN to |
| 49 | distinguish them from other plain accesses. This is currently |
| 50 | supported by Clang 12 or later. |
Marco Elver | bec4a24 | 2020-07-24 09:00:05 +0200 | [diff] [blame] | 51 | |
Marco Elver | 2402d0e | 2020-02-22 00:10:27 +0100 | [diff] [blame] | 52 | config KCSAN_VERBOSE |
| 53 | bool "Show verbose reports with more information about system state" |
| 54 | depends on PROVE_LOCKING |
| 55 | help |
| 56 | If enabled, reports show more information about the system state that |
| 57 | may help better analyze and debug races. This includes held locks and |
| 58 | IRQ trace events. |
| 59 | |
| 60 | While this option should generally be benign, we call into more |
| 61 | external functions on report generation; if a race report is |
| 62 | generated from any one of them, system stability may suffer due to |
| 63 | deadlocks or recursion. If in doubt, say N. |
| 64 | |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 65 | config KCSAN_SELFTEST |
| 66 | bool "Perform short selftests on boot" |
| 67 | default y |
| 68 | help |
Marco Elver | 1fe84fd | 2020-05-05 20:28:21 +0200 | [diff] [blame] | 69 | Run KCSAN selftests on boot. On test failure, causes the kernel to |
| 70 | panic. Recommended to be enabled, ensuring critical functionality |
| 71 | works as intended. |
| 72 | |
Marco Elver | a146fed | 2021-01-13 17:05:56 +0100 | [diff] [blame] | 73 | config KCSAN_KUNIT_TEST |
| 74 | tristate "KCSAN test for integrated runtime behaviour" if !KUNIT_ALL_TESTS |
| 75 | default KUNIT_ALL_TESTS |
Marco Elver | 1fe84fd | 2020-05-05 20:28:21 +0200 | [diff] [blame] | 76 | depends on TRACEPOINTS && KUNIT |
| 77 | select TORTURE_TEST |
| 78 | help |
| 79 | KCSAN test focusing on behaviour of the integrated runtime. Tests |
| 80 | various race scenarios, and verifies the reports generated to |
| 81 | console. Makes use of KUnit for test organization, and the Torture |
| 82 | framework for test thread control. |
| 83 | |
| 84 | Each test case may run at least up to KCSAN_REPORT_ONCE_IN_MS |
| 85 | milliseconds. Test run duration may be optimized by building the |
| 86 | kernel and KCSAN test with KCSAN_REPORT_ONCE_IN_MS set to a lower |
| 87 | than default value. |
| 88 | |
| 89 | Say Y here if you want the test to be built into the kernel and run |
| 90 | during boot; say M if you want the test to build as a module; say N |
| 91 | if you are unsure. |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 92 | |
| 93 | config KCSAN_EARLY_ENABLE |
| 94 | bool "Early enable during boot" |
| 95 | default y |
| 96 | help |
| 97 | If KCSAN should be enabled globally as soon as possible. KCSAN can |
| 98 | later be enabled/disabled via debugfs. |
| 99 | |
| 100 | config KCSAN_NUM_WATCHPOINTS |
| 101 | int "Number of available watchpoints" |
| 102 | default 64 |
| 103 | help |
| 104 | Total number of available watchpoints. An address range maps into a |
| 105 | specific watchpoint slot as specified in kernel/kcsan/encoding.h. |
| 106 | Although larger number of watchpoints may not be usable due to |
| 107 | limited number of CPUs, a larger value helps to improve performance |
| 108 | due to reducing cache-line contention. The chosen default is a |
| 109 | conservative value; we should almost never observe "no_capacity" |
| 110 | events (see /sys/kernel/debug/kcsan). |
| 111 | |
| 112 | config KCSAN_UDELAY_TASK |
| 113 | int "Delay in microseconds (for tasks)" |
| 114 | default 80 |
| 115 | help |
| 116 | For tasks, the microsecond delay after setting up a watchpoint. |
| 117 | |
| 118 | config KCSAN_UDELAY_INTERRUPT |
| 119 | int "Delay in microseconds (for interrupts)" |
| 120 | default 20 |
| 121 | help |
| 122 | For interrupts, the microsecond delay after setting up a watchpoint. |
| 123 | Interrupts have tighter latency requirements, and their delay should |
| 124 | be lower than for tasks. |
| 125 | |
| 126 | config KCSAN_DELAY_RANDOMIZE |
| 127 | bool "Randomize above delays" |
| 128 | default y |
| 129 | help |
| 130 | If delays should be randomized, where the maximum is KCSAN_UDELAY_*. |
Ingo Molnar | 5cbaefe | 2019-11-20 10:41:43 +0100 | [diff] [blame] | 131 | If false, the chosen delays are always the KCSAN_UDELAY_* values |
| 132 | as defined above. |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 133 | |
| 134 | config KCSAN_SKIP_WATCH |
| 135 | int "Skip instructions before setting up watchpoint" |
| 136 | default 4000 |
| 137 | help |
| 138 | The number of per-CPU memory operations to skip, before another |
| 139 | watchpoint is set up, i.e. one in KCSAN_WATCH_SKIP per-CPU |
| 140 | memory operations are used to set up a watchpoint. A smaller value |
| 141 | results in more aggressive race detection, whereas a larger value |
| 142 | improves system performance at the cost of missing some races. |
| 143 | |
| 144 | config KCSAN_SKIP_WATCH_RANDOMIZE |
| 145 | bool "Randomize watchpoint instruction skip count" |
| 146 | default y |
| 147 | help |
| 148 | If instruction skip count should be randomized, where the maximum is |
| 149 | KCSAN_WATCH_SKIP. If false, the chosen value is always |
| 150 | KCSAN_WATCH_SKIP. |
| 151 | |
Marco Elver | 48b1fc1 | 2020-02-21 23:02:09 +0100 | [diff] [blame] | 152 | config KCSAN_INTERRUPT_WATCHER |
Marco Elver | e049380 | 2021-06-15 20:39:38 +0200 | [diff] [blame] | 153 | bool "Interruptible watchers" if !KCSAN_STRICT |
| 154 | default KCSAN_STRICT |
Marco Elver | 48b1fc1 | 2020-02-21 23:02:09 +0100 | [diff] [blame] | 155 | help |
| 156 | If enabled, a task that set up a watchpoint may be interrupted while |
| 157 | delayed. This option will allow KCSAN to detect races between |
| 158 | interrupted tasks and other threads of execution on the same CPU. |
| 159 | |
| 160 | Currently disabled by default, because not all safe per-CPU access |
| 161 | primitives and patterns may be accounted for, and therefore could |
| 162 | result in false positives. |
| 163 | |
Marco Elver | 05f9a40 | 2020-01-10 19:48:34 +0100 | [diff] [blame] | 164 | config KCSAN_REPORT_ONCE_IN_MS |
Marco Elver | d591ec3 | 2020-02-06 16:46:24 +0100 | [diff] [blame] | 165 | int "Duration in milliseconds, in which any given race is only reported once" |
Marco Elver | 05f9a40 | 2020-01-10 19:48:34 +0100 | [diff] [blame] | 166 | default 3000 |
| 167 | help |
Marco Elver | d591ec3 | 2020-02-06 16:46:24 +0100 | [diff] [blame] | 168 | Any given race is only reported once in the defined time window. |
| 169 | Different races may still generate reports within a duration that is |
| 170 | smaller than the duration defined here. This allows rate limiting |
| 171 | reporting to avoid flooding the console with reports. Setting this |
| 172 | to 0 disables rate limiting. |
Marco Elver | 05f9a40 | 2020-01-10 19:48:34 +0100 | [diff] [blame] | 173 | |
Marco Elver | eb32f9f | 2021-06-07 14:56:47 +0200 | [diff] [blame] | 174 | # The main purpose of the below options is to control reported data races, and |
| 175 | # are not expected to be switched frequently by non-testers or at runtime. |
| 176 | # The defaults are chosen to be conservative, and can miss certain bugs. |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 177 | |
| 178 | config KCSAN_REPORT_RACE_UNKNOWN_ORIGIN |
| 179 | bool "Report races of unknown origin" |
| 180 | default y |
| 181 | help |
| 182 | If KCSAN should report races where only one access is known, and the |
| 183 | conflicting access is of unknown origin. This type of race is |
| 184 | reported if it was only possible to infer a race due to a data value |
| 185 | change while an access is being delayed on a watchpoint. |
| 186 | |
Marco Elver | e675d25 | 2021-06-07 14:56:49 +0200 | [diff] [blame] | 187 | config KCSAN_STRICT |
| 188 | bool "Strict data-race checking" |
| 189 | help |
| 190 | KCSAN will report data races with the strictest possible rules, which |
| 191 | closely aligns with the rules defined by the Linux-kernel memory |
| 192 | consistency model (LKMM). |
| 193 | |
Marco Elver | 69562e4 | 2021-08-05 14:57:45 +0200 | [diff] [blame] | 194 | config KCSAN_WEAK_MEMORY |
| 195 | bool "Enable weak memory modeling to detect missing memory barriers" |
| 196 | default y |
| 197 | depends on KCSAN_STRICT |
| 198 | # We can either let objtool nop __tsan_func_{entry,exit}() and builtin |
| 199 | # atomics instrumentation in .noinstr.text, or use a compiler that can |
| 200 | # implement __no_kcsan to really remove all instrumentation. |
Marco Elver | bd3d5bd | 2021-11-30 12:44:33 +0100 | [diff] [blame] | 201 | depends on STACK_VALIDATION || CC_IS_GCC || CLANG_VERSION >= 140000 |
Marco Elver | 69562e4 | 2021-08-05 14:57:45 +0200 | [diff] [blame] | 202 | help |
| 203 | Enable support for modeling a subset of weak memory, which allows |
| 204 | detecting a subset of data races due to missing memory barriers. |
| 205 | |
| 206 | Depends on KCSAN_STRICT, because the options strenghtening certain |
| 207 | plain accesses by default (depending on !KCSAN_STRICT) reduce the |
| 208 | ability to detect any data races invoving reordered accesses, in |
| 209 | particular reordered writes. |
| 210 | |
| 211 | Weak memory modeling relies on additional instrumentation and may |
| 212 | affect performance. |
| 213 | |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 214 | config KCSAN_REPORT_VALUE_CHANGE_ONLY |
| 215 | bool "Only report races where watcher observed a data value change" |
| 216 | default y |
Marco Elver | e675d25 | 2021-06-07 14:56:49 +0200 | [diff] [blame] | 217 | depends on !KCSAN_STRICT |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 218 | help |
Ingo Molnar | 5cbaefe | 2019-11-20 10:41:43 +0100 | [diff] [blame] | 219 | If enabled and a conflicting write is observed via a watchpoint, but |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 220 | the data value of the memory location was observed to remain |
| 221 | unchanged, do not report the data race. |
| 222 | |
Marco Elver | 1e6ee2f | 2020-02-04 18:21:10 +0100 | [diff] [blame] | 223 | config KCSAN_ASSUME_PLAIN_WRITES_ATOMIC |
| 224 | bool "Assume that plain aligned writes up to word size are atomic" |
| 225 | default y |
Marco Elver | e675d25 | 2021-06-07 14:56:49 +0200 | [diff] [blame] | 226 | depends on !KCSAN_STRICT |
Marco Elver | 1e6ee2f | 2020-02-04 18:21:10 +0100 | [diff] [blame] | 227 | help |
| 228 | Assume that plain aligned writes up to word size are atomic by |
| 229 | default, and also not subject to other unsafe compiler optimizations |
| 230 | resulting in data races. This will cause KCSAN to not report data |
| 231 | races due to conflicts where the only plain accesses are aligned |
| 232 | writes up to word size: conflicts between marked reads and plain |
| 233 | aligned writes up to word size will not be reported as data races; |
| 234 | notice that data races between two conflicting plain aligned writes |
| 235 | will also not be reported. |
| 236 | |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 237 | config KCSAN_IGNORE_ATOMICS |
| 238 | bool "Do not instrument marked atomic accesses" |
Marco Elver | e675d25 | 2021-06-07 14:56:49 +0200 | [diff] [blame] | 239 | depends on !KCSAN_STRICT |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 240 | help |
Marco Elver | a249a73 | 2020-02-04 18:21:11 +0100 | [diff] [blame] | 241 | Never instrument marked atomic accesses. This option can be used for |
| 242 | additional filtering. Conflicting marked atomic reads and plain |
| 243 | writes will never be reported as a data race, however, will cause |
| 244 | plain reads and marked writes to result in "unknown origin" reports. |
| 245 | If combined with CONFIG_KCSAN_REPORT_RACE_UNKNOWN_ORIGIN=n, data |
| 246 | races where at least one access is marked atomic will never be |
| 247 | reported. |
| 248 | |
| 249 | Similar to KCSAN_ASSUME_PLAIN_WRITES_ATOMIC, but including unaligned |
| 250 | accesses, conflicting marked atomic reads and plain writes will not |
| 251 | be reported as data races; however, unlike that option, data races |
| 252 | due to two conflicting plain writes will be reported (aligned and |
| 253 | unaligned, if CONFIG_KCSAN_ASSUME_PLAIN_WRITES_ATOMIC=n). |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 254 | |
Marco Elver | 49f72d5 | 2021-06-07 14:56:51 +0200 | [diff] [blame] | 255 | config KCSAN_PERMISSIVE |
| 256 | bool "Enable all additional permissive rules" |
| 257 | depends on KCSAN_REPORT_VALUE_CHANGE_ONLY |
| 258 | help |
| 259 | Enable additional permissive rules to ignore certain classes of data |
| 260 | races (also see kernel/kcsan/permissive.h). None of the permissive |
| 261 | rules imply that such data races are generally safe, but can be used |
| 262 | to further reduce reported data races due to data-racy patterns |
| 263 | common across the kernel. |
| 264 | |
Marco Elver | dfd402a | 2019-11-14 19:02:54 +0100 | [diff] [blame] | 265 | endif # KCSAN |