blob: bf8e341e75b4fd0a270d386f65de42c94dd69ac2 [file] [log] [blame]
Thomas Gleixnerec8f24b2019-05-19 13:07:45 +01001# SPDX-License-Identifier: GPL-2.0-only
Paul E. McKenney0af92d42017-05-17 08:43:40 -07002#
3# RCU-related configuration options
4#
5
6menu "RCU Subsystem"
7
8config TREE_RCU
9 bool
Lai Jiangshanb3e627d2019-10-15 02:55:57 +000010 default y if SMP
Paul E. McKenney0af92d42017-05-17 08:43:40 -070011 help
12 This option selects the RCU implementation that is
13 designed for very large SMP system with hundreds or
14 thousands of CPUs. It also scales down nicely to
15 smaller systems.
16
17config PREEMPT_RCU
18 bool
Thomas Gleixner01b1d882019-07-26 23:19:38 +020019 default y if PREEMPTION
Lai Jiangshanb3e627d2019-10-15 02:55:57 +000020 select TREE_RCU
Paul E. McKenney0af92d42017-05-17 08:43:40 -070021 help
22 This option selects the RCU implementation that is
23 designed for very large SMP systems with hundreds or
24 thousands of CPUs, but for which real-time response
25 is also required. It also scales down nicely to
26 smaller systems.
27
28 Select this option if you are unsure.
29
30config TINY_RCU
31 bool
Thomas Gleixner01b1d882019-07-26 23:19:38 +020032 default y if !PREEMPTION && !SMP
Paul E. McKenney0af92d42017-05-17 08:43:40 -070033 help
34 This option selects the RCU implementation that is
35 designed for UP systems from which real-time response
36 is not required. This option greatly reduces the
37 memory footprint of RCU.
38
39config RCU_EXPERT
40 bool "Make expert-level adjustments to RCU configuration"
41 default n
42 help
43 This option needs to be enabled if you wish to make
44 expert-level adjustments to RCU configuration. By default,
45 no such adjustments can be made, which has the often-beneficial
46 side-effect of preventing "make oldconfig" from asking you all
47 sorts of detailed questions about how you would like numerous
48 obscure RCU options to be set up.
49
50 Say Y if you need to make expert-level adjustments to RCU.
51
52 Say N if you are unsure.
53
54config SRCU
55 bool
56 help
57 This option selects the sleepable version of RCU. This version
58 permits arbitrary sleeping or blocking within RCU read-side critical
59 sections.
60
61config TINY_SRCU
62 bool
63 default y if SRCU && TINY_RCU
64 help
65 This option selects the single-CPU non-preemptible version of SRCU.
66
67config TREE_SRCU
68 bool
69 default y if SRCU && !TINY_RCU
70 help
71 This option selects the full-fledged version of SRCU.
72
Paul E. McKenney5873b8a2020-03-03 11:49:21 -080073config TASKS_RCU_GENERIC
Paul E. McKenneyd5f177d2020-03-09 19:56:53 -070074 def_bool TASKS_RCU || TASKS_RUDE_RCU || TASKS_TRACE_RCU
Paul E. McKenney5873b8a2020-03-03 11:49:21 -080075 select SRCU
76 help
77 This option enables generic infrastructure code supporting
78 task-based RCU implementations. Not for manual selection.
79
Paul E. McKenney0af92d42017-05-17 08:43:40 -070080config TASKS_RCU
Thomas Gleixner01b1d882019-07-26 23:19:38 +020081 def_bool PREEMPTION
Paul E. McKenney0af92d42017-05-17 08:43:40 -070082 help
83 This option enables a task-based RCU implementation that uses
84 only voluntary context switch (not preemption!), idle, and
Paul E. McKenney5873b8a2020-03-03 11:49:21 -080085 user-mode execution as quiescent states. Not for manual selection.
Paul E. McKenney0af92d42017-05-17 08:43:40 -070086
Paul E. McKenneyc84aad72020-03-02 21:06:43 -080087config TASKS_RUDE_RCU
88 def_bool 0
89 help
90 This option enables a task-based RCU implementation that uses
91 only context switch (including preemption) and user-mode
92 execution as quiescent states. It forces IPIs and context
93 switches on all online CPUs, including idle ones, so use
94 with caution.
95
Paul E. McKenneyd5f177d2020-03-09 19:56:53 -070096config TASKS_TRACE_RCU
97 def_bool 0
Paul E. McKenneyc26165e2020-12-21 21:00:18 -080098 select IRQ_WORK
Paul E. McKenneyd5f177d2020-03-09 19:56:53 -070099 help
100 This option enables a task-based RCU implementation that uses
101 explicit rcu_read_lock_trace() read-side markers, and allows
102 these readers to appear in the idle loop as well as on the CPU
103 hotplug code paths. It can force IPIs on online CPUs, including
104 idle ones, so use with caution.
105
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700106config RCU_STALL_COMMON
Lai Jiangshanb3e627d2019-10-15 02:55:57 +0000107 def_bool TREE_RCU
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700108 help
109 This option enables RCU CPU stall code that is common between
110 the TINY and TREE variants of RCU. The purpose is to allow
111 the tiny variants to disable RCU CPU stall warnings, while
112 making these warnings mandatory for the tree variants.
113
114config RCU_NEED_SEGCBLIST
Paul E. McKenney9b073de2021-11-08 16:18:57 -0800115 def_bool ( TREE_RCU || TREE_SRCU || TASKS_RCU_GENERIC )
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700116
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700117config RCU_FANOUT
118 int "Tree-based hierarchical RCU fanout value"
119 range 2 64 if 64BIT
120 range 2 32 if !64BIT
Lai Jiangshanb3e627d2019-10-15 02:55:57 +0000121 depends on TREE_RCU && RCU_EXPERT
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700122 default 64 if 64BIT
123 default 32 if !64BIT
124 help
125 This option controls the fanout of hierarchical implementations
126 of RCU, allowing RCU to work efficiently on machines with
127 large numbers of CPUs. This value must be at least the fourth
128 root of NR_CPUS, which allows NR_CPUS to be insanely large.
129 The default value of RCU_FANOUT should be used for production
130 systems, but if you are stress-testing the RCU implementation
131 itself, small RCU_FANOUT values allow you to test large-system
132 code paths on small(er) systems.
133
134 Select a specific number if testing RCU itself.
135 Take the default if unsure.
136
137config RCU_FANOUT_LEAF
138 int "Tree-based hierarchical RCU leaf-level fanout value"
Paul E. McKenneydc126912020-08-05 16:52:17 -0700139 range 2 64 if 64BIT && !RCU_STRICT_GRACE_PERIOD
140 range 2 32 if !64BIT && !RCU_STRICT_GRACE_PERIOD
141 range 2 3 if RCU_STRICT_GRACE_PERIOD
Lai Jiangshanb3e627d2019-10-15 02:55:57 +0000142 depends on TREE_RCU && RCU_EXPERT
Paul E. McKenneydc126912020-08-05 16:52:17 -0700143 default 16 if !RCU_STRICT_GRACE_PERIOD
144 default 2 if RCU_STRICT_GRACE_PERIOD
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700145 help
146 This option controls the leaf-level fanout of hierarchical
147 implementations of RCU, and allows trading off cache misses
148 against lock contention. Systems that synchronize their
149 scheduling-clock interrupts for energy-efficiency reasons will
150 want the default because the smaller leaf-level fanout keeps
151 lock contention levels acceptably low. Very large systems
152 (hundreds or thousands of CPUs) will instead want to set this
153 value to the maximum value possible in order to reduce the
154 number of cache misses incurred during RCU's grace-period
155 initialization. These systems tend to run CPU-bound, and thus
156 are not helped by synchronized interrupts, and thus tend to
157 skew them, which reduces lock contention enough that large
158 leaf-level fanouts work well. That said, setting leaf-level
159 fanout to a large number will likely cause problematic
160 lock contention on the leaf-level rcu_node structures unless
161 you boot with the skew_tick kernel parameter.
162
163 Select a specific number if testing RCU itself.
164
165 Select the maximum permissible value for large systems, but
166 please understand that you may also need to set the skew_tick
167 kernel boot parameter to avoid contention on the rcu_node
168 structure's locks.
169
170 Take the default if unsure.
171
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700172config RCU_BOOST
173 bool "Enable RCU priority boosting"
Sebastian Andrzej Siewior2341bc42020-12-15 15:16:45 +0100174 depends on (RT_MUTEXES && PREEMPT_RCU && RCU_EXPERT) || PREEMPT_RT
175 default y if PREEMPT_RT
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700176 help
177 This option boosts the priority of preempted RCU readers that
178 block the current preemptible RCU grace period for too long.
179 This option also prevents heavy loads from blocking RCU
Paul E. McKenney8c1cf2d2018-07-07 18:12:26 -0700180 callback invocation.
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700181
182 Say Y here if you are working with real-time apps or heavy loads
183 Say N here if you are unsure.
184
185config RCU_BOOST_DELAY
186 int "Milliseconds to delay boosting after RCU grace-period start"
187 range 0 3000
188 depends on RCU_BOOST
189 default 500
190 help
191 This option specifies the time to wait after the beginning of
192 a given grace period before priority-boosting preempted RCU
193 readers blocking that grace period. Note that any RCU reader
194 blocking an expedited RCU grace period is boosted immediately.
195
196 Accept the default if unsure.
197
198config RCU_NOCB_CPU
199 bool "Offload RCU callback processing from boot-selected CPUs"
Lai Jiangshanb3e627d2019-10-15 02:55:57 +0000200 depends on TREE_RCU
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700201 depends on RCU_EXPERT || NO_HZ_FULL
202 default n
203 help
204 Use this option to reduce OS jitter for aggressive HPC or
205 real-time workloads. It can also be used to offload RCU
206 callback invocation to energy-efficient CPUs in battery-powered
Neeraj Upadhyaya3941512020-09-24 12:04:10 +0530207 asymmetric multiprocessors. The price of this reduced jitter
208 is that the overhead of call_rcu() increases and that some
209 workloads will incur significant increases in context-switch
210 rates.
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700211
Paul E. McKenney8c1cf2d2018-07-07 18:12:26 -0700212 This option offloads callback invocation from the set of CPUs
213 specified at boot time by the rcu_nocbs parameter. For each
214 such CPU, a kthread ("rcuox/N") will be created to invoke
215 callbacks, where the "N" is the CPU being offloaded, and where
Neeraj Upadhyaya3941512020-09-24 12:04:10 +0530216 the "x" is "p" for RCU-preempt (PREEMPTION kernels) and "s" for
217 RCU-sched (!PREEMPTION kernels). Nothing prevents this kthread
218 from running on the specified CPUs, but (1) the kthreads may be
219 preempted between each callback, and (2) affinity or cgroups can
220 be used to force the kthreads to run on whatever set of CPUs is
221 desired.
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700222
Neeraj Upadhyaya3941512020-09-24 12:04:10 +0530223 Say Y here if you need reduced OS jitter, despite added overhead.
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700224 Say N here if you are unsure.
225
Paul E. McKenney9ae58d72020-03-18 17:16:37 -0700226config TASKS_TRACE_RCU_READ_MB
227 bool "Tasks Trace RCU readers use memory barriers in user and idle"
228 depends on RCU_EXPERT
229 default PREEMPT_RT || NR_CPUS < 8
230 help
231 Use this option to further reduce the number of IPIs sent
232 to CPUs executing in userspace or idle during tasks trace
233 RCU grace periods. Given that a reasonable setting of
234 the rcupdate.rcu_task_ipi_delay kernel boot parameter
235 eliminates such IPIs for many workloads, proper setting
236 of this Kconfig option is important mostly for aggressive
237 real-time installations and for battery-powered devices,
238 hence the default chosen above.
239
240 Say Y here if you hate IPIs.
241 Say N here if you hate read-side memory barriers.
242 Take the default if you are unsure.
243
Paul E. McKenney0af92d42017-05-17 08:43:40 -0700244endmenu # "RCU Subsystem"