kernel/rcu/update.c

49 #include "rcu.h"
65  * rcu_read_lock_held_common() - might we be in RCU-sched read-side critical section?
74  * RCU-sched read-side critical section.  In absence of
75  * CONFIG_DEBUG_LOCK_ALLOC, this assumes we are in an RCU-sched read-side
77  * of preemption (including disabling irqs) counts as an RCU-sched
79  * that required that they be called within an RCU-sched read-side
85  * Note that if the CPU is in the idle loop from an RCU point of view (ie:
88  * rcu_read_lock().  The reason for this is that RCU ignores CPUs that are
90  * so such a CPU is effectively never in an RCU read-side critical section
91  * regardless of what RCU primitives it invokes.  This state of affairs is
92  * required --- we need to keep an RCU-free window in idle where the CPU may
97  * Similarly, we avoid claiming an RCU read lock held if the current
132  * non-expedited counterparts?  Intended for use within RCU.  Note
149  * use within RCU.  Note that this function takes the rcu_expedited
161  * rcu_expedite_gp - Expedite future RCU grace periods
191  * Inform RCU of the end of the in-kernel boot sequence.
228  * Switch to run-time mode once RCU has fully initialized.
270 // Tell lockdep when RCU callbacks are being invoked.
284  * rcu_read_lock_held() - might we be in RCU read-side critical section?
286  * If CONFIG_DEBUG_LOCK_ALLOC is selected, returns nonzero iff in an RCU
288  * this assumes we are in an RCU read-side critical section unless it can
290  * require that they be called within an RCU read-side critical section.
301  * offline from an RCU perspective, so check for those as well.
314  * rcu_read_lock_bh_held() - might we be in RCU-bh read-side critical section?
320  * that require that they be called within an RCU read-side critical
326  * offline from an RCU perspective, so check for those as well.
362 	struct rcu_synchronize *rcu;  in wakeme_after_rcu()  local
364 	rcu = container_of(head, struct rcu_synchronize, head);  in wakeme_after_rcu()
365 	complete(&rcu->completion);  in wakeme_after_rcu()
502 // Suppress boot-time RCU CPU stall warnings and rcutorture writer stall
521 	pr_info("RCU test callback executed %d\n", rcu_self_test_counter);  in test_callback()
546 	pr_info("Running RCU self tests\n");  in rcu_early_boot_tests()