kernel/rcu/tree_exp.h

17  * Record the start of an expedited grace period.
26  * Return the value that the expedited-grace-period counter will have
27  * at the end of the current grace period.
35  * Record the end of an expedited grace period.
45  * Take a snapshot of the expedited-grace-period counter, which is the
46  * earliest value that will indicate that a full grace period has
61  * if a full expedited grace period has elapsed since that snapshot
131  * a new expedited grace period.
148  * Return non-zero if there is no RCU expedited grace period in progress
151  * for the current expedited grace period.
179  * grace period.  This event is reported either to the rcu_node structure on
277  * if some other task completed an expedited grace period that this task
280  * expedited grace period.
337  * expedited grace period needs to wait for.
453  * Work-queue handler to drive an expedited grace period forward.
505  * Work-queue handler to drive an expedited grace period forward.
528  * Select the nodes that the upcoming expedited grace period needs
562  * Wait for the expedited grace period to elapse, within time limit.
563  * If the time limit is exceeded without the grace period elapsing,
582  * Wait for the expedited grace period to elapse, issuing any needed
687  * Wait for the current expedited grace period to complete, and then
689  * grace period.  Also update all the ->exp_seq_rq counters as needed
699 	// End the previous grace period only after acquiring the mutex  in rcu_exp_wait_wake()
721  * Common code to drive an expedited grace period forward, used by
773 	 * grace period is still waiting on this CPU, set ->deferred_qs  in rcu_exp_handler()
793 /* PREEMPTION=y, so no PREEMPTION=n expedited grace period to clean up after. */
801  * expedited grace period.
827  * expedited grace period.
919  * blocking the current expedited grace period.
929  * the current expedited grace period.
938  * synchronize_rcu_expedited - Brute-force RCU grace period
940  * Wait for an RCU grace period, but expedite it.  The basic idea is to
970 	/* Is the state is such that the call is a grace period? */  in synchronize_rcu_expedited()
1003 		/* Marshall arguments & schedule the expedited grace period. */  in synchronize_rcu_expedited()
1008 	/* Wait for expedited grace period to complete. */  in synchronize_rcu_expedited()
1014 	/* Let the next expedited grace period start. */  in synchronize_rcu_expedited()
1053 … start_poll_synchronize_rcu_expedited - Snapshot current RCU state and start expedited grace period
1057  * allowing them to determine whether or not any sort of grace period has
1058  * elapsed in the meantime.  If the needed expedited grace period is not
1059  * already slated to start, initiates that grace period.
1087  * start_poll_synchronize_rcu_expedited_full - Take a full snapshot and start expedited grace period
1088  * @rgosp: Place to put snapshot of grace-period state
1090  * Places the normal and expedited grace-period states in rgosp.  This
1093  * grace period (whether normal or expedited) has elapsed in the meantime.
1094  * If the needed expedited grace period is not already slated to start,
1095  * initiates that grace period.
1105  * cond_synchronize_rcu_expedited - Conditionally wait for an expedited RCU grace period
1109  * If any type of full RCU grace period has elapsed since the earlier
1112  * invoke synchronize_rcu_expedited() to wait for a full grace period.
1132  * cond_synchronize_rcu_expedited_full - Conditionally wait for an expedited RCU grace period
1135  * If a full RCU grace period has elapsed since the call to
1139  * to wait for a full grace period.