18 #include <linux/poll.h>
52  * from inside the poll callback, that might be triggered from
54  * So we can't sleep inside the poll callback and hence we need
157 	/* Number of active wait queue attached to poll operations */
160 	/* List containing poll wait queues */
193 	/* Wait queue used by file->poll() */
224 	/* used to track busy poll napi_id */
234 /* Wait structure used by the poll hooks */
252 /* Wrapper struct used by poll queueing */
360 /* Initialize the poll safe wake up structure */
390  * Busy poll if globally on and supporting sockets found && no events,
410  * Set epoll busy poll NAPI ID from sk.
441 	/* record NAPI ID for use in next busy poll */  in ep_set_busy_poll_napi_id()
537  * issue a wake_up() on its poll wake list. Epoll (efd1) has installed a
541  * the waiters on its poll wait list (efd2). So it calls ep_poll_safewake()
614  * This function unregisters poll callbacks from the associated file
666  *                      the scan code, to call f_op->poll(). Also allows for
672  * @depth: The current depth of recursive f_op->poll calls.
700 	 * have the poll callback to queue directly on ep->rdllist,  in ep_scan_ready_list()
717 	 * other events might have been queued by the poll callback.  in ep_scan_ready_list()
774 	 * Removes poll wait queue hooks.  in ep_remove()
825 	 * Walks through the whole tree by unregistering poll callbacks.  in ep_free()
836 	 * point we are sure no poll callbacks will be lingering around, and also by  in ep_free()
911 			 * Item has been dropped into the ready list by the poll  in ep_read_events_proc()
928 	/* Insert inside our poll wait queue */  in ep_eventpoll_poll()
969 	.poll		= ep_eventpoll_poll,
1198  * concurrently for the same @epi from different CPUs if poll table was inited
1218 	 * If the event mask does not contain any poll(2) event, we consider the  in ep_poll_callback()
1237 	 * (because we're accessing user memory, and because of linux f_op->poll()  in ep_poll_callback()
1251 	 * Wake up ( if active ) both the eventpoll wait list and the ->poll()  in ep_poll_callback()
1540 	/* Initialize the poll table using the queue callback */  in ep_insert()
1545 	 * Attach the item to the poll hooks and get current event bits.  in ep_insert()
1548 	 * this operation completes, the poll callback can start hitting  in ep_insert()
1554 	 * We have to check if something went wrong during the poll wait queue  in ep_insert()
1633 	 * Set the new event interest mask before calling f_op->poll();  in ep_modify()
1635 	 * f_op->poll() call and the new event set registering.  in ep_modify()
1651 	 *    event occurs immediately after we call f_op->poll().  in ep_modify()
1657 	 *    when calling f_op->poll().  This barrier also  in ep_modify()
1661 	 * This barrier will now guarantee ep_poll_callback or f_op->poll  in ep_modify()
1768 			 * poll callback will queue them in ep->ovflist.  in ep_send_events_proc()
1861 	 * Busy poll timed out.  Drop NAPI ID for now, we can add  in ep_poll()
2128 	/* The target file descriptor must support poll */  in do_epoll_ctl()