62  * In more detail. When a VMCI queue pair is first created, it will be in the
71  *       vmci_qp_broker_set_page_store to specify the UVAs of the queue pair at
76  * - VMCIQPB_CREATED_MEM: this state is the result when the queue pair
77  *     is created by a VMX using the queue pair device backend that
78  *     sets the UVAs of the queue pair immediately and stores the
82  * Once the queue pair is in one of the created states (with the exception of
84  * queue pair. Again we have two new states possible:
90  *       pair, and attaches to a queue pair previously created by the host side.
92  *     - from VMCIQPB_CREATED_MEM when the host side attaches to a queue pair
98  * - VMCIQPB_ATTACHED_NO_MEM: If the queue pair already was in the
100  *     bring the queue pair into this state. Once vmci_qp_broker_set_page_store
104  * From the attached queue pair, the queue pair can enter the shutdown states
105  * when either side of the queue pair detaches. If the guest side detaches
106  * first, the queue pair will enter the VMCIQPB_SHUTDOWN_NO_MEM state, where
107  * the content of the queue pair will no longer be available. If the host
108  * side detaches first, the queue pair will either enter the
115  * memory will no longer be available, and the queue pair will transition from
117  * in which case the queue pair will transition from the *_NO_MEM state at that
176  * In the queue pair broker, we always use the guest point of view for
181  * that creates the queue pair will have the right orientation, and
209 	void *local_mem;	/* Kernel memory for local queue pair */
474  * Frees the two list of PPNs for a queue pair.
567  * Initialize the mutex for the pair of queues.  This mutex is used to
589  * Cleans up the mutex for the pair of queues.
688  * pair. Enough information to map in pages is stored in the OS specific
732  * queue, the queue pair headers can be mapped into the
775  * Unmaps previously mapped queue pair headers from the kernel.
844  * Dispatches a queue pair event message directly into the local event
1015  * pages for the queue pair.
1084  * pair guest endpoint. Allocates physical pages for the queue
1085  * pair. It makes OS dependent calls through generic wrappers.
1125 				pr_devel("Error mismatched queue pair in local attach\n");  in qp_alloc_guest_work()
1180 	 * It's only necessary to notify the host if this queue pair will be  in qp_alloc_guest_work()
1227 	 * We should initialize the queue pair header pages on a local  in qp_alloc_guest_work()
1228 	 * queue pair create.  For non-local queue pairs, the  in qp_alloc_guest_work()
1259  * The first endpoint issuing a queue pair allocation will create the state
1260  * of the queue pair in the queue pair broker.
1263  * with the queue pair as specified by the page_store. For compatibility with
1270  * since the host is not able to supply a page store for the queue pair.
1272  * For older VMX and host callers, the queue pair will be created in the
1321 		 * The queue pair broker entry stores values from the guest  in qp_broker_create()
1324 		 * pair, in which case no swapping is necessary, since the local  in qp_broker_create()
1382 		 * The VMX already initialized the queue pair headers, so no  in qp_broker_create()
1397 		 * queue pair create (in which case we will expect a  in qp_broker_create()
1441  * the given queue pair handle about attach/detach event by the
1484  * The second endpoint issuing a queue pair allocation will attach to
1485  * the queue pair registered with the queue pair broker.
1488  * range with the queue pair as specified by the page_store. At this
1490  * pair, and an attach event is sent to it. For compatibility with
1500  * For new VMX and host callers, the queue pair will be moved to the
1564 		 * and a host created this queue pair.  in qp_broker_attach()
1575 		 * Do not attach a host to a user created queue pair if that  in qp_broker_attach()
1576 		 * user doesn't support host queue pair end points.  in qp_broker_attach()
1592 		 * The queue pair broker entry stores values from the guest  in qp_broker_attach()
1608 		 * If a guest attached to a queue pair, it will supply  in qp_broker_attach()
1616 		 * must the initially created queue pair not have any  in qp_broker_attach()
1627 			 * initialized the queue pair headers, so no  in qp_broker_attach()
1644 		 * pair that doesn't have any memory associated with  in qp_broker_attach()
1651 		/* The host side has successfully attached to a queue pair. */  in qp_broker_attach()
1660 			pr_warn("Failed to notify peer (ID=0x%x) of attach to queue pair (handle=0x%x:0x%x)\n",  in qp_broker_attach()
1674 	 * an entry tracking the queue pair, so don't add another one.  in qp_broker_attach()
1686  * queue_pair_Alloc for use when setting up queue pair endpoints
1727 		pr_devel("Context (ID=0x%x) already attached to queue pair (handle=0x%x:0x%x)\n",  in qp_broker_alloc()
1761  * pair.
1795 			 * If this is a local queue pair, the attacher  in qp_alloc_host_work()
1810 		pr_devel("queue pair broker failed to alloc (result=%d)\n",  in qp_alloc_host_work()
1853  * a queue pair.
1917  * Requests that a queue pair be allocated with the VMCI queue
1918  * pair broker. Allocates a queue pair entry if one does not
1920  * files backing that queue_pair.  Assumes that the queue pair
1939  * step to add the UVAs of the VMX mapping of the queue pair. This function
1941  * registering the page store for a queue pair previously allocated by the
1942  * VMX during create or attach. This function will move the queue pair state
1945  * attached state with memory, the queue pair is ready to be used by the
1948  * Assumes that the queue pair broker lock is held.
1977 		pr_warn("Context (ID=0x%x) not attached to queue pair (handle=0x%x:0x%x)\n",  in vmci_qp_broker_set_page_store()
2031 			pr_warn("Failed to notify peer (ID=0x%x) of attach to queue pair (handle=0x%x:0x%x)\n",  in vmci_qp_broker_set_page_store()
2055  * The main entry point for detaching from a queue pair registered with the
2056  * queue pair broker. If more than one endpoint is attached to the queue
2057  * pair, the first endpoint will mainly decrement a reference count and
2059  * the queue pair state registered with the broker.
2062  * memory backing the queue pair. If the host is still attached, it will
2063  * no longer be able to access the queue pair content.
2065  * If the queue pair is already in a state where there is no memory
2066  * registered for the queue pair (any *_NO_MEM state), it will transition to
2069  * the first out of two to detach, the queue pair will move to the
2088 		pr_devel("Context (ID=0x%x) not attached to queue pair (handle=0x%x:0x%x)\n",  in vmci_qp_broker_detach()
2096 …pr_devel("Context (ID=0x%x) reports being attached to queue pair(handle=0x%x:0x%x) that isn't pres…  in vmci_qp_broker_detach()
2122 		 * Pre NOVMVM vmx'en may detach from a queue pair  in vmci_qp_broker_detach()
2125 		 * recent VMX'en may detach from a queue pair in the  in vmci_qp_broker_detach()
2138 				pr_warn("Failed to unmap queue headers for queue pair (handle=0x%x:0x%x,result=%d)\n",  in vmci_qp_broker_detach()
2197  * Establishes the necessary mappings for a queue pair given a
2198  * reference to the queue pair guest memory. This is usually
2217 		pr_devel("Context (ID=0x%x) not attached to queue pair (handle=0x%x:0x%x)\n",  in vmci_qp_broker_map()
2225 …pr_devel("Context (ID=0x%x) reports being attached to queue pair (handle=0x%x:0x%x) that isn't pre…  in vmci_qp_broker_map()
2306  * Removes all references to the guest memory of a given queue pair, and
2307  * will move the queue pair from state *_MEM to *_NO_MEM. It is usually
2326 		pr_devel("Context (ID=0x%x) not attached to queue pair (handle=0x%x:0x%x)\n",  in vmci_qp_broker_unmap()
2334 …pr_devel("Context (ID=0x%x) reports being attached to queue pair (handle=0x%x:0x%x) that isn't pre…  in vmci_qp_broker_unmap()
2349 			pr_warn("Failed to save queue headers for queue pair (handle=0x%x:0x%x,result=%d)\n",  in vmci_qp_broker_unmap()
2357 		 * registered memory. If the queue pair is mapped again at a  in vmci_qp_broker_unmap()
2380  * Destroys all guest queue pair endpoints. If active guest queue
2410  * Helper routine that will lock the queue pair before subsequent
2423  * Helper routine that unlocks the queue pair after calling
2454  * headers of a given queue pair. If the guest memory of the
2455  * queue pair is currently not available, the saved queue headers
2479  * Callback from VMCI queue pair broker indicating that a queue
2480  * pair that was previously not ready, now either is ready or
2499  * Makes the calling thread wait for the queue pair to become
2501  * woken up after queue pair state change, false otherwise.
2524  * VMCI_ERROR_QUEUEPAIR_NOTATTACHED, if the queue pair pages aren't
2640  * vmci_qpair_alloc() - Allocates a queue pair.
2752  * vmci_qpair_detach() - Detatches the client from a queue pair.
2792  * @qpair:      Pointer to the queue pair struct.
2829  * @qpair:      Pointer to the queue pair struct.
2866  * @qpair:      Pointer to the queue pair struct.
2900  * @qpair:      Pointer to the queue pair struct.
2935  * @qpair:      Pointer to the queue pair struct.
2970  * @qpair:      Pointer to the queue pair struct.
3004  * @qpair:      Pointer to the queue pair struct.
3048  * @qpair:      Pointer to the queue pair struct.
3092  * @qpair:      Pointer to the queue pair struct.
3137  * @qpair:      Pointer to the queue pair struct.
3178  * @qpair:      Pointer to the queue pair struct.
3219  * @qpair:      Pointer to the queue pair struct.