24 /* Enable/disable NUMA aware optimizations */
28  * cpumasks to track idle CPUs within each NUMA node.
60  * Returns the NUMA node ID associated with a @cpu, or NUMA_NO_NODE if
107  * Pick an idle CPU in a specific NUMA node.
162 	 * This loop is O(N^2), with N being the amount of NUMA nodes,  in pick_idle_cpu_from_online_nodes()
163 	 * which might be quite expensive in large NUMA systems. However,  in pick_idle_cpu_from_online_nodes()
166 	 * without specifying a target NUMA node, so it shouldn't be a  in pick_idle_cpu_from_online_nodes()
244  * Return the amount of CPUs in the same NUMA domain of @cpu (or zero if the
245  * NUMA domain is not defined).
263  * Return the cpumask representing the NUMA domain of @cpu (or NULL if the NUMA
282  * Return true if the LLC domains do not perfectly overlap with the NUMA
293 	 * While it is rare to encounter architectures with asymmetric NUMA  in llc_numa_mismatch()
299 	 *  NUMA 0:  in llc_numa_mismatch()
303 	 *  NUMA 1:  in llc_numa_mismatch()
308 	 * incorrectly assume that the LLC and NUMA domains are fully  in llc_numa_mismatch()
309 	 * overlapping, which is incorrect (as NUMA 1 has two distinct LLC  in llc_numa_mismatch()
322  * Detect if the system has multiple LLC or multiple NUMA domains and enable
323  * cache-aware / NUMA-aware scheduling optimizations in the default CPU idle
328  * contained within a single NUMA node.
356 	 * Enable NUMA optimization only when there are multiple NUMA domains  in scx_idle_update_selcpu_topology()
357 	 * among the online CPUs and the NUMA domains don't perfectly overlaps  in scx_idle_update_selcpu_topology()
360 	 * If all CPUs belong to the same NUMA node and the same LLC domain,  in scx_idle_update_selcpu_topology()
361 	 * enabling both NUMA and LLC optimizations is unnecessary, as checking  in scx_idle_update_selcpu_topology()
364 	 * If SCX_OPS_BUILTIN_IDLE_PER_NODE is enabled ignore the NUMA  in scx_idle_update_selcpu_topology()
366 	 * specific NUMA nodes querying the corresponding per-node cpumask.  in scx_idle_update_selcpu_topology()
373 			pr_debug("sched_ext: NUMA=%*pb weight=%u\n",  in scx_idle_update_selcpu_topology()
381 	pr_debug("sched_ext: NUMA idle selection %s\n",  in scx_idle_update_selcpu_topology()
409  * 4. Pick a CPU within the same NUMA node, if enabled:
410  *   - choose a CPU from the same NUMA node to reduce memory access latency.
415  * multiple LLCs / multiple NUMA nodes (see scx_selcpu_topo_llc and
522 		 * Search for any fully idle core in the same NUMA node.  in scx_select_cpu_dfl()
570 	 * Search for any idle CPU in the same NUMA node.  in scx_select_cpu_dfl()
786  * scx_bpf_cpu_node - Return the NUMA node the given @cpu belongs to, or
846  * idle-tracking per-CPU cpumask of a target NUMA node.
847  * @node: target NUMA node
892  * idle-tracking, per-physical-core cpumask of a target NUMA node. Can be
894  * @node: target NUMA node
983  * @node: target NUMA node
986  * Pick and claim an idle cpu in @cpus_allowed from the NUMA node @node.
991  * The search starts from @node and proceeds to other online NUMA nodes in
1049  * @node: target NUMA node
1057  * The search starts from @node and proceeds to other online NUMA nodes in