This page is for Self-Hosted, version v3.0 (default).
For other versions, use one of these documentation indexes:
- v3.0 (default): https://docs.nvidia.com/run-ai/self-hosted/v3.0/llms.txt
- v2.26: https://docs.nvidia.com/run-ai/self-hosted/v2.26/llms.txt
- v2.25: https://docs.nvidia.com/run-ai/self-hosted/v2.25/llms.txt
- v2.24: https://docs.nvidia.com/run-ai/self-hosted/v2.24/llms.txt
Node pools assist in managing heterogeneous resources effectively.
A node pool is a set of nodes grouped into a bucket of resources using a predefined (for example, GPU-Type) or
administrator-defined label (for example, key & value).
For more information, see Node Pools.
