Compute

This page is for Self-Hosted, version v3.0 (default). For other versions, use one of these documentation indexes: - v3.0 (default): https://docs.nvidia.com/run-ai/self-hosted/v3.0/llms.txt - v2.26: https://docs.nvidia.com/run-ai/self-hosted/v2.26/llms.txt - v2.25: https://docs.nvidia.com/run-ai/self-hosted/v2.25/llms.txt - v2.24: https://docs.nvidia.com/run-ai/self-hosted/v2.24/llms.txt

A compute resource is a building block that represents compute resources such as GPUs, CPU cores, and CPU memory. The compute resources may consist of multiple physical resources, for example, 0.5 GPU, 8 cores and 200 Megabytes of CPU memory. A compute resource is available to a scope and and all of the organizational units within that scope.

For more information, see Compute resource.