Pulling A Container

Using the vLLM NGC Container requires the host system to have the following installed:

• Docker Engine
• NVIDIA GPU Drivers
• NVIDIA Container Toolkit

For supported versions, see the Framework Containers Support Matrix and the NVIDIA Container Toolkit Documentation.

No other installation, compilation, or dependency management is required. It is not necessary to install the NVIDIA CUDA Toolkit