Pulling A Container
Using the vLLM NGC Container requires the host system to have the following installed:
For supported versions, see the Framework Containers Support Matrix and the NVIDIA Container Toolkit Documentation. *No other installation, compilation, or dependency management is required. It is not necessary to install the NVIDIA CUDA Toolkit