Support Matrix
Hardware Requirements
- GPU: 1x A6000, A100, or H100, minimum of 32 GB of memory
- CPU: x86_64 architecture
- Storage: 10 GB
- System Memory: 16 GB
Software Requirements
Operating System: Ubuntu 20.04 or newer
- NVIDIA Driver version: 535 or newer
- NVIDIA CUDA version: 12.4 or newer
- NVIDIA Container Toolkit version: 1.15.0 or newer
- Docker version: Docker version 26 or newer