Is this page helpful?

Support Matrix#

Prerequisites#

  • NVIDIA/NGC API key

  • CUDA 12.6+ drivers installed

Hardware Requirements#

  • GPU: 1× NVIDIA A6000, A100, H100 or newer (minimum 32 GB VRAM)

  • CPU: x86_64 or AArch64

  • Storage: 10 GB

  • System Memory: 16 GB

Software Requirements#

  • Operating System: Ubuntu 20.04 or newer

  • NVIDIA Driver version: 560.28.03 or newer

  • NVIDIA CUDA version: 12.6 or newer

  • NVIDIA Container Toolkit version: 1.15.0 or newer

  • Docker version: Docker version 26 or newer