Support Matrix#

Hardware Requirements#

  • GPU: 1x A6000, A100, or H100, minimum of 32 GB of memory

  • CPU: x86_64 architecture

  • Storage: 10 GB

  • System Memory: 16 GB

Software Requirements#

Operating System: Ubuntu 20.04 or newer

  • NVIDIA Driver version: 535 or newer

  • NVIDIA CUDA version: 12.4 or newer

  • NVIDIA Container Toolkit version: 1.15.0 or newer

  • Docker version: Docker version 26 or newer