Skip to navigation

Supported Hardware

View as Markdown

Each prediction runs on a single GPU. Starting in 1.6.0, a container given more than one GPU serves requests from all of them concurrently; refer to Configuration Alternatives.

GPU

The OpenFold3 NIM is supported to run on the GPU configurations below.

GPUGPU Memory# of GPUs
NVIDIA H100 80GB HBM380 GB1 or more
NVIDIA H100 NVL94 GB1 or more
NVIDIA H100 PCIe80 GB1 or more
NVIDIA A100-SXM4-80GB80 GB1 or more
NVIDIA A100 80GB PCIe80 GB1 or more
NVIDIA A100-SXM4-40GB40 GB1 or more
NVIDIA A100 40GB PCIe40 GB1 or more
NVIDIA H200141 GB1 or more
NVIDIA H200 NVL141 GB1 or more
NVIDIA B200180 GB1 or more
NVIDIA B300288 GB1 or more
NVIDIA GB200186 GB1 or more
NVIDIA GB300288 GB1 or more
NVIDIA GH200 144GB144 GB1 or more
NVIDIA RTX PRO 6000 Blackwell Server Edition96 GB1 or more
NVIDIA RTX PRO 6000 Blackwell Workstation Edition96 GB1 or more
NVIDIA RTX 6000 Ada Generation48 GB1 or more
NVIDIA L40S48 GB1 or more
NVIDIA GB10 (DGX Spark)128 GB1

The GB10 features 128 GB of LPDDR5x unified memory shared between CPU and GPU, providing a single memory space across the NVIDIA Grace Blackwell Superchip architecture. It is listed as 1 rather than 1 or more because a DGX Spark carries a single GB10 superchip. There is no second GPU for the NIM to start a worker on.

Storage

NVIDIA recommends at least 80 GB of disk space.

The container is roughly 11 GB to download and approximately 40 GB once unpacked. Model parameters are not included in the container; they are downloaded on first run into the NIM cache directory, which needs a further 15 GB. Refer to Getting Started for how to set the cache location.

CPU and System Memory

  • At least 64 GB of RAM
  • A CPU with at least 8 available cores