Support Matrix | NVIDIA BioNeMo NIM Documentation

Supported Hardware

Minimum System Hardware Requirements

CPU Cores	RAM (GB)	NVMe SSD Storage (GB)	GPU Count
4	16	50	1 GPU from the list of Supported NVIDIA GPUs

The NVMe SSD Storage requirement of 50GB accounts for the MolMIM NIM image size plus additional space for Docker layer caching and temporary files during runtime.

Supported NVIDIA GPUs

The MolMIM NIM requires NVIDIA GPUs with at least 3 GB of GPU Memory. The MolMIM NIM is configured to run on a single GPU and should run on any NVIDIA GPU that meets this minimum memory requirement and has compute capability >7.0. The following configurations have been specifically tested for optimal performance and stability. We recommend using one of the following tested configurations:

GPU	GPU Memory (GB)	Microarchitecture	Precision	GPU Count
L40	48	Ampere	FP32/FP16	1
A100	40-80	Ampere	FP32/FP16	1
A10	24	Ampere	FP32/FP16	1

While the minimum GPU memory requirement is 3GB, the above configurations have been tested for optimal performance and stability. Other NVIDIA GPUs with Ampere architecture or newer and compute capability >7.0 may work but have not been officially tested.

Testing Locally Available Hardware

Begin with Docker-supported operating system
Install Docker - minimum version: 23.0.1
Install NVIDIA Drivers - minimum version: 535
Install the NVIDIA Container Toolkit - minimum version: 1.13.5
Verify your container runtime supports NVIDIA GPUs by running

docker run --rm --runtime=nvidia --gpus 1 ubuntu nvidia-smi

Example output:

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.78.01    Driver Version: 525.78.01    CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0 Off |                  N/A |
| 41%   30C    P8     1W / 260W |   2244MiB / 11264MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
+-----------------------------------------------------------------------------+