Support Matrix

View as Markdown

Models

MAISI NIM supports the following models:

Supported Hardware

Validated GPUs

GPUGPU Memory (GB)Precision
A100 PCIe80FP32
A100 SXM480FP32
H100 PCIe80FP32
H100 HBM380FP32
L40s48FP32See table below for image size limitations
RTX 6000 Ada48FP32See table below for image size limitations

Required GPU Memory

Output image size is the most defining factor for the amount of required GPU memory, as depicted in the table below. However, please check the exact configuration, as other parameters also contribute to GPU memory usage.

Examplesoutput_sizePeak Memory (VRAM)
1256x256x12814G
2, 3256x256x25614G, 22G
4, 5512x512x12814G, 18G
6, 7, 8512x512x51222G, 26G, 44G
9512x512x76855G

GPU Microarchitecture Compatibility

  • Ampere
  • Hopper

CUDA Compute Capability

This NIM requires CUDA Compute Capability of ≥ 7.0.