Skip to navigation

MSA Search Support Matrix

View as MarkdownOpen in Claude

This page lists the minimum system hardware requirements and the NVIDIA GPUs supported for deploying the MSA Search NIM.

Supported Hardware

The following sections describe the minimum system hardware requirements and the supported NVIDIA GPUs.

Minimum System Hardware Requirements

CPU CoresRAM (GB)NVMe SSD Storage (GB)GPU Count
24641,660One or more NVIDIA GPUs from the Supported NVIDIA GPUs

Supported NVIDIA GPUs

The MSA Search NIM supports NVIDIA GPUs with at least 48 GB of GPU memory. It has been tested on the following recommended configurations:

GPUGPU Memory (GB)GPU Count
NVIDIA A100-SXM4-80GB801-8
NVIDIA H100 80GB HBM3801-8
NVIDIA H2001411-8
NVIDIA B2001801-8
NVIDIA B3002881-8
NVIDIA GB2001861-8
NVIDIA GB3002881-8
NVIDIA GH200 144GB1441-8
NVIDIA GB10 (DGX Spark)1281
NVIDIA L40S482-8
NVIDIA RTX 6000 Ada Generation482-4
  • Starting with version 2.0.0, GPUs with 48 GB memory (NVIDIA L40S, NVIDIA RTX 6000 Ada Generation) require a minimum of 2 GPUs when using GPU Server (enabled by default). This is because GPU Server holds databases in memory for optimal performance.
  • Starting with version 2.4.0, the MSA Search NIM adds support for NVIDIA H200, NVIDIA GH200 144GB, NVIDIA GB200, and NVIDIA GB300. NVIDIA GH200 144GB, NVIDIA GB200, and NVIDIA GB300 are Grace-based platforms (Hopper or Blackwell GPU with NVIDIA Grace CPU). Use container images and host OS builds intended for your CPU architecture (aarch64/arm64 on Grace systems, x86_64/amd64 on typical x86 servers).
  • Starting with version 2.5.0, the MSA Search NIM adds support for NVIDIA B300 and NVIDIA GB10 (DGX Spark). NVIDIA GB10 (DGX Spark) uses 128 GB of unified memory shared across CPU and GPU on the Grace Blackwell Superchip architecture. Use aarch64/arm64 container images and host OS builds for NVIDIA GB10 (DGX Spark) deployments.

Software Prerequisites

docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi

Example output:

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 580.82.07 Driver Version: 580.82.07 CUDA Version: 13.0 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA H100 ... On | 00000000:1B:00.0 Off | 0 |
| N/A 33C P0 75W / 700W | 1MiB / 81559MiB | 0% Default |
| | | Disabled |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| No running processes found |
+-----------------------------------------------------------------------------+

For more information on enumerating multi-GPU systems, refer to the NVIDIA Container Toolkit’s GPU Enumeration Docs.

Supported CPU architectures: x86_64 / amd64 for typical discrete-GPU servers, and aarch64 / arm64 for NVIDIA Grace-based platforms (NVIDIA GH200 144GB, NVIDIA GB200, NVIDIA GB300, NVIDIA GB10 (DGX Spark)) when using the corresponding container images.