MSA Search Support Matrix
This page lists the minimum system hardware requirements and the NVIDIA GPUs supported for deploying the MSA Search NIM.
Supported Hardware
The following sections describe the minimum system hardware requirements and the supported NVIDIA GPUs.
Minimum System Hardware Requirements
Supported NVIDIA GPUs
The MSA Search NIM supports NVIDIA GPUs with at least 48 GB of GPU memory. It has been tested on the following recommended configurations:
- Starting with version 2.0.0, GPUs with 48 GB memory (NVIDIA L40S, NVIDIA RTX 6000 Ada Generation) require a minimum of 2 GPUs when using GPU Server (enabled by default). This is because GPU Server holds databases in memory for optimal performance.
- Starting with version 2.4.0, the MSA Search NIM adds support for NVIDIA H200, NVIDIA GH200 144GB, NVIDIA GB200, and NVIDIA GB300. NVIDIA GH200 144GB, NVIDIA GB200, and NVIDIA GB300 are Grace-based platforms (Hopper or Blackwell GPU with NVIDIA Grace CPU). Use container images and host OS builds intended for your CPU architecture (aarch64/arm64 on Grace systems, x86_64/amd64 on typical x86 servers).
- Starting with version 2.5.0, the MSA Search NIM adds support for NVIDIA B300 and NVIDIA GB10 (DGX Spark). NVIDIA GB10 (DGX Spark) uses 128 GB of unified memory shared across CPU and GPU on the Grace Blackwell Superchip architecture. Use aarch64/arm64 container images and host OS builds for NVIDIA GB10 (DGX Spark) deployments.
Software Prerequisites
- Begin with Linux-based Docker-supported operating system
- Install Docker - minimum version: 23.0.1
- Install NVIDIA Drivers - minimum version: 580
- Install the NVIDIA Container Toolkit - minimum version: 1.13.5
- Verify your container runtime supports NVIDIA GPUs by running
Example output:
For more information on enumerating multi-GPU systems, refer to the NVIDIA Container Toolkit’s GPU Enumeration Docs.
Supported CPU architectures: x86_64 / amd64 for typical discrete-GPU servers, and aarch64 / arm64 for NVIDIA Grace-based platforms (NVIDIA GH200 144GB, NVIDIA GB200, NVIDIA GB300, NVIDIA GB10 (DGX Spark)) when using the corresponding container images.