Support Matrix for NVIDIA NIM for Image OCR (NeMo Retriever OCR)

This documentation describes the models, software, and hardware that NVIDIA NIM for Image OCR (NeMo Retriever OCR) supports.

Models

NeMo Retriever OCR supports the following models.

Model	Model ID	Model Card	Variants
NeMo Retriever OCR v2	nvidia/nemotron-ocr-v2	Model card	English, multilingual

The multilingual variant is the default. Set NIM_ENGINE_MODEL_VARIANT=english to serve the English variant.

Software

• NVIDIA Driver: Install a current NVIDIA driver that supports the CUDA version packaged with the NIM. If the container fails to start, verify that the driver and NVIDIA Container Toolkit are current.

• NVIDIA Container Toolkit: Your Docker environment must support NVIDIA GPUs. For installation instructions, see the NVIDIA Container Toolkit documentation.

System Requirements

Use a supported NVIDIA GPU system with a current NVIDIA driver and NVIDIA Container Toolkit. For validated data center systems, see the NVIDIA Certified Systems Catalog.

Supported Hardware

NeMo Retriever OCR supports the following GPUs:

GPU	Precision
NVIDIA A100 SXM4 80GB	FP16
NVIDIA A10G	FP16
NVIDIA B200	FP16
NVIDIA GB10 Grace Blackwell Superchip, such as NVIDIA DGX Spark systems	FP16
NVIDIA GB200	FP16
NVIDIA H100 80GB HBM3	FP16
NVIDIA H100 NVL	FP16
NVIDIA H200	FP16
NVIDIA L4	FP16
NVIDIA L40S	FP16
NVIDIA RTX PRO 6000 Blackwell Server Edition	FP16

For the approximate GPU memory size of each GPU, refer to Performance and Memory for NVIDIA NIM for Image OCR (NeMo Retriever OCR).

For details about model profiles and kernel selection, refer to Model Profiles and Kernel Selection.