Support Matrix for NVIDIA NIM for Image OCR (NeMo Retriever OCR)#
This documentation describes the software and hardware that NVIDIA NIM for Image OCR (NeMo Retriever OCR) supports.
System Requirements#
Use a supported NVIDIA GPU system with a current NVIDIA driver and NVIDIA Container Toolkit. For validated data center systems, see the NVIDIA Certified Systems Catalog.
Model#
Publisher |
Model |
Model ID |
Variants |
Model Card |
|---|---|---|---|---|
NVIDIA |
NeMo Retriever OCR v2 |
|
English, multilingual |
The multilingual variant is the default. Set NIM_ENGINE_MODEL_VARIANT=english to serve the English variant.
Supported Hardware#
The NIM supports the following validated GPU SKUs and precisions.
GPU SKU |
GPU |
Precision |
|---|---|---|
NVIDIA-A100-SXM4-80GB |
NVIDIA A100 SXM4 80GB |
FP16 |
NVIDIA-A10G |
NVIDIA A10G |
FP16 |
NVIDIA-B200 |
NVIDIA B200 |
FP16 |
NVIDIA-GB10 |
NVIDIA GB10 Grace Blackwell Superchip, such as NVIDIA DGX Spark systems |
FP16 |
NVIDIA-GB200 |
NVIDIA GB200 |
FP16 |
NVIDIA-H100-80GB-HBM3 |
NVIDIA H100 80GB HBM3 |
FP16 |
NVIDIA-H100-NVL |
NVIDIA H100 NVL |
FP16 |
NVIDIA-H200 |
NVIDIA H200 |
FP16 |
NVIDIA-L4 |
NVIDIA L4 |
FP16 |
NVIDIA-L40S |
NVIDIA L40S |
FP16 |
NVIDIA-RTX-PRO-6000-Blackwell-Server-Edition |
NVIDIA RTX PRO 6000 Blackwell Server Edition |
FP16 |
For the approximate GPU memory size of each SKU, refer to Performance and Memory for NVIDIA NIM for Image OCR (NeMo Retriever OCR).
Software#
NVIDIA Driver#
Install a current NVIDIA driver that supports the CUDA version packaged with the NIM. If the container fails to start, verify that the driver and NVIDIA Container Toolkit are current.
NVIDIA Container Toolkit#
Your Docker environment must support NVIDIA GPUs. For installation instructions, see the NVIDIA Container Toolkit documentation.