Support Matrix for NVIDIA NIM for Image OCR (NeMo Retriever OCR)#
This documentation describes the models, software, and hardware that NVIDIA NIM for Image OCR (NeMo Retriever OCR) supports.
Models#
NeMo Retriever OCR supports the following models.
Model |
Model ID |
Model Card |
Variants |
|---|---|---|---|
NeMo Retriever OCR v2 |
|
English, multilingual |
The multilingual variant is the default. Set NIM_ENGINE_MODEL_VARIANT=english to serve the English variant.
For the approximate GPU memory size of each GPU, refer to Performance and Memory for NVIDIA NIM for Image OCR (NeMo Retriever OCR).
For details about model profiles and kernel selection, refer to Model Profiles and Kernel Selection.
Software#
NVIDIA Driver: Install a current NVIDIA driver that supports the CUDA version packaged with the NIM. If the container fails to start, verify that the driver and NVIDIA Container Toolkit are current.
NVIDIA Container Toolkit: Your Docker environment must support NVIDIA GPUs. For installation instructions, refer to the NVIDIA Container Toolkit documentation.
System Requirements#
Use a supported NVIDIA GPU system with a current NVIDIA driver and NVIDIA Container Toolkit. For validated data center systems, refer to the NVIDIA Certified Systems Catalog.
NeMo Retriever OCR v2#
The following table contains the supported GPUs and precisions for NeMo Retriever OCR v2.
GPU |
Precision |
|---|---|
FP16 |
|
FP16 |
|
FP16 |
|
NVIDIA GB10 Grace Blackwell Superchip, such as NVIDIA DGX Spark systems |
FP16 |
FP16 |
|
FP16 |
|
FP16 |
|
FP16 |
|
FP16 |
|
FP16 |
|
FP16 |