Support Matrix for NVIDIA NIM for Image OCR (NeMo Retriever OCR v1)#
This documentation describes the software and hardware that NVIDIA NIM for Image OCR (NeMo Retriever OCR v1) supports.
Models#
NVIDIA NIM for Image OCR (NeMo Retriever OCR v1) supports the following models:
Model Name |
Model ID |
Publisher |
Model Card |
|---|---|---|---|
NeMo Retriever OCR v1 |
nvidia/nemoretriever-ocr-v1 |
NVIDIA |
- |
Supported Hardware#
NeMo Retriever OCR v1#
The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.
GPUs |
GPU Memory |
Precision |
Disk Space |
|---|---|---|---|
Any single NVIDIA GPU that has sufficient memory, or multiple homogenous NVIDIA GPUs that have sufficient memory in total. |
1 |
FP32 |
9 |
Software#
NVIDIA Driver#
Release 1.0.0 uses Triton Inference Server 25.06. For Triton on NVIDIA driver support, refer to the Release Notes.
If issues arise when you start the NIM containers, run the following code to ensure that the latest NVIDIA drivers are installed.
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
&& curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
sudo apt-get update
sudo apt-get install -y nvidia-container-toolkit
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker
NVIDIA Container Toolkit#
Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.