Support Matrix for NVIDIA NIM for Image OCR#
This documentation describes the software and hardware that NVIDIA NIM for Image OCR supports.
Models#
NVIDIA NIM for Image OCR supports the following models:
Model Name |
Model ID |
Publisher |
Model Card |
|---|---|---|---|
PaddleOCR |
baidu/paddleocr |
Baidu |
Supported Hardware#
PaddleOCR#
GPU |
GPU Memory (GB) |
Precision |
|---|---|---|
A100 SXM4 |
40 & 80 |
FP16 |
H100 HBM3 |
80 |
FP16 |
H100 NVL |
80 |
FP16 |
L40s |
48 |
FP16 |
A10G |
24 |
FP16 |
L4 |
24 |
FP16 |
GeForce RTX 4090 (Beta) |
24 |
FP16 |
NVIDIA RTX 6000 Ada Generation (Beta) |
48 |
FP16 |
GeForce RTX 5080 (Beta) |
16 |
FP16 |
GeForce RTX 5090 (Beta) |
32 |
FP16 |
Non-optimized configuration#
The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.
GPUs |
GPU Memory |
Precision |
Disk Space |
|---|---|---|---|
Any single NVIDIA GPU that has sufficient memory, or multiple homogenous NVIDIA GPUs that have sufficient memory in total. |
1 |
FP16 |
9 |
Software#
NVIDIA Driver#
Releases prior to 1.1.0 use Triton Inference Server 24.05. For Triton on NVIDIA driver support, refer to the Release Notes.
Release 1.1.0 uses Triton Inference Server 25.01. For Triton on NVIDIA driver support, refer to the Release Notes.
If issues arise when you start the NIM containers, run the following code to ensure that the latest NVIDIA drivers are installed.
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
&& curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
sudo apt-get update
sudo apt-get install -y nvidia-container-toolkit
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker
NVIDIA Container Toolkit#
Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.