Support Matrix#
Models#
NVIDIA NIM for Table Extraction supports the following models:
Model Name |
Model ID |
Publisher |
|---|---|---|
PaddleOCR |
baidu/paddleocr |
Baidu |
Supported Hardware#
PaddleOCR#
GPU |
GPU Memory (GB) |
Precision |
|---|---|---|
A100 PCIe |
40 & 80 |
FP16 |
A100 SXM4 |
40 & 80 |
FP16 |
H100 PCIe |
80 |
FP16 |
H100 HBM3 |
80 |
FP16 |
H100 NVL |
80 |
FP16 |
L40s |
48 |
FP16 |
A10G |
24 |
FP16 |
Non-optimized configuration#
The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.
GPUs |
GPU Memory |
Precision |
Disk Space |
|---|---|---|---|
Any NVIDIA GPU with sufficient GPU memory or on multiple, homogenous NVIDIA GPUs with sufficient aggregate memory |
1 |
FP16 & FP32 |
19 |
Software#
NVIDIA Driver#
All releases uses Triton Inference Server 24.05. Please refer to the Release Notes for Triton on NVIDIA driver support.
NVIDIA Container Toolkit#
Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.