Support Matrix

Models

NVIDIA NIM for Table Extraction supports the following models:

Model Name

Model ID

Publisher

PaddleOCR

baidu/paddleocr

Baidu

Supported Hardware

PaddleOCR

GPU

GPU Memory (GB)

Precision

A100 PCIe

40 & 80

FP16

A100 SXM4

40 & 80

FP16

H100 PCIe

80

FP16

H100 HBM3

80

FP16

L40s

48

FP16

A10G

24

FP16

Non-optimized configuration

The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.

GPUs

GPU Memory

Precision

Disk Space

Any NVIDIA GPU with sufficient GPU memory or on multiple, homogenous NVIDIA GPUs with sufficient aggregate memory

1

FP16

19

Software

NVIDIA Driver

All releases uses Triton Inference Server 24.05. Please refer to the Release Notes for Triton on NVIDIA driver support.

NVIDIA Container Toolkit

Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.