Support Matrix#

Models#

NVIDIA NIM for Table Extraction supports the following models:

Model Name

Model ID

Publisher

PaddleOCR

baidu/paddleocr

Baidu

Supported Hardware#

PaddleOCR#

GPU

GPU Memory (GB)

Precision

A100 PCIe

40 & 80

FP16

A100 SXM4

40 & 80

FP16

H100 PCIe

80

FP16

H100 HBM3

80

FP16

H100 NVL

80

FP16

L40s

48

FP16

A10G

24

FP16

Non-optimized configuration#

The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.

GPUs

GPU Memory

Precision

Disk Space

Any NVIDIA GPU with sufficient GPU memory or on multiple, homogenous NVIDIA GPUs with sufficient aggregate memory

1

FP16 & FP32

19

Software#

NVIDIA Driver#

All releases uses Triton Inference Server 24.05. Please refer to the Release Notes for Triton on NVIDIA driver support.

NVIDIA Container Toolkit#

Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.