Support Matrix#
Models#
NVIDIA NIM for Chart Extraction supports the following models:
Model Name |
Model ID |
Publisher |
|---|---|---|
CACHED |
university-at-buffalo/cached |
University at Buffalo |
Supported Hardware#
CACHED#
In Early Access, the NVIDIA NIM for Chart Extraction has been tested on A100, H100, L40s, and A10G using the non-optimized model. Tensor(RT) optimized models are coming soon!
Non-optimized configuration#
The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.
GPUs |
GPU Memory |
Precision |
Disk Space |
|---|---|---|---|
Any NVIDIA GPU with sufficient GPU memory or on multiple, homogenous NVIDIA GPUs with sufficient aggregate memory |
2.5 |
FP32 |
25 |
Software#
NVIDIA Driver#
All releases uses Triton Inference Server 24.05. Please refer to the Release Notes for Triton on NVIDIA driver support.
NVIDIA Container Toolkit#
Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.