Support Matrix

Models

NVIDIA NIM for Object Detection supports the following models:

Model Name	Model ID	Publisher
NeMo Retriever YOLOX Structured Images v1	nvidia/nv-yolox-structured-images-v1	NVIDIA

Supported Hardware

NeMo Retriever YOLOX Structured Images v1

GPU	GPU Memory (GB)	Precision
A100 PCIe	40 & 80	FP16
A100 SXM4	40 & 80	FP16
H100 PCIe	80	FP16
H100 HBM3	80	FP16
L40s	48	FP16
A10G	24	FP16

Non-optimized configuration

The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model.

GPUs	GPU Memory	Precision	Disk Space
Any NVIDIA GPU with sufficient GPU memory or on multiple, homogenous NVIDIA GPUs with sufficient aggregate memory	1	FP16	17.5

Software

NVIDIA Driver

All releases uses Triton Inference Server 24.05. Please refer to the Release Notes for Triton on NVIDIA driver support.

NVIDIA Container Toolkit

Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.