Support Matrix for NVIDIA NIM for Nemotron Parse#
This documentation describes the models, software, and hardware that NVIDIA NIM for Nemotron Parse supports.
Models#
Parse NIM supports the following models.
Model |
Model ID |
Model Card |
|---|---|---|
Nemotron 3.5 Parse |
|
For the approximate GPU memory size of each GPU, refer to Performance and Memory for NVIDIA NIM for Nemotron Parse.
Software#
NVIDIA Driver: Install a current NVIDIA driver that supports the CUDA version packaged with the NIM. If the container fails to start, verify that the driver and NVIDIA Container Toolkit are current.
NVIDIA Container Toolkit: Your Docker environment must support NVIDIA GPUs. For installation instructions, refer to the NVIDIA Container Toolkit documentation.
System Requirements#
Use a supported NVIDIA GPU system with a current NVIDIA driver and NVIDIA Container Toolkit. For validated data center systems, refer to the NVIDIA Certified Systems Catalog.
Nemotron 3.5 Parse#
The following table contains the supported GPUs and precisions for Nemotron 3.5 Parse.
GPU |
Precision |
|---|---|
BF16 |
|
BF16 |
|
BF16 |
|
BF16 |
|
BF16 |
|
BF16 |