Support Matrix
NVIDIA NIM for NV-CLIP runs on any supported NVIDIA GPU. For further information, refer to the Supported Models section.
Linux operating systems (Ubuntu 22.04 or later recommended)
NVIDIA Driver >= 535
NVIDIA Docker >= 23.0.1
These models are optimized using TRT and are available as pre-built, optimized engines on NGC and should use the Embeddings Endpoint.
NV-CLIP NIM
Optimized Configurations
The GPU Memory and Disk Space values are in GB; Disk Space is for both the container and the model; Profile is for what the model is optimized.
GPU |
GPU Memory |
Precision |
# of GPUs |
Disk Space |
|---|---|---|---|---|
| H100 SXM | 80 | FP16 | 1 | 30 |
| H100 PCIe | 80 | FP16 | 1 | 30 |
| A100 SXM | 80 | FP16 | 1 | 30 |
| A100 PCIe | 80 | FP16 | 1 | 30 |
| L40S | 48 | FP16 | 1 | 30 |
| A10G | 24 | FP16 | 1 | 30 |
| A6000 Ada | 48 | FP16 | 1 | 30 |
| RTX 4090 | 48 | FP16 | 1 | 30 |
Non-optimized Configuration
NV-CLIP NIM supports non-optimized configurations on GPUs other than these listed.