Support Matrix#
Models#
Model Name |
Model ID |
Publisher |
---|---|---|
BNR |
maxine-bnr |
NVIDIA |
GPUs Optimized#
Hardware Microarchitecture |
GPU |
---|---|
Volta |
V100 |
Turing |
T4 |
Ampere |
A30, A100, A2, A10, A16, A40 |
Ada |
L4, L40, RTX 4080, RTX 4090 |
Hopper |
H100 |
Blackwell |
RTX 5090, 5080, 5070 |
This model uses mixed precision (FP16 + FP32) for all supported GPUs.
Software#
NVIDIA Driver and Prerequisites#
NVIDIA driver requirements and other prerequisites for Maxine BNR NIM:
Prerequisite |
Version |
Download and install steps |
---|---|---|
NVIDIA Graphic Drivers for linux |
571.21+ |
|
Docker |
latest |
Ubuntu, CentOS, Debian: https://docs.docker.com/engine/install/ |
NVIDIA Container Toolkit |
latest |
Installation and configuration instructions: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html |