Support Matrix#

Models#

Model Name

Model ID

Publisher

BNR

maxine-bnr

NVIDIA

GPUs Optimized#

Hardware Microarchitecture

GPU

Volta

V100

Turing

T4

Ampere

A30, A100, A2, A10, A16, A40

Ada

L4, L40, RTX 4080, RTX 4090

Hopper

H100

Blackwell

RTX 5090, 5080, 5070

This model uses mixed precision (FP16 + FP32) for all supported GPUs.

Software#

NVIDIA Driver and Prerequisites#

NVIDIA driver requirements and other prerequisites for Maxine BNR NIM:

Prerequisite

Version

Download and install steps

NVIDIA Graphic Drivers for linux

571.21+

https://www.nvidia.com/en-us/drivers/unix/

Docker

latest

Ubuntu, CentOS, Debian: https://docs.docker.com/engine/install/
Rocky Linux: https://docs.rockylinux.org/gemstones/containers/docker/

NVIDIA Container Toolkit

latest

Installation and configuration instructions: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html