Skip to navigation

Models

Model NameModel IDPublisher
BNRmaxine-bnrNVIDIA

GPUs Optimized

Hardware MicroarchitectureGPU
VoltaV100
TuringT4
AmpereA30, A100, A2, A10, A16, A40
AdaL4, L40, RTX 4080, RTX 4090
HopperH100
BlackwellRTX 5090, 5080, 5070

This model uses mixed precision (FP16 + FP32) for all supported GPUs.

Software

NVIDIA Driver and Prerequisites

NVIDIA driver requirements and other prerequisites for Maxine BNR NIM:

PrerequisiteVersionDownload and install steps
NVIDIA Graphic Drivers for linux571.21+https://www.nvidia.com/en-us/drivers/unix/
DockerlatestUbuntu, CentOS, Debian: https://docs.docker.com/engine/install/
Rocky Linux: https://docs.rockylinux.org/gemstones/containers/docker/
NVIDIA Container ToolkitlatestInstallation and configuration instructions: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html