Skip to navigation

Models

Model NameModel IDPublisher
BNRbnrNVIDIA

Optimized Configurations

GPUPrecision
T4FP16 + FP32
A2, A10, A16, A40FP16 + FP32
A30, A100FP16 + FP32
L4, L40FP16 + FP32
H100FP16 + FP32
B100, B200FP16 + FP32
B40, RTX PRO 6000 Blackwell Server EditionFP16 + FP32

Other Architectures (Consumer RTX GPUs)

Consumer GPUPrecision
RTX 4090FP16 + FP32
RTX 5090, 5080FP16 + FP32

The BNR NIM is compatible with professional and consumer GPUs that have Tensor cores and are based on the following NVIDIA architectures: Blackwell, Ada, Ampere, and Turing. The RTX-based GPUs are also supported.

CPU Architectures

CPU Architecture
x86_64

Software

Linux Requirements

Prerequisites for BNR NIM on Linux:

PrerequisiteVersionDownload and install steps
NVIDIA Graphic Drivers for linux571.21+https://www.nvidia.com/en-us/drivers/unix/
DockerlatestUbuntu, CentOS, Debian: https://docs.docker.com/engine/install/
Rocky Linux: https://docs.rockylinux.org/gemstones/containers/docker/
NVIDIA Container ToolkitlatestInstallation and configuration instructions: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html