Release 1.2.0
Summary
This release adds support for GB200 GPU with ARM architecture and extends hardware compatibility for enterprise deployments.
Key Features
- GB200 Support: Added support for GB200 GPU
- Enhanced compatibility with ARM-based systems
Notes and Limitations
- Ensure you use this NIM with GPUs with at least 48 GB of VRAM.
- CUDA Driver Requirements:
- Minimum version 580 with CUDA 13.0
- TensorRT Engine Speedup: To achieve optimal prediction speedup using TRT engines, this version uses TensorRT 10.11.0. Refer to the TensorRT 10.11.0 Support Matrix to ensure your CUDA Driver and CUDA Toolkit versions are compatible.
While there are many options for tuning this NIM’s performance, for most users, the defaults will provide a balanced performance experience.