Skip to navigation

Release Notes

View as Markdown

v1.10.1

Features

  • The model context length increases from 8 K tokens to 128 K tokens.
  • This release adds support for NVIDIA B200 and H200 GPUs.
  • This release adds generic vLLM model profiles. These profiles avoid the high host memory and GPU requirements needed to build a local engine on first run. See the model profiles.

v1.0.0

Features

This is the first release of Llama 3.1 NemoGuard 8B ContentSafety NIM. The microservice serves a GPU-accelerated LLM model that performs content moderation for building trustworthy LLM applications. The LLM model detects harmful content in user messages or bot responses.

Known Issues

  • The tensor parallel 4 GPU model profiles are not runnable. This is a known issue.