Release Notes#

v1.10.1#

Features#

This is the first release of Llama 3.1 Nemotron Safety Guard Multilingual 8B V1 NIM. The microservice serves a GPU-accelerated LLM model that performs multilingual content moderation for building trustworthy LLM applications. The LLM model detects harmful content in user messages or bot responses.

Known Issues#

  • The locally-buildable profiles are not supported with A100 PCIe GPUs. You can workaround the issue by specifying a generic model profile that matches the number of GPUs on the host.