Skip to navigation

Llama 3.1 Nemotron Safety Guard Multilingual 8B V1 NIM

View as Markdown

About the Microservice

The microservice serves a GPU-accelerated LLM model that performs multilingual content moderation for building trustworthy LLM applications rather than a general-knowledge LLM. The LLM model detects harmful content in user messages or bot responses in the following languages:

  • Arabic

  • Chinese

  • English

  • French

  • German

  • Hindi

  • Japanese

  • Spanish

  • Thai

The model is a content safety model trained by NVIDIA from the Nemotron Content Safety Dataset Multilingual V1 and cultural adaptation techniques. The dataset has a commercially friendly license and is publicly available to permit community analysis and development.

Audience and Best Use

One audience for the microservice is developers who develop their own code and want to integrate multilingual content safety to their application. These developers typically have experience with the OpenAI API specification and libraries such as LangChain. The unique prompt template and extracting the safe and unsafe response are shown in the section of the Getting Started page.

Another audience for the microservice want to integrate the multilingual content safety container with NVIDIA NeMo Guardrails. This audience might want to understand how to customize the Prompt Templates. Refer to Integrating with NeMo Guardrails for an introduction and a reference to detailed steps in the NeMo Guardrails documentation.

License

ComponentArtifact TypeArtifact Licenses
Llama 3.1 Nemotron Safety Guard Multilingual 8B V1 NIMContainerNVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.
Llama Nemotron Safety Guard Multilingual 8B V1ModelNVIDIA Open Model License.
Llama 3.1 Community License Agreement. Built with Llama.