Llama 3.1 Nemotron Safety Guard Multilingual 8B V1 NIM#

About the Microservice#

The microservice serves a GPU-accelerated LLM model that performs multilingual content moderation for building trustworthy LLM applications rather than a general-knowledge LLM. The LLM model detects harmful content in user messages or bot responses in the following languages:

  • Arabic

  • Chinese

  • English

  • French

  • German

  • Hindi

  • Japanese

  • Spanish

  • Thai

The model is a content safety model trained by NVIDIA from the Nemotron Content Safety Dataset Multilingual V1 and cultural adaptation techniques. The dataset has a commercially friendly license and is publicly available to permit community analysis and development.

Audience and Best Use#

One audience for the microservice is developers who develop their own code and want to integrate multilingual content safety to their application. These developers typically have experience with the OpenAI API specification and libraries such as LangChain. The unique prompt template and extracting the safe and unsafe response are shown in the Classifying Safe and Unsafe Content section of the Getting Started page.

Another audience for the microservice want to integrate the multilingual content safety container with NVIDIA NeMo Guardrails. This audience might want to understand how to customize the Prompt Templates. Refer to Integrating with NeMo Guardrails for an introduction and a reference to detailed steps in the NeMo Guardrails documentation.

License#

Component

Artifact Type

Artifact Licenses

Llama 3.1 Nemotron Safety Guard Multilingual 8B V1 NIM

Container

NVIDIA Software License Agreement and the Product-Specific Terms for NVIDIA AI Products.

Llama Nemotron Safety Guard Multilingual 8B V1

Model

NVIDIA Open Model License.

Llama 3.1 Community License Agreement. Built with Llama.