Skip to navigation

Llama 3.1 Nemotron Safety Guard 8B NIM

View as Markdown

About the Microservice

The microservice serves a GPU-accelerated LLM model for multilingual content moderation rather than general knowledge. It detects harmful content in user messages and bot responses in Arabic, Chinese, English, French, German, Hindi, Japanese, Spanish, and Thai.

The model was trained using the Nemotron Safety Guard Dataset V3 and cultural adaptation techniques. The dataset has a commercially friendly license and is publicly available for community analysis and development.

Audience and Best Use

Developers can integrate multilingual content safety into their applications using the standard OpenAI API interface and libraries such as LangChain. The Getting Started page shows how to classify safe and unsafe content.

You can also integrate the container with NVIDIA NeMo Guardrails and customize the prompt template. See Integrating with Guardrails for an introduction and links to detailed instructions.

License

ComponentArtifact TypeArtifact Licenses
Llama 3.1 Nemotron Safety Guard 8B NIMContainerNVIDIA Software License Agreement and Product-Specific Terms for NVIDIA AI Products.
Llama 3.1 Nemotron Safety Guard 8B V3ModelNVIDIA Open Model License. Llama 3.1 Community License Agreement. Built with Llama.