Beginner Tutorials#

Follow the tutorials to explore the end-to-end capabilities of the NeMo microservices platform. This tutorial is for data scientists and AI application developers to learn how to use the NeMo microservices to customize large language models (LLMs), add safety checks to them, and evaluate them.

Note

Before you begin, complete Demo Cluster Setup on Minikube.

Deploy NIM for LLMs

Learn how to deploy a NIM for Llama 3.1 8B Instruct with NeMo Deployment Management.

Deploy NIM for Llama 3.1 8B Instruct
Customize and Evaluate LLMs

Learn how to customize and evaluate the Llama 3.1 8B Instruct model.

Customize the Evaluation Loop
Add Safety Checks to LLMs

Learn how to add safety checks to the Llama 3.1 8B Instruct model.

Insert a Content Safety Check Using NeMo Guardrails
End-to-End Llama Stack Workflow

Learn how to customize, evaluate, and add safety checks using the Llama Stack.

Use Llama Stack API