Beginner Platform Tutorials#

The following tutorials are for data scientists and AI application developers to explore the end-to-end capabilities of the NeMo microservices platform. The tutorials demonstrate how to set up a complete data flywheel by using NeMo microservices to customize and evaluate large language models (LLMs) and add safety checks.

Note

Before you begin, complete Demo Cluster Setup on Minikube.

Deploy a NIM microservice

Learn how to deploy a NIM microservice for Llama 3.1 8B Instruct with NeMo Deployment Management.

Deploy NIM for Llama 3.1 8B Instruct
Customize and Evaluate LLMs

Learn how to customize and evaluate the Llama 3.1 8B Instruct model.

Customize and Evaluate Large Language Models
Add Safety Checks to LLMs

Learn how to add safety checks to the Llama 3.1 8B Instruct model.

Insert a Content Safety Check Using NeMo Guardrails
End-to-End Llama Stack Workflow

Learn how to customize, evaluate, and add safety checks using the Llama Stack.

Use Llama Stack API