About Getting Started with NeMo Microservices#

To get started with the NeMo microservices, use the following instructions to find the tutorials that are relevant to your role and needs.

For First-Time Learners

If you want to set up and explore the NeMo microservices as a platform, use the following tutorials.

Beginner Tutorial Prerequisites

Start by deploying the NeMo microservices as a platform on a minikube cluster.

Beginner Tutorial Prerequisites
Beginner Tutorial

Learn how to use the capabilities of the NeMo microservices as an end-to-end platform to customize large language models (LLMs), add safety checks to them, and evaluate them.

Beginner Tutorials

For Exploring the Capabilities of the NeMo Microservices

If you are a data scientist or an AI application developer and have completed the Beginner Tutorials, proceed to the following pages for microservice-level tutorials:

  1. Entity Management Tutorials

  2. Fine-Tuning Tutorials

  3. Guardrail Tutorials

  4. Evaluation Tutorials

  5. About Deploying and Proxying NIM for LLMs

For Deploying NeMo Microservices Platform to Production-grade Kubernetes Cluster

If you are a cluster administrator and have completed a successful deployment of the NeMo microservices platform on a minikube cluster following the Beginner Tutorial Prerequisites guide, proceed to the Admin Setup section to learn more about deploying the NeMo microservices as a platform or a subset of the microservices on a Kubernetes cluster for production.