NeMo Microservices Documentation#
Welcome to the NeMo Microservices documentation.
Introduction to NeMo Microservices#
Learn about the NeMo microservices, how it works at a high-level, and the key features.
Learn about the NeMo Microservices Platform.
Learn about the key features of the NeMo Microservices Platform.
Learn about the concepts used across the NeMo Microservices Platform.
Release notes for the NeMo microservices.
Tutorials#
Get started with the NeMo microservices by following the tutorials.
Platform End-to-End Tutorials#
Try out the following tutorials to explore the end-to-end capabilities of the NeMo microservices platform.
Get started with the end-to-end tutorials for the NeMo microservices.
Get started with the Jupyter notebooks for the NeMo microservices.
Quickstart Using Docker Compose#
Try out the following NeMo microservices for local testing using Docker Compose. This is a quick way to explore the capabilities of each functional NeMo microservice as a central service before deploying them on a Kubernetes cluster.
Try out the NeMo Data Designer microservice using Docker Compose for local testing.
Try out the NeMo Evaluator microservice using Docker Compose for local testing.
Try out the NeMo Auditor microservice using Docker Compose for local testing.
Try out the NeMo Guardrails microservice using Docker Compose for local testing.
Operation Guides#
Learn how to use each microservice at every stage of the NeMo data flywheel.
Organize and manage AI workloads in the NeMo platform by using namespaces, projects, datasets, and models through the NeMo Entity Store microservice.
Generate synthetic data to train large language models.
Fine-tune your models using customization jobs to improve their performance.
Set evaluation targets, define evaluation configs, and run evaluation jobs to measure your model’s performance.
Audit the safety of your models.
Deploy and proxy NIM for inference.
Manage guardrails to moderate user input and model responses.
Helm Installation for Production#
Install the NeMo microservices as a platform or individually using Helm charts on a production-grade Kubernetes cluster.
Use the admin setup guide to learn about deploying the NeMo microservices to Kubernetes.
Learn about the different deployment scenarios for setting up the NeMo microservices on Kubernetes.
Deploy the entire NeMo microservices as a platform to form a complete data flywheel on your Kubernetes cluster.
Deploy NeMo microservices individually with necessary infrastructure microservices and dependencies.