Skip to main content

Ctrl+K

NVIDIA NeMo Microservices

NVIDIA NeMo Microservices

Table of Contents

About NeMo Microservices

Overview
Key Features
Concepts
Release Notes

Get Started

About Getting Started
Demo Cluster Setup
- Demo Cluster Requirements
- Minikube
  - Set Up Using Deployment Scripts
  - Set Up Manually
Install NeMo Microservices Python SDK
Beginner Platform Tutorials
Jupyter Notebooks

Manage Entities

About Managing Entities
Tutorials
- Set Up Organizational Entities
- Create Dataset Files
Namespaces
Projects
Datasets
Models
Entity Fields Reference

Design Synthetic Data From Scratch or Seeds (Beta)

About Designing Synthetic Data From Scratch or Seeds
Deploy with Docker
Tutorials
Configure Models
Seeding SDG with External Data
Generate Realistic Personal Details
Define Data Columns
Generate Data
- Data Generation Workflow
- Manage Jobs
Data Designer Configuration
- Save Configurations
- Load Configurations
Data Quality

Generate Private Synthetic Data (Beta)

About Generating Private Synthetic Data
Deploy with Docker
Tutorials
- Safe Synthesizer 101
Synthesize
Evaluate
- Evaluation Report
Configure
Python SDK
- REST API Reference
- Examples
Manage Jobs

Fine-Tune

About Fine-Tuning
Tutorials
Model Catalog
Manage Targets
Manage Configs
Manage Jobs

Evaluate

About Evaluating
Deploy with Docker
Tutorials
- Run an LLM Harness Eval
- Run an LLM Judge Eval
Evaluation Flows
Targets
Configurations
Jobs
Live Evaluations
API Key Authentication
Results
Filter and Sort Responses
Support Matrix

Audit Model Safety (Beta)

About Auditing Models
Deploy with Docker
Tutorials
Manage Targets
Manage Configs
Run and Manage Audit Jobs
Viewing Audit Job Results
Reference

Deploy NIM and Run Inference

About Deploying and Running Inference on NIM
Tutorials
- Deploy NIM
- Run Inference on NIM
Manage NIM Deployments
Run Inference on NIM

Manage Guardrails

About Guardrails
Terminology
Deploy with Docker
Tutorials
Manage Configurations
Manage Access to Models
Check a Guardrail
Inference with Guardrails
Streaming Output
Observability
Reference

Admin Setup

About Admin Setup
Install as Platform
Install Individually
Infrastructure Configurations
Custom Resource Definitions
Manage Storage
Manage Secrets
OpenTelemetry Setup
Tenant Configuration Options
Security for NeMo Microservices

Reference

System Requirements
NeMo Microservice API Reference
NeMo Microservices Python SDK Reference
- Client APIs
- API Reference
  - nemo_microservices
    
    nemo_microservices.data_designer
    
    nemo_microservices.lib
    
    nemo_microservices.resources
    
    nemo_microservices.types
    
    nemo_microservices.pagination
NeMo Microservices Helm Chart
Troubleshooting
NVIDIA Distribution in Llama Stack
EULA

Resources

OSS License Acknowledgements

NeMo Microservices Python SDK Reference
NeMo Microservices Python API Reference
nemo_microservices
nemo_microservices.resources
nemo_microservices.resources.v2
nemo_microservices.resources.v2.inference
nemo_microservices.resources.v2.inference.deployment_configs

`nemo_microservices.resources.v2.inference.deployment_configs`#

Submodules#

nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs
nemo_microservices.resources.v2.inference.deployment_configs.versions

previous

nemo_microservices.resources.v2.inference

next

nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs

On this page

Submodules

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA Corporation.

Last updated on Oct 15, 2025.