Skip to main content

Ctrl+K

NVIDIA NeMo Microservices

NVIDIA NeMo Microservices

Table of Contents

About NeMo Microservices

Overview
Key Features
Concepts
Release Notes

Get Started

About Getting Started
Beginner Tutorial Prerequisites
Beginner Tutorials

Jupyter Notebooks

Data Flywheel and Tool Calling

Manage Entities

About Managing Entities
Tutorials
- Set Up Organizational Entities
- Create Dataset Files
Namespaces
Projects
Datasets
Models
Entity Fields Reference

Fine-Tune

About Fine-Tuning
Tutorials
Model Catalog
- Llama Models
- Phi Models
Manage Customization Configs
- Get Customization Configs
- Customization Config
Manage Customization Jobs

Evaluate

About Evaluating
Tutorials
- Run a Simple Evaluation
Evaluation Types
Evaluation Jobs
Evaluation Targets
Evaluation Configurations
Custom Evaluations
Evaluation Results
Use Custom Data
Filter and Sort Responses
Support Matrix

Deploy and Proxy NIMs

About Deploying and Proxying NIM for LLMs
Deploy NVIDIA NIM for large language models (LLMs)
Proxy Deployed NIM for LLMs

Manage Guardrails

About Guardrails
Terminology
Tutorials
Manage Configurations
Check a Guardrail
Inference with Guardrails
Streaming Output
Reference

Admin Setup

About Admin Setup
Installation Scenarios
Helm Installation Overview
Install as Platform
Install Individually
Model Configurations
Custom Resource Definitions
Manage Storage
Manage Secrets
Open Telemetry Setup
Tenant Configuration Options
Security for NeMo Microservices

Reference

NeMo Microservice APIs
Requirements
NeMo Helm Chart Values
Troubleshooting Guide
Governing Terms

Resources

OSS License Acknowledgements

NeMo Microservice APIs
Data Store API

Data Store API#

previous

Entity Store API

next

Customizer API

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA Corporation.

Last updated on Apr 24, 2025.