Skip to main content

Ctrl+K

NVIDIA NeMo Microservices Documentation

NVIDIA NeMo Microservices Documentation

Table of Contents

About NeMo Microservices

Overview
Key Features
Concepts
Release Notes

Get Started

About Getting Started
Developer Setup
- Developer Setup Requirements
- Minikube
  - Set Up Using NeMo Platform Deployment Script
  - Set Up Manually
Install NeMo Microservices Python SDK
Beginner Platform Tutorials
Jupyter Notebooks

Manage Entities with NeMo Entity Store and NeMo Data Store

About Managing Entities
Tutorials
- Set Up Organizational Entities
- Create Dataset Files
Namespaces
Projects
Datasets
Models
Entity Fields Reference

Design Synthetic Data From Scratch or Seeds with NeMo Data Designer

About Designing Synthetic Data From Scratch or Seeds
Deploy with Docker
Tutorials
Configure Models
Seeding SDG with External Data
Generate Realistic Personal Details
Define Data Columns
Generate Data
- Data Generation Workflow
- Manage Jobs
Data Designer Configuration
- Save Configurations
- Load Configurations
Data Quality

Generate Private Synthetic Data with NeMo Safe Synthesizer (Beta)

About Generating Private Synthetic Data
Deploy with Docker
Tutorials
- Safe Synthesizer 101
Synthesize
Evaluate
- Evaluation Report
Configure
Python SDK
Manage Jobs

Fine-Tune with NeMo Customizer

About Fine-Tuning
Tutorials
Model Catalog
Manage Targets
Manage Configs
Manage Jobs

Evaluate with NeMo Evaluator

About Evaluating
Deploy with Docker
Tutorials
- Run an LLM Harness Eval
- Run an LLM Judge Eval
Evaluation Flows
Targets
Configurations
Jobs
Live Evaluations
API Key Authentication
Results
Filter, Search, and Sort Responses
Support Matrix

Audit Model Safety with NeMo Auditor (Beta)

About Auditing Models
Deploy with Docker
Tutorials
Manage Targets
Manage Configs
Manage Audit Jobs
Viewing Audit Job Results
Reference

Deploy NIM and Run Inference

About Deploying and Running Inference on NIM
Manage NIM Deployments
Run Inference on NIM

Manage Guardrails with NeMo Guardrails

About Guardrails
Terminology
Deploy with Docker
Tutorials
Manage Configurations
Manage Access to Models
Check a Guardrail
Inference with Guardrails
Streaming Output
Observability
Reference

Manage AI Development Workflow with NeMo Studio (Beta)

About Studio
How It Works
Install and Launch Studio
Studio Features Overview
Feature Details

Admin Setup

About Admin Setup
Install as Platform
Install Individually
Infrastructure Configurations
Custom Resource Definitions
Manage Storage
Manage Secrets
OpenTelemetry Setup
Tenant Configuration Options
Security for NeMo Microservices

Reference

System Requirements
NeMo Microservice API Reference
NeMo Microservices Python SDK Reference
- Client APIs
- API Reference
  - nemo_microservices
    
    nemo_microservices.data_designer
    
    nemo_microservices.lib
    
    nemo_microservices.resources
    
    nemo_microservices.types
    
    nemo_microservices.pagination
NeMo Microservices Helm Chart
Troubleshooting
NVIDIA Distribution in Llama Stack
EULA

Resources

OSS License Acknowledgements

NeMo Microservices Python SDK Reference
API Reference
nemo_microservices
nemo_microservices.lib
nemo_microservices.lib.custom_types
nemo_microservices.lib.custom_types.inference

Is this page helpful?

`nemo_microservices.lib.custom_types.inference`#

Submodules#

nemo_microservices.lib.custom_types.inference.model_list_response

previous

nemo_microservices.lib.custom_types

next

nemo_microservices.lib.custom_types.inference.model_list_response

On this page

Submodules

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.