Skip to main content

Ctrl+K

NVIDIA NeMo Microservices

NVIDIA NeMo Microservices

Table of Contents

About NeMo Microservices

Overview
Key Features
Concepts
Release Notes

Get Started

About Getting Started
Demo Cluster Setup on Minikube
Advanced Installation on Kubernetes
Install the NeMo Microservices Python SDK
Beginner Tutorials

Jupyter Notebooks

Data Flywheel and Tool Calling

Manage Entities

About Managing Entities
Tutorials
- Set Up Organizational Entities
- Create Dataset Files
Namespaces
Projects
Datasets
Models
Entity Fields Reference

Fine-Tune

About Fine-Tuning
Tutorials
Model Catalog
Manage Targets
Manage Configs
Manage Jobs

Evaluate

About Evaluating
Install Evaluator
Tutorials
- Run a Simple Job
Evaluation Types
- Agentic
- BFCL
- BigCode
- Custom
- LM Harness
- RAG
- Retriever
Targets
Configurations
Jobs
Live Evaluations
Custom Evaluations
Results
Filter and Sort Responses
Support Matrix

Deploy NIM and Run Inference

About Deploying and Running Inference on NIM
Tutorials
- Deploy NIM
- Run Inference on NIM
Manage NIM Deployments
Run Inference on NIM

Manage Guardrails

About Guardrails
Terminology
Tutorials
Manage Configurations
Manage Access to Models
Check a Guardrail
Inference with Guardrails
Streaming Output
Reference

Admin Setup

About Admin Setup
Helm Installation Scenarios
Helm Installation Overview
Install as Platform
Install Individually
Configure Models
Manage GPUs
Custom Resource Definitions
Manage Storage
Manage Secrets
Open Telemetry Setup
Tenant Configuration Options
Security for NeMo Microservices

Reference

NeMo Microservice APIs
NeMo Microservices Python SDK
Requirements
NeMo Helm Chart Values
- Platform
- DGX Cloud Admission Controller
Troubleshooting Guide
NVIDIA Distribution in Llama Stack
Governing Terms

Resources

OSS License Acknowledgements

NeMo Microservices Python SDK
Types APIs
Shared Params Types
Instruction

Instruction#

class nemo_microservices.types.shared_params.Instruction

Bases: TypedDict

content: Required[str]

type: Required[str]

previous

InputRails

next

JailbreakDetectionConfig

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2025, NVIDIA Corporation.

Last updated on Jul 11, 2025.