NVIDIA NIM for Large Language Models

About NVIDIA NIM for LLMs

• Overview
• Benchmarking
• Release Notes
• Models

Get Started

• Get Started with NIM
• Tutorials

Deploy NIM

• Deployment Guide
• Deploy with Helm
• Air Gap Deployment
• Multi-Node Deployment
• Deploy Behind a Proxy

Work with Models

• Model Profiles
• Supported Models
• Fine-Tuned Models
• Reward Models
• Reasoning Models

Use Key Features

• Custom Guided Decoding Backends
• Function (Tool) Calling
• Message Roles
• Observability
• Parameter-Efficient Fine-Tuning
• Structured Generation

Configure Your NIM

• Configure Your NIM
• Deterministic Generation Mode
• KV Cache Reuse
• Repository Override

Reference

• API Reference
• Llama Stack API
• Utilities
• Troubleshoot

Resources

• Acknowledgements
• EULA