Skip to main content

Ctrl+K

NVIDIA NIM for Large Language Models

Documentation Home

NVIDIA NIM for Large Language Models

Documentation Home

Table of Contents

About NVIDIA NIM for LLMs

Overview
NIM Offerings
Enterprise-Grade Inference Software Stack
Release Notes

Get Started

About Get Started
Prerequisites
Configuration
Installation
Quickstart

Deployment

Model Profiles and Selection
Model Download
Model-Free NIM
Kubernetes Deployment
Cloud Service Provider (CSP) Deployment
- Google Cloud
- AWS
- Azure
- Oracle
Air-Gap Deployment
Multi-Node Deployment
vGPU Deployment

Advanced Use Cases

Fine-Tuning with LoRA
Tool Calling and MCP Integration
Custom Logits Processing
Prompt Embeddings

AI Assistant Integrations

Use Claude Code with NIM

Day 0 NIMs

About Day 0 NIMs
- Support Matrix for Day 0 NIMs
- Get Started with Nemotron-Content-Safety-Reasoning-4B-Experimental

Reference

Architecture
Environment Variables
API Reference
CLI Reference
Advanced Configuration
Logging and Observability
Model Signature Verification
1.x Migration Guide
Support Matrix for Certified NIMs
Archived Versions

Troubleshooting

GPU Memory (OOM) Errors
CUDA Driver Initialization

Resources

Support and FAQ
Related Products
Legal

Is this page helpful?

Search

Ctrl+K

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2026, NVIDIA Corporation.

Last updated on May 11, 2026.