Skip to main content

Ctrl+K

NVIDIA NIM for Large Language Models

Documentation Home

NVIDIA NIM for Large Language Models

Documentation Home

Table of Contents

About NVIDIA NIM for LLMs

Overview
Enterprise-Grade Inference Software Stack
Release Notes

Get Started

About Get Started
Prerequisites
Configuration
Installation
Quickstart

Deployment

Model Profiles and Selection
Model Download
Model-Free NIM
Kubernetes Deployment
Cloud Service Provider (CSP) Deployment
- Google Cloud
- AWS
- Azure
- Oracle
Air-Gap Deployment
Multi-Node Deployment
vGPU Deployment

Advanced Use Cases

Fine-Tuning with LoRA
Tool Calling and MCP Integration
Custom Logits Processing
Prompt Embeddings

AI Assistant Integrations

Use Claude Code with NIM

Reference

Architecture
Environment Variables
API Reference
CLI Reference
Advanced Configuration
Logging and Observability
Model Signature Verification
1.x Migration Guide
Support Matrix
Archived Versions

Troubleshooting

GPU Memory (OOM) Errors
CUDA Driver Initialization

Resources

Support and FAQ
Related Products
Legal

Is this page helpful?

Python Module Index

n


	n
	`nim_llm`
	`nim_llm.cli.parser`
	`nim_llm.features.middleware`

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2026, NVIDIA Corporation.

Last updated on Apr 10, 2026.