Skip to main content
Ctrl+K
NVIDIA NIM for Large Language Models 2.0 - Home NVIDIA NIM for Large Language Models 2.0 - Home

NVIDIA NIM for Large Language Models 2.0

  • Documentation Home
NVIDIA NIM for Large Language Models 2.0 - Home NVIDIA NIM for Large Language Models 2.0 - Home

NVIDIA NIM for Large Language Models 2.0
  • Documentation Home

Table of Contents

About NVIDIA NIM for LLMs

  • Overview
  • Enterprise-Grade Inference Software Stack
  • Release Notes

Get Started

  • About Get Started
  • Prerequisites
  • Installation
  • Configuration
  • Quickstart

Deployment

  • Model Profiles and Selection
  • Model Download
  • Model-Free NIM
  • Kubernetes Deployment
    • Helm and Kubernetes
    • KServe
    • OpenShift
    • Run:ai
    • NIM Operator Deployment
  • Cloud Service Provider (CSP) Deployment
    • Google Cloud
    • AWS
    • Azure
    • Oracle
  • Air-Gap Deployment
  • Multi-Node Deployment
  • vGPU Deployment

Advanced Use Cases

  • Fine-Tuning with LoRA
  • Custom Logits Processing
  • Prompt Embeddings

Reference

  • Architecture
  • Environment Variables
  • API Reference
  • CLI Reference
  • Advanced Configuration
  • Logging and Observability
  • 1.x Migration Guide
  • Support Matrix

Resources

  • Support and FAQ
  • Related Products
  • Legal

Python Module Index

n
 
n
- nim_llm
    nim_llm.cli.parser
    nim_llm.features.middleware
NVIDIA NVIDIA
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2024-2026, NVIDIA Corporation.

Last updated on Mar 12, 2026.