> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# 0.5.0 · 26.06

## Docs

- [About NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/get-started/about.md): Overview of NeMo AutoModel, a PyTorch DTensor-native SPMD library with optimized model implementations and a Hugging Face-compatible API for training, fine-tuning, and as an accelerated backend for other frameworks
- [Key Features and Concepts](https://docs.nvidia.com/nemo/automodel/v0.5/get-started/key-features.md): Key features and core concepts of NeMo AutoModel for scalable LLM and VLM training with Hugging Face integration
- [Install NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/get-started/installation.md): 
- [YAML Configuration](https://docs.nvidia.com/nemo/automodel/v0.5/get-started/configuration.md): 
- [🤗 Transformers API Compatibility](https://docs.nvidia.com/nemo/automodel/v0.5/get-started/hf-compatibility.md): 
- [Repository Structure](https://docs.nvidia.com/nemo/automodel/v0.5/get-started/repo-structure.md): 
- [Announcements](https://docs.nvidia.com/nemo/automodel/v0.5/whats-new/announcements.md): 
- [Release Notes](https://docs.nvidia.com/nemo/automodel/v0.5/whats-new/release-notes.md): 
- [Model Release Log](https://docs.nvidia.com/nemo/automodel/v0.5/whats-new/model-release-log.md): 
- [Performance Summary](https://docs.nvidia.com/nemo/automodel/v0.5/performance/performance-summary.md): 
- [Model Coverage Overview](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/overview.md): 
- [Model Release Log](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/release-log.md): 
- [Troubleshooting Unsupported Models](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/troubleshooting.md): 
- [Large Language Models (LLMs)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/overview.md): 
- [Llama](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/llama.md): 
- [Gemma](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/gemma.md): 
- [Qwen2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/qwen-2.md): 
- [Qwen2 MoE](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/qwen-2-mo-e.md): 
- [Qwen3](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/qwen-3.md): 
- [Qwen3 MoE](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/qwen-3-mo-e.md): 
- [Qwen3-Next](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/qwen-3-next.md): 
- [ERNIE 4.5](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/ernie-4-5.md): 
- [DeepSeek](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/deep-seek.md): 
- [DeepSeek-V3](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/deep-seek-v-3.md): 
- [DeepSeek V4 Flash](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/deep-seek-v-4-flash.md): 
- [Mistral](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/mistral.md): 
- [Mixtral](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/mixtral.md): 
- [Ministral3 / Devstral](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/ministral3-devstral.md): 
- [Phi](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/phi.md): 
- [Phi-3 / Phi-4](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/phi-3-phi-4.md): 
- [Phi-3-Small](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/phi-3-small.md): 
- [Nemotron / Minitron](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/nemotron-minitron.md): 
- [Nemotron-H](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/nemotron-h.md): 
- [Nemotron-Flash](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/nemotron-flash.md): 
- [Nemotron-Super (Llama-3.3-Nemotron-Super-49B)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/nemotron-super-llama-3-3-nemotron-super-49b.md): 
- [ChatGLM](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/chat-glm.md): 
- [GLM-4](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/glm-4.md): 
- [GLM-4 MoE (GLM-4.5 / GLM-4.7)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/glm-4-moe-glm-4-5-glm-4-7.md): 
- [GLM-5 / GLM-5.1 / GLM-5.2 (MoE + DSA)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/glm-5-moe-dsa.md): 
- [Granite](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/granite.md): 
- [Granite MoE](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/granite-mo-e.md): 
- [Bamba](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/bamba.md): 
- [OLMo](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/ol-mo.md): 
- [OLMo2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/ol-mo-2.md): 
- [OLMoE](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/ol-mo-e.md): 
- [GPT-OSS](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/gpt-oss.md): 
- [GPT-2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/gpt-2.md): 
- [GPT-J](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/gpt-j.md): 
- [GPT-NeoX / Pythia](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/gpt-neox-pythia.md): 
- [StarCoder](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/star-coder.md): 
- [StarCoder2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/star-coder-2.md): 
- [Aquila / Aquila2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/aquila-aquila2.md): 
- [Baichuan / Baichuan2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/baichuan-baichuan2.md): 
- [Command-R](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/command-r.md): 
- [Falcon](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/falcon.md): 
- [EXAONE](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/exaone.md): 
- [InternLM](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/intern-lm.md): 
- [Jais](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/jais.md): 
- [MiniMax-M2](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/mini-max-m-2.md): 
- [MiniCPM](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/mini-cpm.md): 
- [Moonlight](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/moonlight.md): 
- [Seed (ByteDance)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/seed-byte-dance.md): 
- [Solar Pro](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/solar-pro.md): 
- [Orion](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/orion.md): 
- [StableLM](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/stable-lm.md): 
- [Step-3.5](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/step-3-5.md): 
- [GritLM](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/grit-lm.md): 
- [Hy3 (HunyuanLarge)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/hy-3-preview.md): 
- [Hy-MT2 (Hunyuan-MT2)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/hy-mt-2.md): 
- [MiMo-V2-Flash](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/mi-mo-v-2-flash.md): 
- [Ling 2.0](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/large-language-models/ling-2-0.md): 
- [Vision Language Models (VLMs)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/overview.md): 
- [Kimi-VL](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/kimi-vl.md): 
- [Gemma 3 VL / Gemma 3n](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/gemma-3-vl-gemma-3n.md): 
- [Gemma 4](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/gemma-4.md): 
- [Qwen2.5-VL](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/qwen2-5-vl.md): 
- [Qwen3-VL / Qwen3-VL-MoE](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/qwen3-vl-qwen3-vl-moe.md): 
- [Qwen3.5-VL](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/qwen3-5-vl.md): 
- [Nemotron-Parse](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/nemotron-parse.md): 
- [Ministral3 VL](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/ministral-3-vl.md): 
- [Mistral Medium 3.5](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/mistral-medium-3-5.md): 
- [Mistral-Small-4](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/mistral-small-4.md): 
- [InternVL](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/intern-vl.md): 
- [Llama 4](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/llama-4.md): 
- [LLaVA-OneVision 1.5](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/l-la-va-one-vision.md): 
- [SmolVLM](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/smol-vlm.md): 
- [LLaVA](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/l-la-va.md): 
- [Step-3.7-Flash](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/step-3-7-flash.md): 
- [MiniMax-M3](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/vision-language-models/minimax-m3.md)
- [Multimodal Models](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/multimodal/overview.md): 
- [BAGEL](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/multimodal/bagel.md): 
- [Omni Models](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/omni/overview.md): 
- [Qwen3-Omni](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/omni/qwen-3-omni.md): 
- [Qwen2.5-Omni](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/omni/qwen2-5-omni.md): 
- [Phi-4-multimodal](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/omni/phi-4-multimodal.md): 
- [Nemotron-3-Nano-Omni](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/omni/nemotron-omni.md): 
- [Diffusion Language Models (dLLMs)](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/dllm/overview.md): 
- [DiffusionGemma](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/dllm/diffusion-gemma.md): 
- [Diffusion Models](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/diffusion/overview.md): 
- [Wan 2.1 T2V](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/diffusion/wan-2-1-t2v.md): 
- [Wan 2.2 T2V-A14B](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/diffusion/wan-2-2-t2v-a14b.md): 
- [FLUX.1-dev](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/diffusion/flux-1-dev.md): 
- [HunyuanVideo 1.5](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/diffusion/hunyuanvideo-1-5.md): 
- [Qwen-Image](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/diffusion/qwen-image.md): 
- [Embedding Models](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/embedding-models/overview.md): 
- [Llama (Bidirectional) for Embedding](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/embedding-models/llama-bidirectional.md): 
- [Ministral3 (Bidirectional) for Embedding](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/embedding-models/ministral3-bidirectional.md): 
- [Reranking Models](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/reranking-models/overview.md): 
- [Llama (Bidirectional) for Reranking](https://docs.nvidia.com/nemo/automodel/v0.5/model-coverage/reranking-models/llama-bidirectional.md): 
- [Recipes and End-to-End Examples](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/overview.md): 
- [Supervised Fine-Tuning (SFT) and Parameter-Efficient Fine-Tuning (PEFT) with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/sft-peft.md): 
- [Function Calling with NeMo AutoModel using FunctionGemma](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/function-calling.md): 
- [Multi-Turn Agent (Tool-Calling) SFT with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/agent-sft.md): End-to-end multi-turn, function-calling SFT on Qwen2.5-3B with the glaive_toolcall dataset
- [Knowledge Distillation with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/knowledge-distillation.md): 
- [Fine-Tune Large MoE LLMs](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/large-moe-fine-tuning.md): 
- [DeepSeek V4 Flash](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/deepseek-v4-flash.md): 
- [Hy3-preview](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/hy3-preview.md): 
- [Fine-Tune Nemotron-3-Ultra-550B](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/nemotron-3-ultra.md): End-to-end LoRA PEFT fine-tuning of Nemotron-3-Ultra-550B on HellaSwag using NeMo AutoModel on GB200 and H100.
- [Pretrain Megatron Core Datasets with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/pretraining.md): 
- [LLM Pre-Training with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/nanogpt-pretraining.md): 
- [Sequence Classification (SFT/PEFT) with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/sequence-classification.md): 
- [Retrieval Fine-Tuning (Bi-Encoder and Cross-Encoder)](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/retrieval-finetune.md): Fine-tune bi-encoder and cross-encoder retrieval models in NeMo AutoModel: data prep, configs, distributed launch, LoRA, hard-negative mining, and evaluation.
- [Fine-Tune Gemma 3 and Gemma 3n](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/gemma-3-3n.md): 
- [Fine-Tune Gemma 4 31B on CORD-v2 Receipts — End-to-End Guide](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/gemma-4.md): 
- [Fine-Tune Qwen3.5-VL](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/qwen3-5-vl.md): 
- [Nemotron-Omni](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/nemotron-omni.md): 
- [Mistral Medium 3.5 VL](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/mistral-medium-3-5.md): 
- [MiniMax-M3](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/minimax-m3.md)
- [Fine-Tune Step-3.7-Flash](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/step-3-7.md): End-to-end SFT and LoRA setup for Stepfun AI's Step-3.7-Flash 198B-A13B MoE vision-language model.
- [Fine-Tune Qwen3-Omni for ASR](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/qwen3-omni-asr.md): End-to-end ASR fine-tuning of Qwen3-Omni-30B on Hugging Face audio datasets with NeMo AutoModel.
- [Diffusion Model Fine-Tuning with NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/diffusion-fine-tuning.md): 
- [Fine-Tuning DiffusionGemma](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/diffusiongemma.md)
- [Train an EAGLE Drafter for Speculative Decoding — End-to-End Guide](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/eagle-speculative-decoding.md): Step-by-step guide for training EAGLE-3 and EAGLE-1 speculative decoding drafters with NeMo AutoModel, from data preparation through SGLang serving.
- [Train a DSpark Drafter for Speculative Decoding](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/dspark-speculative-decoding.md): Train a DSpark semi-autoregressive speculative-decoding drafter with NeMo AutoModel, from data through 2-GPU FSDP2 training.
- [dLLM Fine-Tuning](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/dllm-fine-tuning.md): 
- [Quantization-Aware Training (QAT) in NeMo Automodel](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/qat.md): 
- [Model Training on Databricks](https://docs.nvidia.com/nemo/automodel/v0.5/recipes-e2e-examples/databricks.md): 
- [Dataset Overview: LLM, VLM, and Retrieval Datasets in NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/overview.md): 
- [Integrate Your Own Text Dataset](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/text-dataset.md): 
- [Retrieval Dataset (Embedding Fine-Tuning)](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/retrieval-dataset.md): 
- [Use the ColumnMappedTextInstructionDataset](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/columnmapped-dataset.md): 
- [Use the ColumnMappedTextInstructionIterableDataset (Streaming)](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/columnmapped-iterable.md): 
- [Integrate Your Own Multi-Modal Dataset](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/multi-modal-dataset.md): 
- [Diffusion Dataset Preparation](https://docs.nvidia.com/nemo/automodel/v0.5/datasets/diffusion-dataset.md): 
- [Job Launchers](https://docs.nvidia.com/nemo/automodel/v0.5/job-launchers/overview.md): 
- [Run on Your Local Workstation](https://docs.nvidia.com/nemo/automodel/v0.5/job-launchers/local-workstation.md): 
- [Run on a Cluster](https://docs.nvidia.com/nemo/automodel/v0.5/job-launchers/slurm-cluster.md): 
- [Run with NeMo-Run](https://docs.nvidia.com/nemo/automodel/v0.5/job-launchers/nemo-run.md): 
- [Run on Any Cloud with SkyPilot](https://docs.nvidia.com/nemo/automodel/v0.5/job-launchers/skypilot.md): 
- [SkyPilot k8s](https://docs.nvidia.com/nemo/automodel/v0.5/job-launchers/skypilot-k8s.md): 
- [Checkpointing in NeMo Automodel](https://docs.nvidia.com/nemo/automodel/v0.5/development/checkpointing.md): 
- [Use Gradient (Activation) Checkpointing](https://docs.nvidia.com/nemo/automodel/v0.5/development/gradient-checkpointing.md): 
- [Distributed Setup (Python API)](https://docs.nvidia.com/nemo/automodel/v0.5/development/distributed-setup.md): Configure tensor, pipeline, context, and expert parallelism for NeMoAutoModel* loaders with the typed DistributedSetup object.
- [Pipeline Parallelism with AutoPipeline](https://docs.nvidia.com/nemo/automodel/v0.5/development/pipeline-parallelism.md): 
- [FP8 Training in NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/development/fp8-training.md): 
- [Mixed-Precision Training](https://docs.nvidia.com/nemo/automodel/v0.5/development/mixed-precision-training.md): Recommended dtype patterns for fp32 master weights and optimizer state, bf16 compute, and FSDP2 mixed precision in NeMo AutoModel.
- [MLflow Logging in NeMo AutoModel](https://docs.nvidia.com/nemo/automodel/v0.5/development/mlflow-logging.md): 
- [Breaking Changes](https://docs.nvidia.com/nemo/automodel/v0.5/development/breaking-changes.md): 
- [API Reference](https://docs.nvidia.com/nemo/automodel/v0.5/reference/api-reference.md): Auto-generated Python API reference for the nemo_automodel library.
- [nemo_automodel](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel.md)
- [nemo_automodel.autonvtx](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/autonvtx.md)
- [nemo_automodel.cli](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/cli.md)
- [nemo_automodel.cli.app](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/cli/app.md)
- [nemo_automodel.cli.query_capabilities](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/cli/query_capabilities.md)
- [nemo_automodel.cli.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/cli/utils.md)
- [nemo_automodel.components](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components.md)
- [nemo_automodel.components.attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/attention.md)
- [nemo_automodel.components.attention.dflash_mask](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/attention/dflash_mask.md)
- [nemo_automodel.components.attention.ffpa_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/attention/ffpa_attention.md)
- [nemo_automodel.components.attention.flex_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/attention/flex_attention.md)
- [nemo_automodel.components.attention.idlm_mask](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/attention/idlm_mask.md)
- [nemo_automodel.components.attention.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/attention/utils.md)
- [nemo_automodel.components.checkpoint](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint.md)
- [nemo_automodel.components.checkpoint.addons](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/addons.md)
- [nemo_automodel.components.checkpoint.checkpointing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/checkpointing.md)
- [nemo_automodel.components.checkpoint.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/config.md)
- [nemo_automodel.components.checkpoint.conversion_mapping](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/conversion_mapping.md)
- [nemo_automodel.components.checkpoint.lifecycle](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/lifecycle.md)
- [nemo_automodel.components.checkpoint.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/state_dict_adapter.md)
- [nemo_automodel.components.checkpoint.stateful_wrappers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/stateful_wrappers.md)
- [nemo_automodel.components.checkpoint.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/checkpoint/utils.md)
- [nemo_automodel.components.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/config.md)
- [nemo_automodel.components.config.loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/config/loader.md)
- [nemo_automodel.components.cuda_graphs](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/cuda_graphs.md)
- [nemo_automodel.components.cuda_graphs.partial](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/cuda_graphs/partial.md)
- [nemo_automodel.components.datasets](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets.md)
- [nemo_automodel.components.datasets.audio](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/audio.md)
- [nemo_automodel.components.datasets.audio.collate_fns](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/audio/collate_fns.md)
- [nemo_automodel.components.datasets.audio.datasets](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/audio/datasets.md)
- [nemo_automodel.components.datasets.audio.multi_en](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/audio/multi_en.md)
- [nemo_automodel.components.datasets.datum](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/datum.md)
- [nemo_automodel.components.datasets.diffusion](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion.md)
- [nemo_automodel.components.datasets.diffusion.base_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/base_dataset.md)
- [nemo_automodel.components.datasets.diffusion.collate_fns](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/collate_fns.md)
- [nemo_automodel.components.datasets.diffusion.image_edit_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/image_edit_dataset.md)
- [nemo_automodel.components.datasets.diffusion.loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/loader.md)
- [nemo_automodel.components.datasets.diffusion.meta_files_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/meta_files_dataset.md)
- [nemo_automodel.components.datasets.diffusion.mock_dataloader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/mock_dataloader.md)
- [nemo_automodel.components.datasets.diffusion.multi_tier_bucketing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/multi_tier_bucketing.md)
- [nemo_automodel.components.datasets.diffusion.sampler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/sampler.md)
- [nemo_automodel.components.datasets.diffusion.text_to_image_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/text_to_image_dataset.md)
- [nemo_automodel.components.datasets.diffusion.text_to_video_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/diffusion/text_to_video_dataset.md)
- [nemo_automodel.components.datasets.dllm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/dllm.md)
- [nemo_automodel.components.datasets.dllm.collate](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/dllm/collate.md)
- [nemo_automodel.components.datasets.dllm.corruption](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/dllm/corruption.md)
- [nemo_automodel.components.datasets.lazy_mapped_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/lazy_mapped_dataset.md)
- [nemo_automodel.components.datasets.llm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm.md)
- [nemo_automodel.components.datasets.llm.agent_chat](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/agent_chat.md)
- [nemo_automodel.components.datasets.llm.chat_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/chat_dataset.md)
- [nemo_automodel.components.datasets.llm.column_mapped_text_instruction_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/column_mapped_text_instruction_dataset.md)
- [nemo_automodel.components.datasets.llm.column_mapped_text_instruction_iterable_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/column_mapped_text_instruction_iterable_dataset.md)
- [nemo_automodel.components.datasets.llm.delta_lake_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/delta_lake_dataset.md)
- [nemo_automodel.components.datasets.llm.dspark_cache](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/dspark_cache.md)
- [nemo_automodel.components.datasets.llm.eagle3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/eagle3.md)
- [nemo_automodel.components.datasets.llm.eagle3_cache](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/eagle3_cache.md)
- [nemo_automodel.components.datasets.llm.formatting_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/formatting_utils.md)
- [nemo_automodel.components.datasets.llm.hellaswag](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/hellaswag.md)
- [nemo_automodel.components.datasets.llm.length_grouped_sampler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/length_grouped_sampler.md)
- [nemo_automodel.components.datasets.llm.megatron](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron.md)
- [nemo_automodel.components.datasets.llm.megatron.builder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron/builder.md)
- [nemo_automodel.components.datasets.llm.megatron.gpt_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron/gpt_dataset.md)
- [nemo_automodel.components.datasets.llm.megatron.helpers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron/helpers.md)
- [nemo_automodel.components.datasets.llm.megatron.indexed_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron/indexed_dataset.md)
- [nemo_automodel.components.datasets.llm.megatron.megatron_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron/megatron_utils.md)
- [nemo_automodel.components.datasets.llm.megatron.sampler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron/sampler.md)
- [nemo_automodel.components.datasets.llm.megatron_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/megatron_dataset.md)
- [nemo_automodel.components.datasets.llm.mock](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/mock.md)
- [nemo_automodel.components.datasets.llm.mock_iterable_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/mock_iterable_dataset.md)
- [nemo_automodel.components.datasets.llm.mock_packed](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/mock_packed.md)
- [nemo_automodel.components.datasets.llm.mock_prefix_tree](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/mock_prefix_tree.md)
- [nemo_automodel.components.datasets.llm.mock_seq_cls](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/mock_seq_cls.md)
- [nemo_automodel.components.datasets.llm.nanogpt_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/nanogpt_dataset.md)
- [nemo_automodel.components.datasets.llm.neat_packing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/neat_packing.md)
- [nemo_automodel.components.datasets.llm.offline_cache](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/offline_cache.md)
- [nemo_automodel.components.datasets.llm.packed_sequence](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/packed_sequence.md)
- [nemo_automodel.components.datasets.llm.prefix_tree](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/prefix_tree.md)
- [nemo_automodel.components.datasets.llm.retrieval_collator](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/retrieval_collator.md)
- [nemo_automodel.components.datasets.llm.retrieval_dataset](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/retrieval_dataset.md)
- [nemo_automodel.components.datasets.llm.retrieval_dataset_inline](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/retrieval_dataset_inline.md)
- [nemo_automodel.components.datasets.llm.retrieval_dataset_normalized](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/retrieval_dataset_normalized.md)
- [nemo_automodel.components.datasets.llm.retrieval_distill_collator](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/retrieval_distill_collator.md)
- [nemo_automodel.components.datasets.llm.seq_cls](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/seq_cls.md)
- [nemo_automodel.components.datasets.llm.seq2seq](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/seq2seq.md)
- [nemo_automodel.components.datasets.llm.squad](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/squad.md)
- [nemo_automodel.components.datasets.llm.xlam](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/llm/xlam.md)
- [nemo_automodel.components.datasets.loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/loader.md)
- [nemo_automodel.components.datasets.multimodal](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal.md)
- [nemo_automodel.components.datasets.multimodal.collate_fns](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/collate_fns.md)
- [nemo_automodel.components.datasets.multimodal.datasets](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/datasets.md)
- [nemo_automodel.components.datasets.multimodal.distributed_iterable](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/distributed_iterable.md)
- [nemo_automodel.components.datasets.multimodal.interleave](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/interleave.md)
- [nemo_automodel.components.datasets.multimodal.loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/loader.md)
- [nemo_automodel.components.datasets.multimodal.packing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/packing.md)
- [nemo_automodel.components.datasets.multimodal.parquet_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/parquet_utils.md)
- [nemo_automodel.components.datasets.multimodal.transforms](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/transforms.md)
- [nemo_automodel.components.datasets.multimodal.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/utils.md)
- [nemo_automodel.components.datasets.multimodal.video](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/multimodal/video.md)
- [nemo_automodel.components.datasets.packed_seq](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/packed_seq.md)
- [nemo_automodel.components.datasets.packing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/packing.md)
- [nemo_automodel.components.datasets.reservoir_sampler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/reservoir_sampler.md)
- [nemo_automodel.components.datasets.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/utils.md)
- [nemo_automodel.components.datasets.vlm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm.md)
- [nemo_automodel.components.datasets.vlm.collate_fns](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/collate_fns.md)
- [nemo_automodel.components.datasets.vlm.datasets](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/datasets.md)
- [nemo_automodel.components.datasets.vlm.dspark_collate](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/dspark_collate.md)
- [nemo_automodel.components.datasets.vlm.fake_image](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/fake_image.md)
- [nemo_automodel.components.datasets.vlm.loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/loader.md)
- [nemo_automodel.components.datasets.vlm.mock](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/mock.md)
- [nemo_automodel.components.datasets.vlm.neat_packing_vlm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/neat_packing_vlm.md)
- [nemo_automodel.components.datasets.vlm.pp_media](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/pp_media.md)
- [nemo_automodel.components.datasets.vlm.samplers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/samplers.md)
- [nemo_automodel.components.datasets.vlm.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/datasets/vlm/utils.md)
- [nemo_automodel.components.distributed](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed.md)
- [nemo_automodel.components.distributed.activation_checkpointing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/activation_checkpointing.md)
- [nemo_automodel.components.distributed.blockdiag_cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp.md)
- [nemo_automodel.components.distributed.blockdiag_cp.batch](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp/batch.md)
- [nemo_automodel.components.distributed.blockdiag_cp.exchange](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp/exchange.md)
- [nemo_automodel.components.distributed.blockdiag_cp.kernels](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp/kernels.md)
- [nemo_automodel.components.distributed.blockdiag_cp.packed](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp/packed.md)
- [nemo_automodel.components.distributed.blockdiag_cp.runtime](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp/runtime.md)
- [nemo_automodel.components.distributed.blockdiag_cp.state](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/blockdiag_cp/state.md)
- [nemo_automodel.components.distributed.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/config.md)
- [nemo_automodel.components.distributed.context_parallel](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/context_parallel.md)
- [nemo_automodel.components.distributed.context_parallel.magi](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/context_parallel/magi.md)
- [nemo_automodel.components.distributed.context_parallel.mamba](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/context_parallel/mamba.md)
- [nemo_automodel.components.distributed.context_parallel.sharder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/context_parallel/sharder.md)
- [nemo_automodel.components.distributed.context_parallel.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/context_parallel/utils.md)
- [nemo_automodel.components.distributed.cp_vision_frame_shard](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/cp_vision_frame_shard.md)
- [nemo_automodel.components.distributed.ddp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/ddp.md)
- [nemo_automodel.components.distributed.fsdp_patches](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/fsdp_patches.md)
- [nemo_automodel.components.distributed.fsdp2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/fsdp2.md)
- [nemo_automodel.components.distributed.grad_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/grad_utils.md)
- [nemo_automodel.components.distributed.init_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/init_utils.md)
- [nemo_automodel.components.distributed.megatron_fsdp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/megatron_fsdp.md)
- [nemo_automodel.components.distributed.mesh](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/mesh.md)
- [nemo_automodel.components.distributed.mesh_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/mesh_utils.md)
- [nemo_automodel.components.distributed.model_parallelizer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/model_parallelizer.md)
- [nemo_automodel.components.distributed.multimodal_fsdp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/multimodal_fsdp.md)
- [nemo_automodel.components.distributed.optimized_tp_plans](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/optimized_tp_plans.md)
- [nemo_automodel.components.distributed.parallel_styles](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/parallel_styles.md)
- [nemo_automodel.components.distributed.parallelizer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/parallelizer.md)
- [nemo_automodel.components.distributed.parallelizer_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/parallelizer_utils.md)
- [nemo_automodel.components.distributed.pipelining](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining.md)
- [nemo_automodel.components.distributed.pipelining.autopipeline](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining/autopipeline.md)
- [nemo_automodel.components.distributed.pipelining.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining/config.md)
- [nemo_automodel.components.distributed.pipelining.functional](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining/functional.md)
- [nemo_automodel.components.distributed.pipelining.hf_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining/hf_utils.md)
- [nemo_automodel.components.distributed.pipelining.recv_buffer_pool](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining/recv_buffer_pool.md)
- [nemo_automodel.components.distributed.pipelining.runtime](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/pipelining/runtime.md)
- [nemo_automodel.components.distributed.recompute_replay](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/recompute_replay.md)
- [nemo_automodel.components.distributed.tensor_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/tensor_utils.md)
- [nemo_automodel.components.distributed.thd_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/thd_utils.md)
- [nemo_automodel.components.distributed.tp_replicas](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/tp_replicas.md)
- [nemo_automodel.components.distributed.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/distributed/utils.md)
- [nemo_automodel.components.eval](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/eval.md)
- [nemo_automodel.components.eval.tool_call_evaluator](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/eval/tool_call_evaluator.md)
- [nemo_automodel.components.eval.tool_call_parser](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/eval/tool_call_parser.md)
- [nemo_automodel.components.flow_matching](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching.md)
- [nemo_automodel.components.flow_matching.adapters](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters.md)
- [nemo_automodel.components.flow_matching.adapters.base](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/base.md)
- [nemo_automodel.components.flow_matching.adapters.flux](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/flux.md)
- [nemo_automodel.components.flow_matching.adapters.flux2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/flux2.md)
- [nemo_automodel.components.flow_matching.adapters.hunyuan](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/hunyuan.md)
- [nemo_automodel.components.flow_matching.adapters.ltx2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/ltx2.md)
- [nemo_automodel.components.flow_matching.adapters.qwen_image](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/qwen_image.md)
- [nemo_automodel.components.flow_matching.adapters.qwen_image_21](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/qwen_image_21.md)
- [nemo_automodel.components.flow_matching.adapters.simple](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/adapters/simple.md)
- [nemo_automodel.components.flow_matching.pipeline](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/pipeline.md)
- [nemo_automodel.components.flow_matching.time_shift_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/flow_matching/time_shift_utils.md)
- [nemo_automodel.components.launcher](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher.md)
- [nemo_automodel.components.launcher.base](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/base.md)
- [nemo_automodel.components.launcher.interactive](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/interactive.md)
- [nemo_automodel.components.launcher.nemo_run](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/nemo_run.md)
- [nemo_automodel.components.launcher.nemo_run.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/nemo_run/config.md)
- [nemo_automodel.components.launcher.nemo_run.launcher](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/nemo_run/launcher.md)
- [nemo_automodel.components.launcher.nemo_run.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/nemo_run/utils.md)
- [nemo_automodel.components.launcher.skypilot](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/skypilot.md)
- [nemo_automodel.components.launcher.skypilot.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/skypilot/config.md)
- [nemo_automodel.components.launcher.skypilot.launcher](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/skypilot/launcher.md)
- [nemo_automodel.components.launcher.skypilot.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/launcher/skypilot/utils.md)
- [nemo_automodel.components.loggers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers.md)
- [nemo_automodel.components.loggers.comet_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers/comet_utils.md)
- [nemo_automodel.components.loggers.log_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers/log_utils.md)
- [nemo_automodel.components.loggers.loggers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers/loggers.md)
- [nemo_automodel.components.loggers.metric_logger](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers/metric_logger.md)
- [nemo_automodel.components.loggers.mlflow_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers/mlflow_utils.md)
- [nemo_automodel.components.loggers.wandb_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loggers/wandb_utils.md)
- [nemo_automodel.components.loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss.md)
- [nemo_automodel.components.loss.chunked_ce](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/chunked_ce.md)
- [nemo_automodel.components.loss.dist_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/dist_utils.md)
- [nemo_automodel.components.loss.dllm_loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/dllm_loss.md)
- [nemo_automodel.components.loss.embedding_distill](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/embedding_distill.md)
- [nemo_automodel.components.loss.infonce](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/infonce.md)
- [nemo_automodel.components.loss.intermediate_distill](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/intermediate_distill.md)
- [nemo_automodel.components.loss.kd_loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/kd_loss.md)
- [nemo_automodel.components.loss.linear_ce](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/linear_ce.md)
- [nemo_automodel.components.loss.linear_ce_base](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/linear_ce_base.md)
- [nemo_automodel.components.loss.listmle](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/listmle.md)
- [nemo_automodel.components.loss.loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/loss.md)
- [nemo_automodel.components.loss.masked_ce](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/masked_ce.md)
- [nemo_automodel.components.loss.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/mtp.md)
- [nemo_automodel.components.loss.soft_ce](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/soft_ce.md)
- [nemo_automodel.components.loss.te_parallel_ce](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/te_parallel_ce.md)
- [nemo_automodel.components.loss.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/loss/utils.md)
- [nemo_automodel.components.models](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models.md)
- [nemo_automodel.components.models.bagel](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel.md)
- [nemo_automodel.components.models.bagel.attention_masks](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/attention_masks.md)
- [nemo_automodel.components.models.bagel.autoencoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/autoencoder.md)
- [nemo_automodel.components.models.bagel.configuration](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/configuration.md)
- [nemo_automodel.components.models.bagel.connector](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/connector.md)
- [nemo_automodel.components.models.bagel.embeddings](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/embeddings.md)
- [nemo_automodel.components.models.bagel.hf_backbone_loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/hf_backbone_loader.md)
- [nemo_automodel.components.models.bagel.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/model.md)
- [nemo_automodel.components.models.bagel.modeling_qwen2_packed](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/modeling_qwen2_packed.md)
- [nemo_automodel.components.models.bagel.modeling_siglip_navit](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/modeling_siglip_navit.md)
- [nemo_automodel.components.models.bagel.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/parallelization.md)
- [nemo_automodel.components.models.bagel.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/bagel/state_dict_adapter.md)
- [nemo_automodel.components.models.baichuan](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/baichuan.md)
- [nemo_automodel.components.models.baichuan.configuration](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/baichuan/configuration.md)
- [nemo_automodel.components.models.baichuan.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/baichuan/model.md)
- [nemo_automodel.components.models.common](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common.md)
- [nemo_automodel.components.models.common.bidirectional](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/bidirectional.md)
- [nemo_automodel.components.models.common.cudnn_sparse_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/cudnn_sparse_attention.md)
- [nemo_automodel.components.models.common.gated_delta_net_fp32](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/gated_delta_net_fp32.md)
- [nemo_automodel.components.models.common.hf_checkpointing_mixin](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/hf_checkpointing_mixin.md)
- [nemo_automodel.components.models.common.inbatch_neg_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/inbatch_neg_utils.md)
- [nemo_automodel.components.models.common.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/mtp.md)
- [nemo_automodel.components.models.common.mtp.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/mtp/mtp.md)
- [nemo_automodel.components.models.common.packing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/packing.md)
- [nemo_automodel.components.models.common.tie_word_embeddings](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/tie_word_embeddings.md)
- [nemo_automodel.components.models.common.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/common/utils.md)
- [nemo_automodel.components.models.deepseek_v3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v3.md)
- [nemo_automodel.components.models.deepseek_v3.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v3/layers.md)
- [nemo_automodel.components.models.deepseek_v3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v3/model.md)
- [nemo_automodel.components.models.deepseek_v3.rope_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v3/rope_utils.md)
- [nemo_automodel.components.models.deepseek_v3.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v3/state_dict_adapter.md)
- [nemo_automodel.components.models.deepseek_v32](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v32.md)
- [nemo_automodel.components.models.deepseek_v32.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v32/config.md)
- [nemo_automodel.components.models.deepseek_v32.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v32/layers.md)
- [nemo_automodel.components.models.deepseek_v32.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v32/model.md)
- [nemo_automodel.components.models.deepseek_v32.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v32/state_dict_adapter.md)
- [nemo_automodel.components.models.deepseek_v4](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4.md)
- [nemo_automodel.components.models.deepseek_v4.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/config.md)
- [nemo_automodel.components.models.deepseek_v4.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/cp.md)
- [nemo_automodel.components.models.deepseek_v4.fsdp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/fsdp.md)
- [nemo_automodel.components.models.deepseek_v4.kernels](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels.md)
- [nemo_automodel.components.models.deepseek_v4.kernels.sparse_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels/sparse_attention.md)
- [nemo_automodel.components.models.deepseek_v4.kernels.tilelang_indexer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels/tilelang_indexer.md)
- [nemo_automodel.components.models.deepseek_v4.kernels.tilelang_indexer_bwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels/tilelang_indexer_bwd.md)
- [nemo_automodel.components.models.deepseek_v4.kernels.tilelang_indexer_fwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels/tilelang_indexer_fwd.md)
- [nemo_automodel.components.models.deepseek_v4.kernels.tilelang_sparse_mla_bwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels/tilelang_sparse_mla_bwd.md)
- [nemo_automodel.components.models.deepseek_v4.kernels.tilelang_sparse_mla_fwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/kernels/tilelang_sparse_mla_fwd.md)
- [nemo_automodel.components.models.deepseek_v4.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/layers.md)
- [nemo_automodel.components.models.deepseek_v4.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/model.md)
- [nemo_automodel.components.models.deepseek_v4.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/mtp.md)
- [nemo_automodel.components.models.deepseek_v4.optimized_kernels](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/optimized_kernels.md)
- [nemo_automodel.components.models.deepseek_v4.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/parallelization.md)
- [nemo_automodel.components.models.deepseek_v4.processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/processing.md)
- [nemo_automodel.components.models.deepseek_v4.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/state_dict_adapter.md)
- [nemo_automodel.components.models.deepseek_v4.vision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v4/vision.md)
- [nemo_automodel.components.models.deepseek_v41](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41.md)
- [nemo_automodel.components.models.deepseek_v41.attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/attention.md)
- [nemo_automodel.components.models.deepseek_v41.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/config.md)
- [nemo_automodel.components.models.deepseek_v41.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/cp.md)
- [nemo_automodel.components.models.deepseek_v41.dspark](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/dspark.md)
- [nemo_automodel.components.models.deepseek_v41.engram](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/engram.md)
- [nemo_automodel.components.models.deepseek_v41.fsdp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/fsdp.md)
- [nemo_automodel.components.models.deepseek_v41.indexer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/indexer.md)
- [nemo_automodel.components.models.deepseek_v41.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/layers.md)
- [nemo_automodel.components.models.deepseek_v41.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/model.md)
- [nemo_automodel.components.models.deepseek_v41.packing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/packing.md)
- [nemo_automodel.components.models.deepseek_v41.processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/processing.md)
- [nemo_automodel.components.models.deepseek_v41.quantization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/quantization.md)
- [nemo_automodel.components.models.deepseek_v41.rope_triton](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/rope_triton.md)
- [nemo_automodel.components.models.deepseek_v41.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/state_dict_adapter.md)
- [nemo_automodel.components.models.deepseek_v41.vision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deepseek_v41/vision.md)
- [nemo_automodel.components.models.deprecation](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/deprecation.md)
- [nemo_automodel.components.models.diffusion_gemma](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/diffusion_gemma.md)
- [nemo_automodel.components.models.diffusion_gemma.attention_mask](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/diffusion_gemma/attention_mask.md)
- [nemo_automodel.components.models.diffusion_gemma.fsdp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/diffusion_gemma/fsdp.md)
- [nemo_automodel.components.models.diffusion_gemma.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/diffusion_gemma/layers.md)
- [nemo_automodel.components.models.diffusion_gemma.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/diffusion_gemma/model.md)
- [nemo_automodel.components.models.diffusion_gemma.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/diffusion_gemma/state_dict_adapter.md)
- [nemo_automodel.components.models.ernie4_5](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ernie4_5.md)
- [nemo_automodel.components.models.ernie4_5.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ernie4_5/model.md)
- [nemo_automodel.components.models.ernie4_5.rope_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ernie4_5/rope_utils.md)
- [nemo_automodel.components.models.ernie4_5.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ernie4_5/state_dict_adapter.md)
- [nemo_automodel.components.models.gemma4_drafter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_drafter.md)
- [nemo_automodel.components.models.gemma4_drafter.composite](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_drafter/composite.md)
- [nemo_automodel.components.models.gemma4_drafter.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_drafter/model.md)
- [nemo_automodel.components.models.gemma4_moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe.md)
- [nemo_automodel.components.models.gemma4_moe.cp_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/cp_attention.md)
- [nemo_automodel.components.models.gemma4_moe.cp_batch](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/cp_batch.md)
- [nemo_automodel.components.models.gemma4_moe.cp_local_ring](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/cp_local_ring.md)
- [nemo_automodel.components.models.gemma4_moe.loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/loss.md)
- [nemo_automodel.components.models.gemma4_moe.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/model.md)
- [nemo_automodel.components.models.gemma4_moe.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/parallelization.md)
- [nemo_automodel.components.models.gemma4_moe.sdpa_fp32](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/sdpa_fp32.md)
- [nemo_automodel.components.models.gemma4_moe.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_moe/state_dict_adapter.md)
- [nemo_automodel.components.models.gemma4_unified](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_unified.md)
- [nemo_automodel.components.models.gemma4_unified.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_unified/model.md)
- [nemo_automodel.components.models.gemma4_unified.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gemma4_unified/state_dict_adapter.md)
- [nemo_automodel.components.models.glm_moe_dsa](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa.md)
- [nemo_automodel.components.models.glm_moe_dsa.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/config.md)
- [nemo_automodel.components.models.glm_moe_dsa.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/cp.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.cudnn_dsa](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/cudnn_dsa.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.indexer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/indexer.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.sparse_mla](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/sparse_mla.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_bwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/tilelang_indexer_bwd.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/tilelang_indexer_fwd.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_sparse_mla_bwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/tilelang_sparse_mla_bwd.md)
- [nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_sparse_mla_fwd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/kernels/tilelang_sparse_mla_fwd.md)
- [nemo_automodel.components.models.glm_moe_dsa.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/layers.md)
- [nemo_automodel.components.models.glm_moe_dsa.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/model.md)
- [nemo_automodel.components.models.glm_moe_dsa.optimized_kernels](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/optimized_kernels.md)
- [nemo_automodel.components.models.glm_moe_dsa.rope_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/rope_utils.md)
- [nemo_automodel.components.models.glm_moe_dsa.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm_moe_dsa/state_dict_adapter.md)
- [nemo_automodel.components.models.glm4_moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm4_moe.md)
- [nemo_automodel.components.models.glm4_moe.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm4_moe/layers.md)
- [nemo_automodel.components.models.glm4_moe.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm4_moe/model.md)
- [nemo_automodel.components.models.glm4_moe.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm4_moe/state_dict_adapter.md)
- [nemo_automodel.components.models.glm4_moe_lite](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm4_moe_lite.md)
- [nemo_automodel.components.models.glm4_moe_lite.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm4_moe_lite/model.md)
- [nemo_automodel.components.models.glm5_next](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next.md)
- [nemo_automodel.components.models.glm5_next.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/config.md)
- [nemo_automodel.components.models.glm5_next.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/cp.md)
- [nemo_automodel.components.models.glm5_next.image_processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/image_processing.md)
- [nemo_automodel.components.models.glm5_next.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/layers.md)
- [nemo_automodel.components.models.glm5_next.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/model.md)
- [nemo_automodel.components.models.glm5_next.processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/processing.md)
- [nemo_automodel.components.models.glm5_next.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/state_dict_adapter.md)
- [nemo_automodel.components.models.glm5_next.vision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/glm5_next/vision.md)
- [nemo_automodel.components.models.gpt_oss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gpt_oss.md)
- [nemo_automodel.components.models.gpt_oss.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gpt_oss/layers.md)
- [nemo_automodel.components.models.gpt_oss.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gpt_oss/model.md)
- [nemo_automodel.components.models.gpt_oss.rope_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gpt_oss/rope_utils.md)
- [nemo_automodel.components.models.gpt_oss.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gpt_oss/state_dict_adapter.md)
- [nemo_automodel.components.models.gpt2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/gpt2.md)
- [nemo_automodel.components.models.hunyuan_image3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3.md)
- [nemo_automodel.components.models.hunyuan_image3.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/config.md)
- [nemo_automodel.components.models.hunyuan_image3.flow_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/flow_adapter.md)
- [nemo_automodel.components.models.hunyuan_image3.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/layers.md)
- [nemo_automodel.components.models.hunyuan_image3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/model.md)
- [nemo_automodel.components.models.hunyuan_image3.pipeline](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/pipeline.md)
- [nemo_automodel.components.models.hunyuan_image3.release](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/release.md)
- [nemo_automodel.components.models.hunyuan_image3.rope](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/rope.md)
- [nemo_automodel.components.models.hunyuan_image3.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hunyuan_image3/state_dict_adapter.md)
- [nemo_automodel.components.models.hy_mt2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_mt2.md)
- [nemo_automodel.components.models.hy_mt2.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_mt2/config.md)
- [nemo_automodel.components.models.hy_mt2.dispatch](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_mt2/dispatch.md)
- [nemo_automodel.components.models.hy_mt2.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_mt2/layers.md)
- [nemo_automodel.components.models.hy_mt2.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_mt2/model.md)
- [nemo_automodel.components.models.hy_mt2.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_mt2/state_dict_adapter.md)
- [nemo_automodel.components.models.hy_v3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_v3.md)
- [nemo_automodel.components.models.hy_v3.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_v3/config.md)
- [nemo_automodel.components.models.hy_v3.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_v3/layers.md)
- [nemo_automodel.components.models.hy_v3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_v3/model.md)
- [nemo_automodel.components.models.hy_v3.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/hy_v3/state_dict_adapter.md)
- [nemo_automodel.components.models.inkling](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling.md)
- [nemo_automodel.components.models.inkling.configuration](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/configuration.md)
- [nemo_automodel.components.models.inkling.feature_extraction](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/feature_extraction.md)
- [nemo_automodel.components.models.inkling.image_processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/image_processing.md)
- [nemo_automodel.components.models.inkling.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/layers.md)
- [nemo_automodel.components.models.inkling.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/model.md)
- [nemo_automodel.components.models.inkling.multimodal](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/multimodal.md)
- [nemo_automodel.components.models.inkling.processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/processing.md)
- [nemo_automodel.components.models.inkling.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/state_dict_adapter.md)
- [nemo_automodel.components.models.inkling.text](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/inkling/text.md)
- [nemo_automodel.components.models.kimi_k2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k2.md)
- [nemo_automodel.components.models.kimi_k2.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k2/config.md)
- [nemo_automodel.components.models.kimi_k25_vl](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k25_vl.md)
- [nemo_automodel.components.models.kimi_k25_vl.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k25_vl/model.md)
- [nemo_automodel.components.models.kimi_k25_vl.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k25_vl/state_dict_adapter.md)
- [nemo_automodel.components.models.kimi_k3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3.md)
- [nemo_automodel.components.models.kimi_k3.attn_res_triton](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/attn_res_triton.md)
- [nemo_automodel.components.models.kimi_k3.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/config.md)
- [nemo_automodel.components.models.kimi_k3.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/cp.md)
- [nemo_automodel.components.models.kimi_k3.encoding](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/encoding.md)
- [nemo_automodel.components.models.kimi_k3.kda_fused](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/kda_fused.md)
- [nemo_automodel.components.models.kimi_k3.kda_fused.chunk_kda_bwd_triton](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/kda_fused/chunk_kda_bwd_triton.md)
- [nemo_automodel.components.models.kimi_k3.kda_fused.chunk_kda_fwd_cuda](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/kda_fused/chunk_kda_fwd_cuda.md)
- [nemo_automodel.components.models.kimi_k3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/model.md)
- [nemo_automodel.components.models.kimi_k3.multimodal](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/multimodal.md)
- [nemo_automodel.components.models.kimi_k3.situ](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/situ.md)
- [nemo_automodel.components.models.kimi_k3.situ_triton](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/situ_triton.md)
- [nemo_automodel.components.models.kimi_k3.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/state_dict_adapter.md)
- [nemo_automodel.components.models.kimi_k3.tokenization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/tokenization.md)
- [nemo_automodel.components.models.kimi_k3.vision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_k3/vision.md)
- [nemo_automodel.components.models.kimi_linear](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_linear.md)
- [nemo_automodel.components.models.kimi_linear.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_linear/config.md)
- [nemo_automodel.components.models.kimi_linear.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_linear/cp.md)
- [nemo_automodel.components.models.kimi_linear.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_linear/model.md)
- [nemo_automodel.components.models.kimi_linear.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimi_linear/state_dict_adapter.md)
- [nemo_automodel.components.models.kimivl](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimivl.md)
- [nemo_automodel.components.models.kimivl.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/kimivl/model.md)
- [nemo_automodel.components.models.laguna](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/laguna.md)
- [nemo_automodel.components.models.laguna.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/laguna/config.md)
- [nemo_automodel.components.models.laguna.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/laguna/model.md)
- [nemo_automodel.components.models.laguna.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/laguna/state_dict_adapter.md)
- [nemo_automodel.components.models.ling_v2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ling_v2.md)
- [nemo_automodel.components.models.ling_v2.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ling_v2/config.md)
- [nemo_automodel.components.models.ling_v2.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ling_v2/layers.md)
- [nemo_automodel.components.models.ling_v2.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ling_v2/model.md)
- [nemo_automodel.components.models.ling_v2.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ling_v2/state_dict_adapter.md)
- [nemo_automodel.components.models.llama](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama.md)
- [nemo_automodel.components.models.llama.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama/model.md)
- [nemo_automodel.components.models.llama.rope_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama/rope_utils.md)
- [nemo_automodel.components.models.llama_bidirectional](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama_bidirectional.md)
- [nemo_automodel.components.models.llama_bidirectional.export_onnx](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama_bidirectional/export_onnx.md)
- [nemo_automodel.components.models.llama_bidirectional.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama_bidirectional/model.md)
- [nemo_automodel.components.models.llama_nemotron_vl](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama_nemotron_vl.md)
- [nemo_automodel.components.models.llama_nemotron_vl.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama_nemotron_vl/model.md)
- [nemo_automodel.components.models.llama_nemotron_vl.processor](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llama_nemotron_vl/processor.md)
- [nemo_automodel.components.models.llava_onevision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llava_onevision.md)
- [nemo_automodel.components.models.llava_onevision.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llava_onevision/model.md)
- [nemo_automodel.components.models.llava_onevision.rice_vit](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llava_onevision/rice_vit.md)
- [nemo_automodel.components.models.llava_onevision.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/llava_onevision/state_dict_adapter.md)
- [nemo_automodel.components.models.mimo_v2_flash](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash.md)
- [nemo_automodel.components.models.mimo_v2_flash.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash/config.md)
- [nemo_automodel.components.models.mimo_v2_flash.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash/cp.md)
- [nemo_automodel.components.models.mimo_v2_flash.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash/model.md)
- [nemo_automodel.components.models.mimo_v2_flash.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash/parallelization.md)
- [nemo_automodel.components.models.mimo_v2_flash.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash/state_dict_adapter.md)
- [nemo_automodel.components.models.mimo_v2_flash.vision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v2_flash/vision.md)
- [nemo_automodel.components.models.mimo_v25](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v25.md)
- [nemo_automodel.components.models.mimo_v25.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v25/config.md)
- [nemo_automodel.components.models.mimo_v25.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v25/model.md)
- [nemo_automodel.components.models.mimo_v25.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mimo_v25/state_dict_adapter.md)
- [nemo_automodel.components.models.minimax_m2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m2.md)
- [nemo_automodel.components.models.minimax_m2.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m2/layers.md)
- [nemo_automodel.components.models.minimax_m2.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m2/model.md)
- [nemo_automodel.components.models.minimax_m2.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m2/state_dict_adapter.md)
- [nemo_automodel.components.models.minimax_m3_vl](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl.md)
- [nemo_automodel.components.models.minimax_m3_vl.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/config.md)
- [nemo_automodel.components.models.minimax_m3_vl.cp_sparse_attn](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/cp_sparse_attn.md)
- [nemo_automodel.components.models.minimax_m3_vl.flops](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/flops.md)
- [nemo_automodel.components.models.minimax_m3_vl.kernels](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/kernels.md)
- [nemo_automodel.components.models.minimax_m3_vl.kernels.msa_backward_postprocess_sm100](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/kernels/msa_backward_postprocess_sm100.md)
- [nemo_automodel.components.models.minimax_m3_vl.kernels.msa_backward_preprocess_sm100](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/kernels/msa_backward_preprocess_sm100.md)
- [nemo_automodel.components.models.minimax_m3_vl.kernels.msa_backward_sm100](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/kernels/msa_backward_sm100.md)
- [nemo_automodel.components.models.minimax_m3_vl.kernels.msa_schedule](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/kernels/msa_schedule.md)
- [nemo_automodel.components.models.minimax_m3_vl.kernels.msa_task_build_sm100](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/kernels/msa_task_build_sm100.md)
- [nemo_automodel.components.models.minimax_m3_vl.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/layers.md)
- [nemo_automodel.components.models.minimax_m3_vl.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/model.md)
- [nemo_automodel.components.models.minimax_m3_vl.msa](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/msa.md)
- [nemo_automodel.components.models.minimax_m3_vl.msa_bindings](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/msa_bindings.md)
- [nemo_automodel.components.models.minimax_m3_vl.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/mtp.md)
- [nemo_automodel.components.models.minimax_m3_vl.processing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/processing.md)
- [nemo_automodel.components.models.minimax_m3_vl.recompute](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/recompute.md)
- [nemo_automodel.components.models.minimax_m3_vl.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/state_dict_adapter.md)
- [nemo_automodel.components.models.minimax_m3_vl.vision_encoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/minimax_m3_vl/vision_encoder.md)
- [nemo_automodel.components.models.ministral_bidirectional](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ministral_bidirectional.md)
- [nemo_automodel.components.models.ministral_bidirectional.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ministral_bidirectional/model.md)
- [nemo_automodel.components.models.ministral_bidirectional.processor](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ministral_bidirectional/processor.md)
- [nemo_automodel.components.models.ministral_bidirectional.reranker_export](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ministral_bidirectional/reranker_export.md)
- [nemo_automodel.components.models.ministral_bidirectional.reranker_model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/ministral_bidirectional/reranker_model.md)
- [nemo_automodel.components.models.mistral3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral3.md)
- [nemo_automodel.components.models.mistral3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral3/model.md)
- [nemo_automodel.components.models.mistral3.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral3/state_dict_adapter.md)
- [nemo_automodel.components.models.mistral3_vlm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral3_vlm.md)
- [nemo_automodel.components.models.mistral3_vlm.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral3_vlm/model.md)
- [nemo_automodel.components.models.mistral3_vlm.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral3_vlm/state_dict_adapter.md)
- [nemo_automodel.components.models.mistral4](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral4.md)
- [nemo_automodel.components.models.mistral4.configuration](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral4/configuration.md)
- [nemo_automodel.components.models.mistral4.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral4/model.md)
- [nemo_automodel.components.models.mistral4.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/mistral4/state_dict_adapter.md)
- [nemo_automodel.components.models.muse_glimmer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/muse_glimmer.md)
- [nemo_automodel.components.models.muse_glimmer.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/muse_glimmer/config.md)
- [nemo_automodel.components.models.muse_glimmer.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/muse_glimmer/model.md)
- [nemo_automodel.components.models.muse_glimmer.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/muse_glimmer/parallelization.md)
- [nemo_automodel.components.models.muse_glimmer.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/muse_glimmer/state_dict_adapter.md)
- [nemo_automodel.components.models.muse_glimmer.vision](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/muse_glimmer/vision.md)
- [nemo_automodel.components.models.nemotron_omni](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_omni.md)
- [nemo_automodel.components.models.nemotron_omni.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_omni/model.md)
- [nemo_automodel.components.models.nemotron_omni.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_omni/state_dict_adapter.md)
- [nemo_automodel.components.models.nemotron_parse](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_parse.md)
- [nemo_automodel.components.models.nemotron_parse.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_parse/model.md)
- [nemo_automodel.components.models.nemotron_parse.nemotron_parse_loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_parse/nemotron_parse_loss.md)
- [nemo_automodel.components.models.nemotron_v3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3.md)
- [nemo_automodel.components.models.nemotron_v3.cache](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3/cache.md)
- [nemo_automodel.components.models.nemotron_v3.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3/layers.md)
- [nemo_automodel.components.models.nemotron_v3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3/model.md)
- [nemo_automodel.components.models.nemotron_v3.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3/mtp.md)
- [nemo_automodel.components.models.nemotron_v3.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3/parallelization.md)
- [nemo_automodel.components.models.nemotron_v3.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/nemotron_v3/state_dict_adapter.md)
- [nemo_automodel.components.models.pixtral](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/pixtral.md)
- [nemo_automodel.components.models.pixtral.compat](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/pixtral/compat.md)
- [nemo_automodel.components.models.qwen_image_edit](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen_image_edit.md)
- [nemo_automodel.components.models.qwen_image_edit.adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen_image_edit/adapter.md)
- [nemo_automodel.components.models.qwen_image_edit.preprocessing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen_image_edit/preprocessing.md)
- [nemo_automodel.components.models.qwen2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen2.md)
- [nemo_automodel.components.models.qwen2.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen2/model.md)
- [nemo_automodel.components.models.qwen2_5_omni](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen2_5_omni.md)
- [nemo_automodel.components.models.qwen2_5_omni.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen2_5_omni/model.md)
- [nemo_automodel.components.models.qwen2_5_omni.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen2_5_omni/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3.md)
- [nemo_automodel.components.models.qwen3.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3/model.md)
- [nemo_automodel.components.models.qwen3_5](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5.md)
- [nemo_automodel.components.models.qwen3_5.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5/model.md)
- [nemo_automodel.components.models.qwen3_5.packing](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5/packing.md)
- [nemo_automodel.components.models.qwen3_5.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5/parallelization.md)
- [nemo_automodel.components.models.qwen3_5.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3_5_moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5_moe.md)
- [nemo_automodel.components.models.qwen3_5_moe.cp_linear_attn](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5_moe/cp_linear_attn.md)
- [nemo_automodel.components.models.qwen3_5_moe.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5_moe/model.md)
- [nemo_automodel.components.models.qwen3_5_moe.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_5_moe/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3_8_flash_next](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.backend](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/backend.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/config.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/cp.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.engram](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/engram.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.fa4_qsa](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/fa4_qsa.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.flex_qsa](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/flex_qsa.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/layers.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/model.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.qsa](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/qsa.md)
- [nemo_automodel.components.models.qwen3_8_flash_next.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_8_flash_next/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3_moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_moe.md)
- [nemo_automodel.components.models.qwen3_moe.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_moe/layers.md)
- [nemo_automodel.components.models.qwen3_moe.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_moe/model.md)
- [nemo_automodel.components.models.qwen3_moe.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_moe/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3_next](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_next.md)
- [nemo_automodel.components.models.qwen3_next.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_next/layers.md)
- [nemo_automodel.components.models.qwen3_next.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_next/model.md)
- [nemo_automodel.components.models.qwen3_next.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_next/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3_omni_moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_omni_moe.md)
- [nemo_automodel.components.models.qwen3_omni_moe.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_omni_moe/model.md)
- [nemo_automodel.components.models.qwen3_omni_moe.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_omni_moe/state_dict_adapter.md)
- [nemo_automodel.components.models.qwen3_reranker](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_reranker.md)
- [nemo_automodel.components.models.qwen3_reranker.collator](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_reranker/collator.md)
- [nemo_automodel.components.models.qwen3_reranker.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_reranker/model.md)
- [nemo_automodel.components.models.qwen3_vl](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_vl.md)
- [nemo_automodel.components.models.qwen3_vl.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_vl/model.md)
- [nemo_automodel.components.models.qwen3_vl.parallelization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_vl/parallelization.md)
- [nemo_automodel.components.models.qwen3_vl_moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_vl_moe.md)
- [nemo_automodel.components.models.qwen3_vl_moe.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_vl_moe/model.md)
- [nemo_automodel.components.models.qwen3_vl_moe.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/qwen3_vl_moe/state_dict_adapter.md)
- [nemo_automodel.components.models.step3p5](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p5.md)
- [nemo_automodel.components.models.step3p5.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p5/layers.md)
- [nemo_automodel.components.models.step3p5.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p5/model.md)
- [nemo_automodel.components.models.step3p5.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p5/state_dict_adapter.md)
- [nemo_automodel.components.models.step3p7](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7.md)
- [nemo_automodel.components.models.step3p7.configuration_step3p7](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7/configuration_step3p7.md)
- [nemo_automodel.components.models.step3p7.model](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7/model.md)
- [nemo_automodel.components.models.step3p7.mtp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7/mtp.md)
- [nemo_automodel.components.models.step3p7.processing_step3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7/processing_step3.md)
- [nemo_automodel.components.models.step3p7.state_dict_adapter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7/state_dict_adapter.md)
- [nemo_automodel.components.models.step3p7.vision_encoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/models/step3p7/vision_encoder.md)
- [nemo_automodel.components.moe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe.md)
- [nemo_automodel.components.moe.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/config.md)
- [nemo_automodel.components.moe.experts](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/experts.md)
- [nemo_automodel.components.moe.fsdp_mixin](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/fsdp_mixin.md)
- [nemo_automodel.components.moe.layers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/layers.md)
- [nemo_automodel.components.moe.load_balance_metrics](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/load_balance_metrics.md)
- [nemo_automodel.components.moe.megatron](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/megatron.md)
- [nemo_automodel.components.moe.megatron.fused_a2a](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/megatron/fused_a2a.md)
- [nemo_automodel.components.moe.megatron.fused_indices_converter](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/megatron/fused_indices_converter.md)
- [nemo_automodel.components.moe.megatron.moe_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/megatron/moe_utils.md)
- [nemo_automodel.components.moe.megatron.token_dispatcher](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/megatron/token_dispatcher.md)
- [nemo_automodel.components.moe.mok_experts](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/mok_experts.md)
- [nemo_automodel.components.moe.mxfp8](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/mxfp8.md)
- [nemo_automodel.components.moe.optimized_ops](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/optimized_ops.md)
- [nemo_automodel.components.moe.parallelizer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/parallelizer.md)
- [nemo_automodel.components.moe.quantized_experts](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/quantized_experts.md)
- [nemo_automodel.components.moe.router_replay](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/router_replay.md)
- [nemo_automodel.components.moe.state_dict_mixin](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/state_dict_mixin.md)
- [nemo_automodel.components.moe.state_dict_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/state_dict_utils.md)
- [nemo_automodel.components.moe.swiglu_triton](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/swiglu_triton.md)
- [nemo_automodel.components.moe.tp_plan_validation](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/tp_plan_validation.md)
- [nemo_automodel.components.moe.uccl_ep](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/uccl_ep.md)
- [nemo_automodel.components.moe.uccl_ep.buffer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/moe/uccl_ep/buffer.md)
- [nemo_automodel.components.optim](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/optim.md)
- [nemo_automodel.components.optim.dion](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/optim/dion.md)
- [nemo_automodel.components.optim.optimizer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/optim/optimizer.md)
- [nemo_automodel.components.optim.precision_warnings](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/optim/precision_warnings.md)
- [nemo_automodel.components.optim.scheduler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/optim/scheduler.md)
- [nemo_automodel.components.quantization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/quantization.md)
- [nemo_automodel.components.quantization.fp8](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/quantization/fp8.md)
- [nemo_automodel.components.quantization.mxfp4](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/quantization/mxfp4.md)
- [nemo_automodel.components.quantization.qat](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/quantization/qat.md)
- [nemo_automodel.components.quantization.qlora](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/quantization/qlora.md)
- [nemo_automodel.components.speculative](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative.md)
- [nemo_automodel.components.speculative.bench_common](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/bench_common.md)
- [nemo_automodel.components.speculative.bench_sglang](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/bench_sglang.md)
- [nemo_automodel.components.speculative.bench_sweep](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/bench_sweep.md)
- [nemo_automodel.components.speculative.bench_vllm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/bench_vllm.md)
- [nemo_automodel.components.speculative.decode_eval](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/decode_eval.md)
- [nemo_automodel.components.speculative.dflash](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash.md)
- [nemo_automodel.components.speculative.dflash.core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/core.md)
- [nemo_automodel.components.speculative.dflash.dflash2_core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/dflash2_core.md)
- [nemo_automodel.components.speculative.dflash.domino_core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/domino_core.md)
- [nemo_automodel.components.speculative.dflash.draft_kimi_k3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/draft_kimi_k3.md)
- [nemo_automodel.components.speculative.dflash.draft_qwen3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/draft_qwen3.md)
- [nemo_automodel.components.speculative.dflash.draft_qwen3_dflash2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/draft_qwen3_dflash2.md)
- [nemo_automodel.components.speculative.dflash.jetspec_core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/jetspec_core.md)
- [nemo_automodel.components.speculative.dflash.registry](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/registry.md)
- [nemo_automodel.components.speculative.dflash.target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dflash/target.md)
- [nemo_automodel.components.speculative.dspark](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark.md)
- [nemo_automodel.components.speculative.dspark.common](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/common.md)
- [nemo_automodel.components.speculative.dspark.config](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/config.md)
- [nemo_automodel.components.speculative.dspark.core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/core.md)
- [nemo_automodel.components.speculative.dspark.draft_deepseek_v4](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/draft_deepseek_v4.md)
- [nemo_automodel.components.speculative.dspark.draft_gemma4](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/draft_gemma4.md)
- [nemo_automodel.components.speculative.dspark.draft_glm_5_2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/draft_glm_5_2.md)
- [nemo_automodel.components.speculative.dspark.draft_kimi_k3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/draft_kimi_k3.md)
- [nemo_automodel.components.speculative.dspark.draft_minimax_m3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/draft_minimax_m3.md)
- [nemo_automodel.components.speculative.dspark.draft_qwen3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/draft_qwen3.md)
- [nemo_automodel.components.speculative.dspark.loss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/loss.md)
- [nemo_automodel.components.speculative.dspark.markov_head](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/markov_head.md)
- [nemo_automodel.components.speculative.dspark.registry](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/registry.md)
- [nemo_automodel.components.speculative.dspark.target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/target.md)
- [nemo_automodel.components.speculative.dspark.target_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/dspark/target_utils.md)
- [nemo_automodel.components.speculative.eagle](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle.md)
- [nemo_automodel.components.speculative.eagle.backend](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/backend.md)
- [nemo_automodel.components.speculative.eagle.core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/core.md)
- [nemo_automodel.components.speculative.eagle.core_v12](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/core_v12.md)
- [nemo_automodel.components.speculative.eagle.draft_deepseek](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/draft_deepseek.md)
- [nemo_automodel.components.speculative.eagle.draft_gemma](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/draft_gemma.md)
- [nemo_automodel.components.speculative.eagle.draft_gpt_oss](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/draft_gpt_oss.md)
- [nemo_automodel.components.speculative.eagle.draft_kimi_k3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/draft_kimi_k3.md)
- [nemo_automodel.components.speculative.eagle.draft_llama](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/draft_llama.md)
- [nemo_automodel.components.speculative.eagle.draft_llama_v12](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/draft_llama_v12.md)
- [nemo_automodel.components.speculative.eagle.msd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/msd.md)
- [nemo_automodel.components.speculative.eagle.msd_curriculum](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/msd_curriculum.md)
- [nemo_automodel.components.speculative.eagle.msd_decode](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/msd_decode.md)
- [nemo_automodel.components.speculative.eagle.msd_target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/msd_target.md)
- [nemo_automodel.components.speculative.eagle.peagle_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/peagle_attention.md)
- [nemo_automodel.components.speculative.eagle.peagle_data](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/peagle_data.md)
- [nemo_automodel.components.speculative.eagle.peagle_draft](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/peagle_draft.md)
- [nemo_automodel.components.speculative.eagle.peagle_trainer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/peagle_trainer.md)
- [nemo_automodel.components.speculative.eagle.registry](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/registry.md)
- [nemo_automodel.components.speculative.eagle.remote](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/remote.md)
- [nemo_automodel.components.speculative.eagle.remote.client](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/remote/client.md)
- [nemo_automodel.components.speculative.eagle.remote.protocol](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/remote/protocol.md)
- [nemo_automodel.components.speculative.eagle.remote.server](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/remote/server.md)
- [nemo_automodel.components.speculative.eagle.remote.transport](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/remote/transport.md)
- [nemo_automodel.components.speculative.eagle.remote.wire](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/remote/wire.md)
- [nemo_automodel.components.speculative.eagle.ring_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/ring_attention.md)
- [nemo_automodel.components.speculative.eagle.sglang_runner](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/sglang_runner.md)
- [nemo_automodel.components.speculative.eagle.sglang_target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/sglang_target.md)
- [nemo_automodel.components.speculative.eagle.target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/target.md)
- [nemo_automodel.components.speculative.eagle.target_runner](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/target_runner.md)
- [nemo_automodel.components.speculative.eagle.target_v12](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/target_v12.md)
- [nemo_automodel.components.speculative.eagle.ulysses_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/ulysses_attention.md)
- [nemo_automodel.components.speculative.eagle.vispec_core](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/vispec_core.md)
- [nemo_automodel.components.speculative.eagle.vispec_draft](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/vispec_draft.md)
- [nemo_automodel.components.speculative.eagle.vispec_target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/vispec_target.md)
- [nemo_automodel.components.speculative.eagle.vllm_runner](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/vllm_runner.md)
- [nemo_automodel.components.speculative.eagle.vllm_target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/vllm_target.md)
- [nemo_automodel.components.speculative.eagle.zigzag_ring_attention](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/eagle/zigzag_ring_attention.md)
- [nemo_automodel.components.speculative.precompute_dspark](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/precompute_dspark.md)
- [nemo_automodel.components.speculative.precompute_eagle3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/precompute_eagle3.md)
- [nemo_automodel.components.speculative.regen_loop](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/regen_loop.md)
- [nemo_automodel.components.speculative.regenerate](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/regenerate.md)
- [nemo_automodel.components.speculative.regenerate_vlm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/regenerate_vlm.md)
- [nemo_automodel.components.speculative.serve_sglang](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/serve_sglang.md)
- [nemo_automodel.components.speculative.serve_target](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/serve_target.md)
- [nemo_automodel.components.speculative.serve_vllm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/serve_vllm.md)
- [nemo_automodel.components.speculative.streaming](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming.md)
- [nemo_automodel.components.speculative.streaming.async_pipeline](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/async_pipeline.md)
- [nemo_automodel.components.speculative.streaming.eagle3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/eagle3.md)
- [nemo_automodel.components.speculative.streaming.loader](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/loader.md)
- [nemo_automodel.components.speculative.streaming.producer](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/producer.md)
- [nemo_automodel.components.speculative.streaming.queue](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/queue.md)
- [nemo_automodel.components.speculative.streaming.refs](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/refs.md)
- [nemo_automodel.components.speculative.streaming.store](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/store.md)
- [nemo_automodel.components.speculative.streaming.stores](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/stores.md)
- [nemo_automodel.components.speculative.streaming.stores.local](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/stores/local.md)
- [nemo_automodel.components.speculative.streaming.stores.shared_dir](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/streaming/stores/shared_dir.md)
- [nemo_automodel.components.speculative.target_cp](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/speculative/target_cp.md)
- [nemo_automodel.components.training](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training.md)
- [nemo_automodel.components.training.domain_mixture](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/domain_mixture.md)
- [nemo_automodel.components.training.ema](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/ema.md)
- [nemo_automodel.components.training.embedding_row_repair](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/embedding_row_repair.md)
- [nemo_automodel.components.training.garbage_collection](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/garbage_collection.md)
- [nemo_automodel.components.training.model_output_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/model_output_utils.md)
- [nemo_automodel.components.training.neftune](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/neftune.md)
- [nemo_automodel.components.training.prewarm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/prewarm.md)
- [nemo_automodel.components.training.rng](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/rng.md)
- [nemo_automodel.components.training.signal_handler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/signal_handler.md)
- [nemo_automodel.components.training.step_scheduler](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/step_scheduler.md)
- [nemo_automodel.components.training.timers](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/timers.md)
- [nemo_automodel.components.training.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/training/utils.md)
- [nemo_automodel.components.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/utils.md)
- [nemo_automodel.components.utils.compile_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/utils/compile_utils.md)
- [nemo_automodel.components.utils.flops_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/utils/flops_utils.md)
- [nemo_automodel.components.utils.model_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/utils/model_utils.md)
- [nemo_automodel.components.utils.yaml_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/components/utils/yaml_utils.md)
- [nemo_automodel.package_info](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/package_info.md)
- [nemo_automodel.recipes](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes.md)
- [nemo_automodel.recipes.base_recipe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/base_recipe.md)
- [nemo_automodel.recipes.diffusion](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/diffusion.md)
- [nemo_automodel.recipes.diffusion.train](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/diffusion/train.md)
- [nemo_automodel.recipes.dllm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/dllm.md)
- [nemo_automodel.recipes.dllm.strategy](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/dllm/strategy.md)
- [nemo_automodel.recipes.dllm.train_ft](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/dllm/train_ft.md)
- [nemo_automodel.recipes.kd_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/kd_utils.md)
- [nemo_automodel.recipes.llm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm.md)
- [nemo_automodel.recipes.llm.benchmark](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/benchmark.md)
- [nemo_automodel.recipes.llm.kd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/kd.md)
- [nemo_automodel.recipes.llm.peagle_recipe](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/peagle_recipe.md)
- [nemo_automodel.recipes.llm.precompute_dspark_dist](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/precompute_dspark_dist.md)
- [nemo_automodel.recipes.llm.train_dflash](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_dflash.md)
- [nemo_automodel.recipes.llm.train_dflash2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_dflash2.md)
- [nemo_automodel.recipes.llm.train_domino](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_domino.md)
- [nemo_automodel.recipes.llm.train_dspark](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_dspark.md)
- [nemo_automodel.recipes.llm.train_eagle1](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_eagle1.md)
- [nemo_automodel.recipes.llm.train_eagle2](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_eagle2.md)
- [nemo_automodel.recipes.llm.train_eagle3](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_eagle3.md)
- [nemo_automodel.recipes.llm.train_ft](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_ft.md)
- [nemo_automodel.recipes.llm.train_jetspec](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_jetspec.md)
- [nemo_automodel.recipes.llm.train_seq_cls](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_seq_cls.md)
- [nemo_automodel.recipes.llm.train_vispec](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/llm/train_vispec.md)
- [nemo_automodel.recipes.multimodal](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/multimodal.md)
- [nemo_automodel.recipes.multimodal.finetune](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/multimodal/finetune.md)
- [nemo_automodel.recipes.multimodal.pretrain](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/multimodal/pretrain.md)
- [nemo_automodel.recipes.retrieval](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/retrieval.md)
- [nemo_automodel.recipes.retrieval.distill_bi_encoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/retrieval/distill_bi_encoder.md)
- [nemo_automodel.recipes.retrieval.mine_hard_negatives](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/retrieval/mine_hard_negatives.md)
- [nemo_automodel.recipes.retrieval.mining_encoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/retrieval/mining_encoder.md)
- [nemo_automodel.recipes.retrieval.train_bi_encoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/retrieval/train_bi_encoder.md)
- [nemo_automodel.recipes.retrieval.train_cross_encoder](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/retrieval/train_cross_encoder.md)
- [nemo_automodel.recipes.vlm](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/vlm.md)
- [nemo_automodel.recipes.vlm.finetune](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/vlm/finetune.md)
- [nemo_automodel.recipes.vlm.kd](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/recipes/vlm/kd.md)
- [nemo_automodel.shared](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared.md)
- [nemo_automodel.shared.embedding_padding](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/embedding_padding.md)
- [nemo_automodel.shared.import_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/import_utils.md)
- [nemo_automodel.shared.model_utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/model_utils.md)
- [nemo_automodel.shared.parameter_names](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/parameter_names.md)
- [nemo_automodel.shared.retrieval_ids](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/retrieval_ids.md)
- [nemo_automodel.shared.te_patches](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/te_patches.md)
- [nemo_automodel.shared.tied_weights](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/tied_weights.md)
- [nemo_automodel.shared.tokenizer_serialization](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/tokenizer_serialization.md)
- [nemo_automodel.shared.torch_patches](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/torch_patches.md)
- [nemo_automodel.shared.tp_linear](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/tp_linear.md)
- [nemo_automodel.shared.transformers_patches](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/transformers_patches.md)
- [nemo_automodel.shared.utils](https://docs.nvidia.com/nemo/automodel/v0.5/nemo-automodel/nemo_automodel/shared/utils.md)


> **Note:** This page contains both a page directory (above) and the landing page content (below). The page directory is generated for agent use and does not appear on the landing page.

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# NeMo AutoModel Documentation

> NeMo AutoModel is a PyTorch DTensor-native SPMD open-source training library for scalable LLM and VLM training and fine-tuning with day-0 Hugging Face model support

PyTorch-native training that scales from 1 GPU to thousands with a single config change. Load any Hugging Face model, point at your data, and start training; no checkpoint conversion and no boilerplate.

## Quick Links

🤗 HF Compatible

🚀 Performance

📐 Scalability

🎯 SFT & PEFT

🎨 Diffusion

👁️ VLM

🌐 Omni

🌊 dLLM

🔊 Audio

⚡ Speculative

#### [About](/get-started/about)

Overview of NeMo AutoModel and its capabilities.

#### [Key Features](/get-started/key-features)

Supported workflows, parallelism, recipes, and benchmarks.

#### [🤗 HF Integration](/get-started/hf-compatibility)

A `transformers`-compatible library with accelerated model implementations.

#### [Model Coverage](/model-coverage/overview)

Built on `transformers` for day-0 model support and OOTB compatibility.

## Get Started

```bash
uv pip install nemo-automodel

automodel --nproc-per-node=2 llama3_2_1b_squad.yaml
```

See the [installation guide](/get-started/installation) for Docker, source builds, and multi-node setup.
See the [configuration guide](/get-started/configuration) for YAML recipes and CLI overrides.
Launch on a [local workstation](/job-launchers/local-workstation) or [SLURM cluster](/job-launchers/slurm-cluster).

## Latest Model Support

New models are added regularly. Pick a model below to start fine-tuning, or see the [full release log](/model-coverage/release-log).

| Date       | Modality  | Model                                                                                                                                                                                                        |
| ---------- | --------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| 2026-05-19 | LLM       | Ling 2.0 ([recipes](https://github.com/NVIDIA-NeMo/Automodel/tree/main/examples/llm_finetune/ling))                                                                                                          |
| 2026-05-18 | Audio     | Qwen3-Omni ASR ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/audio_finetune/qwen3_omni_asr/ami_sft.yaml))                                                                            |
| 2026-05-17 | LLM       | ERNIE 4.5 ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/llm_finetune/ernie4_5/ernie4_5_21b_a3b_hellaswag.yaml))                                                                      |
| 2026-05-17 | LLM       | MiMo-V2-Flash ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/llm_finetune/mimo_v2_flash/mimo_v2_flash_hellaswag.yaml))                                                                |
| 2026-04-07 | LLM       | [GLM-5.1](https://github.com/NVIDIA-NeMo/Automodel/discussions/1719) ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/llm_finetune/glm/glm_5.1_hellaswag_pp.yaml))                      |
| 2026-04-02 | VLM       | Gemma 4 ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/vlm_finetune/gemma4/gemma4_4b.yaml))                                                                                           |
| 2026-03-16 | VLM       | [Mistral Small 4](https://github.com/NVIDIA-NeMo/Automodel/discussions/1558) ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/vlm_finetune/mistral4/mistral4_medpix.yaml))              |
| 2026-03-11 | LLM       | [Nemotron Super v3](https://github.com/NVIDIA-NeMo/Automodel/discussions/976) ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/llm_finetune/nemotron/nemotron_super_v3_hellaswag.yaml)) |
| 2026-03-03 | Diffusion | FLUX.1-dev ([recipe](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/diffusion/finetune/flux_t2i_flow.yaml))                                                                                     |

## Recipes and Guides

Find the right guide for your task: fine-tuning, pretraining, distillation, diffusion, and more.

| I want to...                    | Choose this when...                                                                               | Input Data                                        | Model      | Guide                                                                  |
| ------------------------------- | ------------------------------------------------------------------------------------------------- | ------------------------------------------------- | ---------- | ---------------------------------------------------------------------- |
| **SFT (full fine-tune)**        | You need maximum accuracy and have the GPU budget to update all weights                           | Instruction / chat dataset                        | LLM        | [Start fine-tuning](/recipes-e2e-examples/sft-peft)                    |
| **PEFT (LoRA)**                 | You want to fine-tune on limited GPU memory; updates \<1 % of parameters                          | Instruction / chat dataset                        | LLM        | [Start LoRA](/recipes-e2e-examples/sft-peft)                           |
| **Tool / function calling**     | Your model needs to call APIs or tools with structured arguments                                  | Function-calling dataset (queries + tool schemas) | LLM        | [Add tool calling](/recipes-e2e-examples/function-calling)             |
| **Fine-tune VLM**               | Your task involves both images and text (e.g., visual QA, captioning)                             | Image + text dataset                              | VLM        | [Fine-tune VLM](/recipes-e2e-examples/gemma-3-3n)                      |
| **Fine-tune Gemma 4**           | You want to fine-tune Gemma 4 for structured extraction from images (e.g., receipts)              | Image + text dataset                              | VLM        | [Fine-tune Gemma 4](/recipes-e2e-examples/gemma-4)                     |
| **Fine-tune dLLM**              | You want to fine-tune a diffusion language model (e.g., LLaDA) using masked denoising             | Instruction / chat dataset                        | dLLM       | [Fine-tune dLLM](/recipes-e2e-examples/dllm-fine-tuning)               |
| **Fine-tune Diffusion**         | You want to fine-tune a diffusion model for image or video generation                             | Video / Image dataset                             | Diffusion  | [Fine-tune Diffusion](/recipes-e2e-examples/diffusion-fine-tuning)     |
| **Fine-tune VLM-MoE**           | You need large-scale vision-language training with sparse MoE efficiency                          | Image + text dataset                              | VLM (MoE)  | [Fine-tune VLM-MoE](/recipes-e2e-examples/qwen3-5-vl)                  |
| **Fine-tune agentic VLM-MoE**   | You need image/video context for agentic developer workflows                                      | Image / video + text dataset                      | VLM (MoE)  | [Fine-tune Step-3.7-Flash](/recipes-e2e-examples/step-3-7)             |
| **Fine-tune Audio ASR**         | Adapt Qwen3-Omni for speech recognition on HF audio datasets                                      | Audio + transcript dataset                        | Qwen3-Omni | [Fine-tune Qwen3-Omni ASR](/recipes-e2e-examples/qwen3-omni-asr)       |
| **Embedding fine-tune**         | You want to improve text similarity for search, retrieval, or RAG                                 | Text pairs / retrieval corpus                     | LLM        | Coming Soon                                                            |
| **Fine-tune a large MoE**       | You are adapting a large sparse MoE model (DeepSeek-V3, GLM-5, etc.) to your domain               | Text dataset (e.g., HellaSwag)                    | LLM (MoE)  | [Fine-tune MoE](/recipes-e2e-examples/large-moe-fine-tuning)           |
| **Fine-tune DeepSeek V4 Flash** | You want to fine-tune the DeepSeek V4 Flash hybrid-attention MoE (SWA / CSA / HCA + hash-routing) | Text dataset (e.g., HellaSwag)                    | LLM (MoE)  | [Fine-tune DeepSeek V4 Flash](/recipes-e2e-examples/deepseek-v4-flash) |
| **Fine-tune Hy3-preview**       | You want to fine-tune Tencent's 295B MoE with sigmoid routing and per-head QK RMSNorm             | Text dataset (e.g., HellaSwag)                    | LLM (MoE)  | [Fine-tune Hy3-preview](/recipes-e2e-examples/hy3-preview)             |
| **Fine-tune Nemotron-3 Ultra**  | You want to fine-tune NVIDIA's 550B-A55B hybrid Mamba-2 / LatentMoE model with MTP                | Text dataset (e.g., HellaSwag)                    | LLM (MoE)  | [Fine-tune Nemotron-3 Ultra](/recipes-e2e-examples/nemotron-3-ultra)   |
| **Sequence classification**     | You need to classify text into categories (sentiment, topic, NLI)                                 | Text + labels (e.g., GLUE MRPC)                   | LLM        | [Train classifier](/recipes-e2e-examples/sequence-classification)      |
| **QAT fine-tune**               | You want a quantized model that keeps accuracy for efficient deployment                           | Text dataset                                      | LLM        | [Enable QAT](/recipes-e2e-examples/qat)                                |
| **Knowledge distillation**      | You want a smaller, faster model that retains most of the teacher's quality                       | Instruction dataset + teacher model               | LLM        | [Distill a model](/recipes-e2e-examples/knowledge-distillation)        |
| **Pretrain an LLM**             | You are building a base model from scratch on your own corpus                                     | Large unlabeled text corpus (e.g., FineWeb-Edu)   | LLM        | [Start pretraining](/recipes-e2e-examples/pretraining)                 |
| **Pretrain (NanoGPT)**          | You want quick pretraining experiments on a single node                                           | FineWeb / text corpus                             | LLM        | [Try NanoGPT](/recipes-e2e-examples/nanogpt-pretraining)               |

## Performance

Training throughput on NVIDIA GPUs with optimized kernels for Hugging Face models.

| Model            | GPUs | TFLOPs/sec/GPU | Tokens/sec/GPU | Optimizations          |
| ---------------- | ---- | -------------- | -------------- | ---------------------- |
| DeepSeek V3 671B | 256  | 250            | 1,002          | TE + DeepEP            |
| GPT-OSS 20B      | 8    | 279            | 13,058         | TE + DeepEP + FlexAttn |
| Qwen3 MoE 30B    | 8    | 277            | 12,040         | TE + DeepEP            |

See the [full benchmark results](/performance/performance-summary) for configuration details and more models.

## Advanced Topics

Parallelism, precision, checkpointing strategies, and experiment tracking.

#### [Pipeline Parallelism](/development/pipeline-parallelism)

Torch-native pipelining composable with FSDP2 and DTensor.

3d-parallelism

#### [FP8 Training](/development/fp8-training)

Mixed-precision FP8 training with torchao.

FP8

mixed-precision

#### [Mixed-Precision Training](/development/mixed-precision-training)

fp32 master weights, bf16 compute, and the precision traps to avoid.

bf16

mixed-precision

#### [Checkpointing](/development/checkpointing)

Distributed checkpoints with SafeTensors output.

DCP

safetensors

#### [Gradient Checkpointing](/development/gradient-checkpointing)

Trade compute for memory with activation checkpointing.

memory-efficiency

#### [Quantization-Aware Training](/recipes-e2e-examples/qat)

Train with quantization for deployment-ready models.

QAT

#### [Experiment Tracking](/development/mlflow-logging)

Track experiments and metrics with MLflow and Wandb.

MLflow

Wandb

## For Developers

#### [Repo Internals](/get-started/repo-structure)

Components, recipes, and CLI architecture.

#### [API Reference](/development/api-reference/overview)

Auto-generated Python API documentation.

#### [Use as a Library](/get-started/about)

Drop-in accelerated backend for TRL, lm-eval-harness, OpenRLHF, or any code that loads Hugging Face models.

---

::

::

::

::

::

::

::

::