Skip to main content
Ctrl+K
NeMo-AutoModel - Home NeMo-AutoModel - Home

NeMo-AutoModel

  • GitHub
NeMo-AutoModel - Home NeMo-AutoModel - Home

NeMo-AutoModel
  • GitHub

Table of Contents

Get Started

  • About NeMo AutoModel
  • Key Features and Concepts
  • Install NeMo AutoModel
  • YAML Configuration
  • 🤗 Transformers API Compatibility
  • Run AutoModel on Your Local Workstation
  • Run on a Cluster
  • Repository Structure

Announcements

  • Announcements

NeMo AutoModel Performance

  • Performance Summary

Model Coverage

  • Model Coverage Overview
  • Large Language Models (LLMs)
  • Vision Language Models (VLMs)
  • Diffusion Models
  • Troubleshooting Unsupported Models

Recipes & E2E Examples

  • Recipes and End-to-End Examples
  • Supervised Fine-Tuning (SFT) and Parameter-Efficient Fine-Tuning (PEFT) with NeMo AutoModel
  • Function Calling with NeMo AutoModel using FunctionGemma
  • Knowledge Distillation with NeMo AutoModel
  • Fine-Tune Large MoE LLMs
  • Pretraining Megatron Core Datasets with NeMo AutoModel
  • LLM Pre-Training with NeMo AutoModel
  • Sequence Classification (SFT/PEFT) with NeMo AutoModel
  • Fine-Tune Gemma 3 and Gemma 3n
  • Fine-Tune Qwen3.5-VL
  • Diffusion Model Fine-Tuning with NeMo AutoModel
  • Quantization-Aware Training (QAT) in NeMo Automodel
  • Model Training on Databricks

Datasets

  • Dataset Overview: LLM, VLM, and Retrieval Datasets in NeMo Automodel
  • Integrate Your Own Text Dataset
  • Biencoder Retrieval Dataset (Embedding Fine-tuning)
  • Use the ColumnMappedTextInstructionDataset
  • Use the ColumnMappedTextInstructionIterableDataset (Streaming)
  • Integrate Your Own Multi-Modal Dataset
  • Diffusion Dataset Preparation

Job Launchers

  • Run on Any Cloud with SkyPilot

Development

  • Checkpointing in NeMo Automodel
  • Gradient (Activation) Checkpointing in NeMo AutoModel
  • Pipeline Parallelism with AutoPipeline
  • FP8 Training in NeMo AutoModel
  • MLflow Logging in NeMo AutoModel
  • API Reference
    • nemo_automodel
      • nemo_automodel.components
        • nemo_automodel.components.optim
        • nemo_automodel.components.launcher
        • nemo_automodel.components.flow_matching
        • nemo_automodel.components.loss
        • nemo_automodel.components.moe
        • nemo_automodel.components.loggers
        • nemo_automodel.components.config
        • nemo_automodel.components.quantization
        • nemo_automodel.components.models
        • nemo_automodel.components.distributed
        • nemo_automodel.components.utils
        • nemo_automodel.components._peft
        • nemo_automodel.components.datasets
        • nemo_automodel.components.attention
        • nemo_automodel.components.checkpoint
        • nemo_automodel.components.training
      • nemo_automodel.autonvtx
      • nemo_automodel._diffusers
        • nemo_automodel._diffusers.auto_diffusion_pipeline
      • nemo_automodel.shared
        • nemo_automodel.shared.torch_patches
        • nemo_automodel.shared.transformers_patches
        • nemo_automodel.shared.utils
        • nemo_automodel.shared.import_utils
        • nemo_automodel.shared.te_patches
      • nemo_automodel._transformers
        • nemo_automodel._transformers.mfu
        • nemo_automodel._transformers.infrastructure
        • nemo_automodel._transformers.biencoder
        • nemo_automodel._transformers.utils
        • nemo_automodel._transformers.auto_model
        • nemo_automodel._transformers.model_init
        • nemo_automodel._transformers.auto_tokenizer
        • nemo_automodel._transformers.kernel_patches
        • nemo_automodel._transformers.capabilities
        • nemo_automodel._transformers.registry
  • API Reference
  • nemo_automodel
  • nemo_automodel.components
  • nemo_automodel.components.models
  • nemo_automodel.components.models.step3p5

nemo_automodel.components.models.step3p5#

Submodules#

  • nemo_automodel.components.models.step3p5.state_dict_adapter
  • nemo_automodel.components.models.step3p5.layers
  • nemo_automodel.components.models.step3p5.model

Package Contents#

Data#

ModelClass

API#

nemo_automodel.components.models.step3p5.ModelClass#

None

previous

nemo_automodel.components.models.baichuan.model

next

nemo_automodel.components.models.step3p5.state_dict_adapter
On this page
  • Submodules
  • Package Contents
    • Data
    • API
      • ModelClass
NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

Last updated on 2026-03-27.