Model CoverageOmni

Nemotron-3-Nano-Omni

View as Markdown

Nemotron-3-Nano-Omni-30B-A3B-Reasoning is NVIDIA’s omnimodal reasoning model. It pairs a NemotronH (hybrid Mamba-2 + Attention) MoE language backbone with a RADIO v2.5-H vision encoder and a Parakeet (FastConformer) sound encoder, supporting interleaved text, image, and audio inputs.

TaskOmnimodal (Text·Image·Audio)
ArchitectureNemotronH_Nano_Omni_Reasoning_V3
Parameters30B total / 3B active
HF Orgnvidia

Available Models

  • Nemotron-3-Nano-Omni-30B-A3B-Reasoning: 30B total, 3B activated (MoE)

Architecture

  • NemotronH_Nano_Omni_Reasoning_V3

Example Recipes

RecipeDatasetDescription
nemotron_omni_cord_v2.yamlCORD-v2Full SFT — receipt parsing
nemotron_omni_cord_v2_peft.yamlCORD-v2LoRA PEFT — receipt parsing

Try with NeMo AutoModel

1. Clone and install from source (full instructions):

$git clone https://github.com/NVIDIA-NeMo/Automodel.git
$cd Automodel
$uv sync --locked --all-groups --all-extras --extra vlm-media

2. Run the recipe from inside the repo (8x H100 example):

$uv run automodel examples/vlm_finetune/nemotron_omni/nemotron_omni_cord_v2.yaml --nproc-per-node 8

For a full walkthrough — dataset preparation, SFT vs. LoRA configs, and post-training inference — see the Nemotron-Omni guide.