For AI agents: a documentation index is available at the root level at /llms.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.

Skip to navigation

On this page

Submodules

Reference Full Library Reference Nemo Automodel Nemo Automodel Components Modelsnemo_automodel.components.models.gemma4_moe

nemo_automodel.components.models.gemma4_moe

||View as Markdown|

This page is for version 0.5.0 · 26.06. For other versions, use one of these documentation indexes: - Nightly (default): https://docs.nvidia.com/nemo/automodel/nightly/llms.txt - Latest: https://docs.nvidia.com/nemo/automodel/latest/llms.txt - 0.5.0 · 26.06: https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt - 0.4.0 · 26.04: https://docs.nvidia.com/nemo/automodel/v0.4/llms.txt

Submodules

nemo_automodel.components.models.gemma4_moe.cp_attention
nemo_automodel.components.models.gemma4_moe.cp_batch
nemo_automodel.components.models.gemma4_moe.cp_local_ring
nemo_automodel.components.models.gemma4_moe.loss
nemo_automodel.components.models.gemma4_moe.model
nemo_automodel.components.models.gemma4_moe.parallelization
nemo_automodel.components.models.gemma4_moe.sdpa_fp32
nemo_automodel.components.models.gemma4_moe.state_dict_adapter

nemo_automodel.components.models.gemma4_drafter.model

nemo_automodel.components.models.gemma4_moe.cp_attention

- Home
Get Started
What's New
Performance
- Performance Summary
Model Coverage
Recipes & E2E Examples
Data
Run Jobs
Advanced Training
Reference
- API Reference
- - Nemo Automodel
    Autonvtx
    Cli
    Components
    Attention
    Checkpoint
    Config
    Cuda Graphs
    Datasets
    Distributed
    Eval
    Flow Matching
    Launcher
    Loggers
    Loss
    Models
    Bagel
    Baichuan
    Common
    Deepseek V3
    Deepseek V32
    Deepseek V4
    Deepseek V41
    Deprecation
    Diffusion Gemma
    Ernie4 5
    Gemma4 Drafter
    Gemma4 Moe
    Cp Attention
    Cp Batch
    Cp Local Ring
    Loss
    Model
    Parallelization
    Sdpa Fp32
    State Dict Adapter
    Gemma4 Unified
    Glm Moe Dsa
    Glm4 Moe
    Glm4 Moe Lite
    Glm5 Next
    Gpt Oss
    Gpt2
    Hunyuan Image3
    Hy Mt2
    Hy V3
    Inkling
    Kimi K2
    Kimi K25 Vl
    Kimi K3
    Kimi Linear
    Kimivl
    Laguna
    Ling V2
    Llama
    Llama Bidirectional
    Llama Nemotron Vl
    Llava Onevision
    Mimo V2 Flash
    Mimo V25
    Minimax M2
    Minimax M3 Vl
    Ministral Bidirectional
    Mistral3
    Mistral3 Vlm
    Mistral4
    Muse Glimmer
    Nemotron Omni
    Nemotron Parse
    Nemotron V3
    Pixtral
    Qwen Image Edit
    Qwen2
    Qwen2 5 Omni
    Qwen3
    Qwen3 5
    Qwen3 5 Moe
    Qwen3 8 Flash Next
    Qwen3 Moe
    Qwen3 Next
    Qwen3 Omni Moe
    Qwen3 Reranker
    Qwen3 Vl
    Qwen3 Vl Moe
    Step3p5
    Step3p7
    Moe
    Optim
    Quantization
    Speculative
    Training
    Utils
    Package Info
    Recipes
    Shared

Nightly
Latest
0.5.0 · 26.06
0.4.0 · 26.04

Developer-friendly docs for your API

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.