nemo_automodel.components.models

Convenience model builders for NeMo Automodel.

Currently includes: • build_gpt2_model – returns a GPT-2 causal language model (Flash-Attention-2 by default).

Subpackages

• nemo_automodel.components.models.common
  • nemo_automodel.components.models.common.combined_projection
    • nemo_automodel.components.models.common.combined_projection.combined_qkv
    • nemo_automodel.components.models.common.combined_projection.state_dict_adapter
    • nemo_automodel.components.models.common.combined_projection.combined_mlp
  • nemo_automodel.components.models.common.hf_checkpointing_mixin
  • nemo_automodel.components.models.common.utils
  • nemo_automodel.components.models.common.bidirectional
• nemo_automodel.components.models.llama_bidirectional
  • nemo_automodel.components.models.llama_bidirectional.export_onnx
  • nemo_automodel.components.models.llama_bidirectional.model
• nemo_automodel.components.models.nemotron_parse
  • nemo_automodel.components.models.nemotron_parse.nemotron_parse_loss
  • nemo_automodel.components.models.nemotron_parse.model
• nemo_automodel.components.models.qwen3_moe
  • nemo_automodel.components.models.qwen3_moe.model
  • nemo_automodel.components.models.qwen3_moe.layers
  • nemo_automodel.components.models.qwen3_moe.state_dict_adapter
• nemo_automodel.components.models.nemotron_v3
  • nemo_automodel.components.models.nemotron_v3.cache
  • nemo_automodel.components.models.nemotron_v3.model
  • nemo_automodel.components.models.nemotron_v3.layers
  • nemo_automodel.components.models.nemotron_v3.state_dict_adapter
• nemo_automodel.components.models.minimax_m2
  • nemo_automodel.components.models.minimax_m2.model
  • nemo_automodel.components.models.minimax_m2.layers
  • nemo_automodel.components.models.minimax_m2.state_dict_adapter
• nemo_automodel.components.models.kimivl
  • nemo_automodel.components.models.kimivl.model
• nemo_automodel.components.models.mistral3
  • nemo_automodel.components.models.mistral3.model
• nemo_automodel.components.models.kimi_k25_vl
  • nemo_automodel.components.models.kimi_k25_vl.model
  • nemo_automodel.components.models.kimi_k25_vl.state_dict_adapter
• nemo_automodel.components.models.glm4_moe_lite
  • nemo_automodel.components.models.glm4_moe_lite.model
• nemo_automodel.components.models.qwen2
  • nemo_automodel.components.models.qwen2.model
  • nemo_automodel.components.models.qwen2.state_dict_adapter
• nemo_automodel.components.models.qwen3_next
  • nemo_automodel.components.models.qwen3_next.model
  • nemo_automodel.components.models.qwen3_next.layers
  • nemo_automodel.components.models.qwen3_next.state_dict_adapter
• nemo_automodel.components.models.step3p5
  • nemo_automodel.components.models.step3p5.model
  • nemo_automodel.components.models.step3p5.layers
  • nemo_automodel.components.models.step3p5.state_dict_adapter
• nemo_automodel.components.models.glm4_moe
  • nemo_automodel.components.models.glm4_moe.model
  • nemo_automodel.components.models.glm4_moe.layers
  • nemo_automodel.components.models.glm4_moe.state_dict_adapter
• nemo_automodel.components.models.deepseek_v32
  • nemo_automodel.components.models.deepseek_v32.config
  • nemo_automodel.components.models.deepseek_v32.model
  • nemo_automodel.components.models.deepseek_v32.layers
  • nemo_automodel.components.models.deepseek_v32.state_dict_adapter
• nemo_automodel.components.models.qwen3_vl_moe
  • nemo_automodel.components.models.qwen3_vl_moe.model
  • nemo_automodel.components.models.qwen3_vl_moe.state_dict_adapter
• nemo_automodel.components.models.gpt_oss
  • nemo_automodel.components.models.gpt_oss.model
  • nemo_automodel.components.models.gpt_oss.layers
  • nemo_automodel.components.models.gpt_oss.rope_utils
  • nemo_automodel.components.models.gpt_oss.state_dict_adapter
• nemo_automodel.components.models.llama
  • nemo_automodel.components.models.llama.model
  • nemo_automodel.components.models.llama.rope_utils
  • nemo_automodel.components.models.llama.state_dict_adapter
• nemo_automodel.components.models.deepseek_v3
  • nemo_automodel.components.models.deepseek_v3.model
  • nemo_automodel.components.models.deepseek_v3.layers
  • nemo_automodel.components.models.deepseek_v3.rope_utils
  • nemo_automodel.components.models.deepseek_v3.state_dict_adapter
• nemo_automodel.components.models.qwen3_omni_moe
  • nemo_automodel.components.models.qwen3_omni_moe.model
  • nemo_automodel.components.models.qwen3_omni_moe.state_dict_adapter
• nemo_automodel.components.models.qwen3_5_moe
  • nemo_automodel.components.models.qwen3_5_moe.model
  • nemo_automodel.components.models.qwen3_5_moe.state_dict_adapter

Submodules

• nemo_automodel.components.models.gpt2

Package Contents

Classes

_MissingModelFinder

Produces a helpful error when importing a non-existent model subpackage.

Functions

_available_model_submodules	Return the set of model sub-package names shipped with this installation.
_make_upgrade_message
__getattr__

Data

__all__
_MODELS_DIR
_PACKAGE_PREFIX

API

nemo_automodel.components.models.__all__

[‘build_gpt2_model’]

nemo_automodel.components.models._MODELS_DIR

None

nemo_automodel.components.models._PACKAGE_PREFIX

None

nemo_automodel.components.models._available_model_submodules() → set[str]

Return the set of model sub-package names shipped with this installation.

nemo_automodel.components.models._make_upgrade_message(name: str) → str

nemo_automodel.components.models.__getattr__(name: str)

class nemo_automodel.components.models._MissingModelFinder

Bases: importlib.abc.MetaPathFinder

Produces a helpful error when importing a non-existent model subpackage.

Installed at the end of sys.meta_path so it is only consulted after all real finders have already returned None. For any import of the form nemo_automodel.components.models.<name> (direct child only), it raises a ModuleNotFoundError with upgrade instructions instead of the default unhelpful message.

find_spec(fullname, path, target=None)