bridge.recipes.nemotronh.nemotron_3_ultra

Module Contents

Functions

nemotron_3_ultra_pretrain_config	Return a pre-training config for Nemotron 3 Ultra.
nemotron_3_ultra_sft_openmathinstruct2_packed_config	Return a packed OpenMathInstruct-2 full SFT config for Nemotron 3 Ultra.
nemotron_3_ultra_peft_openmathinstruct2_packed_config	Return a packed OpenMathInstruct-2 PEFT config for Nemotron 3 Ultra.

Data

NEMOTRON_3_ULTRA_HF_MODEL_ID
NEMOTRON_3_ULTRA_TOKENIZER_NAME
__all__

API

bridge.recipes.nemotronh.nemotron_3_ultra.NEMOTRON_3_ULTRA_HF_MODEL_ID

‘nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16’

bridge.recipes.nemotronh.nemotron_3_ultra.NEMOTRON_3_ULTRA_TOKENIZER_NAME

‘nvidia–NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16’

bridge.recipes.nemotronh.nemotron_3_ultra.nemotron_3_ultra_pretrain_config(

*,

hf_path: str | None = None,

seq_length: int = 8192,

) → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for Nemotron 3 Ultra.

Parameters:

• hf_path – Optional Hugging Face model ID or local snapshot path.

• seq_length – Sequence length for model and dataset settings.

Returns:

Pre-training configuration for Nemotron 3 Ultra.

bridge.recipes.nemotronh.nemotron_3_ultra.nemotron_3_ultra_sft_openmathinstruct2_packed_config(

*,

hf_path: str | None = None,

seq_length: int = 4096,

) → megatron.bridge.training.config.ConfigContainer

Return a packed OpenMathInstruct-2 full SFT config for Nemotron 3 Ultra.

Parameters:

• hf_path – Optional Hugging Face model ID or local snapshot path.

• seq_length – Packed sequence length.

Returns:

Full-parameter SFT configuration for OpenMathInstruct-2.

bridge.recipes.nemotronh.nemotron_3_ultra.nemotron_3_ultra_peft_openmathinstruct2_packed_config(

*,

peft: str | megatron.bridge.peft.base.PEFT | None = 'lora',

hf_path: str | None = None,

seq_length: int = 4096,

) → megatron.bridge.training.config.ConfigContainer

Return a packed OpenMathInstruct-2 PEFT config for Nemotron 3 Ultra.

Parameters:

• peft – PEFT scheme, PEFT instance, or “none”.

• hf_path – Optional Hugging Face model ID or local snapshot path.

• seq_length – Packed sequence length.

Returns:

PEFT configuration for OpenMathInstruct-2.

bridge.recipes.nemotronh.nemotron_3_ultra.__all__

[‘nemotron_3_ultra_pretrain_config’, ‘nemotron_3_ultra_sft_openmathinstruct2_packed_config’, ‘nemotr…