bridge.recipes.nemotronh.h100.nemotron_3_ultra

Module Contents

Functions

nemotron_3_ultra_pretrain_24gpu_h100_bf16_config	Return a pre-training config for Nemotron 3 Ultra.
nemotron_3_ultra_sft_192gpu_h100_bf16_openmathinstruct2_packed_config	Return a packed OpenMathInstruct-2 full SFT config for Nemotron 3 Ultra.
nemotron_3_ultra_peft_32gpu_h100_bf16_openmathinstruct2_packed_config	Return a packed OpenMathInstruct-2 PEFT config for Nemotron 3 Ultra.

Data

NEMOTRON_3_ULTRA_HF_MODEL_ID
NEMOTRON_3_ULTRA_TOKENIZER_NAME
NEMOTRON_3_ULTRA_PRETRAIN_SEQ_LENGTH
NEMOTRON_3_ULTRA_OPENMATHINSTRUCT2_SEQ_LENGTH
__all__

API

bridge.recipes.nemotronh.h100.nemotron_3_ultra.NEMOTRON_3_ULTRA_HF_MODEL_ID

‘nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16’

bridge.recipes.nemotronh.h100.nemotron_3_ultra.NEMOTRON_3_ULTRA_TOKENIZER_NAME

‘nvidia–NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16’

bridge.recipes.nemotronh.h100.nemotron_3_ultra.NEMOTRON_3_ULTRA_PRETRAIN_SEQ_LENGTH

8192

bridge.recipes.nemotronh.h100.nemotron_3_ultra.NEMOTRON_3_ULTRA_OPENMATHINSTRUCT2_SEQ_LENGTH

4096

bridge.recipes.nemotronh.h100.nemotron_3_ultra.nemotron_3_ultra_pretrain_24gpu_h100_bf16_config() → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for Nemotron 3 Ultra.

Returns:

Pre-training configuration for Nemotron 3 Ultra.

bridge.recipes.nemotronh.h100.nemotron_3_ultra.nemotron_3_ultra_sft_192gpu_h100_bf16_openmathinstruct2_packed_config() → megatron.bridge.training.config.ConfigContainer

Return a packed OpenMathInstruct-2 full SFT config for Nemotron 3 Ultra.

Returns:

Full-parameter SFT configuration for OpenMathInstruct-2.

bridge.recipes.nemotronh.h100.nemotron_3_ultra.nemotron_3_ultra_peft_32gpu_h100_bf16_openmathinstruct2_packed_config(

peft_scheme: str | megatron.bridge.peft.base.PEFT | None = 'lora',

) → megatron.bridge.training.config.ConfigContainer

Return a packed OpenMathInstruct-2 PEFT config for Nemotron 3 Ultra.

Parameters:

peft_scheme – PEFT scheme, PEFT instance, or “none”.

Returns:

PEFT configuration for OpenMathInstruct-2.

bridge.recipes.nemotronh.h100.nemotron_3_ultra.__all__

[‘nemotron_3_ultra_peft_32gpu_h100_bf16_openmathinstruct2_packed_config’, ‘nemotron_3_ultra_pretrain…