bridge.perf_recipes.nemotronh.b200.nemotronh

B200 performance recipes for NemotronH and Nemotron 3.

Module Contents

Functions

_apply_nemotron_3_5_lightning_defaults	Apply the Nemotron 3.5 Lightning workload contract to a B200 execution config.
nemotronh_56b_pretrain_64gpu_b200_fp8cs_config	NemotronH 56B pretrain: 64× B200, FP8 current-scaling.
nemotron_3_super_pretrain_64gpu_b200_bf16_config	Nemotron 3 Super pretrain: 64× B200, BF16.
nemotron_3_super_pretrain_64gpu_b200_fp8mx_config	Nemotron 3 Super pretrain: 64× B200, MXFP8.
nemotron_3_super_pretrain_64gpu_b200_nvfp4_config	Nemotron 3 Super pretrain: 64× B200, NVFP4.
nemotron_3_nano_pretrain_8gpu_b200_bf16_config	Nemotron 3 Nano pretrain: 8× B200, BF16.
nemotron_3_nano_pretrain_8gpu_b200_fp8mx_config	Nemotron 3 Nano pretrain: 8× B200, MXFP8.
nemotron_3_nano_pretrain_8gpu_b200_nvfp4_config	Nemotron 3 Nano pretrain: 8× B200, NVFP4.
nemotron_3_5_lightning_pretrain_8gpu_b200_bf16_config	Nemotron 3.5 Lightning pretrain: 8× B200, BF16.
nemotron_3_5_lightning_pretrain_8gpu_b200_fp8mx_config	Nemotron 3.5 Lightning pretrain: 8× B200, MXFP8.
nemotron_3_5_lightning_pretrain_8gpu_b200_nvfp4_config	Nemotron 3.5 Lightning pretrain: 8× B200, NVFP4.
nemotronh_56b_pretrain_256gpu_b200_bf16_config	NemotronH 56B pretrain: 256× B200, BF16 (same layout as FP8-CS).
nemotronh_56b_pretrain_256gpu_b200_fp8cs_config	NemotronH 56B pretrain: 256× B200, FP8 current-scaling, legacy-scaled GBS.

Data

_NEMOTRON_3_5_LIGHTNING_MODEL_ID
_NEMOTRON_3_5_LIGHTNING_MODEL_REVISION

API

bridge.perf_recipes.nemotronh.b200.nemotronh._NEMOTRON_3_5_LIGHTNING_MODEL_ID

‘nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16’

bridge.perf_recipes.nemotronh.b200.nemotronh._NEMOTRON_3_5_LIGHTNING_MODEL_REVISION

‘b3caaabed0263651a17dc1f2d4ce97e794f76c44’

bridge.perf_recipes.nemotronh.b200.nemotronh._apply_nemotron_3_5_lightning_defaults(

cfg: megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer,

) → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Apply the Nemotron 3.5 Lightning workload contract to a B200 execution config.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotronh_56b_pretrain_64gpu_b200_fp8cs_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

NemotronH 56B pretrain: 64× B200, FP8 current-scaling.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_super_pretrain_64gpu_b200_bf16_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3 Super pretrain: 64× B200, BF16.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_super_pretrain_64gpu_b200_fp8mx_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3 Super pretrain: 64× B200, MXFP8.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_super_pretrain_64gpu_b200_nvfp4_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3 Super pretrain: 64× B200, NVFP4.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_nano_pretrain_8gpu_b200_bf16_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3 Nano pretrain: 8× B200, BF16.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_nano_pretrain_8gpu_b200_fp8mx_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3 Nano pretrain: 8× B200, MXFP8.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_nano_pretrain_8gpu_b200_nvfp4_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3 Nano pretrain: 8× B200, NVFP4.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_5_lightning_pretrain_8gpu_b200_bf16_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3.5 Lightning pretrain: 8× B200, BF16.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_5_lightning_pretrain_8gpu_b200_fp8mx_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3.5 Lightning pretrain: 8× B200, MXFP8.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_5_lightning_pretrain_8gpu_b200_nvfp4_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

Nemotron 3.5 Lightning pretrain: 8× B200, NVFP4.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotronh_56b_pretrain_256gpu_b200_bf16_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

NemotronH 56B pretrain: 256× B200, BF16 (same layout as FP8-CS).

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotronh_56b_pretrain_256gpu_b200_fp8cs_config() → megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer

NemotronH 56B pretrain: 256× B200, FP8 current-scaling, legacy-scaled GBS.