bridge.perf_recipes.nemotronh.b200.nemotronh#

B200 performance recipes for NemotronH and Nemotron 3.

Module Contents#

Functions#

nemotronh_56b_pretrain_64gpu_b200_fp8cs_config

NemotronH 56B pretrain: 64× B200, FP8 current-scaling.

nemotron_3_super_pretrain_64gpu_b200_bf16_config

Nemotron 3 Super pretrain: 64× B200, BF16.

nemotron_3_super_pretrain_64gpu_b200_fp8mx_config

Nemotron 3 Super pretrain: 64× B200, MXFP8.

nemotron_3_super_pretrain_64gpu_b200_nvfp4_config

Nemotron 3 Super pretrain: 64× B200, NVFP4.

nemotron_3_nano_pretrain_8gpu_b200_bf16_config

Nemotron 3 Nano pretrain: 8× B200, BF16.

nemotron_3_nano_pretrain_8gpu_b200_fp8mx_config

Nemotron 3 Nano pretrain: 8× B200, MXFP8.

nemotron_3_nano_pretrain_8gpu_b200_nvfp4_config

Nemotron 3 Nano pretrain: 8× B200, NVFP4.

nemotronh_56b_pretrain_256gpu_b200_bf16_config

NemotronH 56B pretrain: 256× B200, BF16 (same layout as FP8-CS).

nemotronh_56b_pretrain_256gpu_b200_fp8cs_config

NemotronH 56B pretrain: 256× B200, FP8 current-scaling, legacy-scaled GBS.

API#

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotronh_56b_pretrain_64gpu_b200_fp8cs_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

NemotronH 56B pretrain: 64× B200, FP8 current-scaling.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_super_pretrain_64gpu_b200_bf16_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

Nemotron 3 Super pretrain: 64× B200, BF16.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_super_pretrain_64gpu_b200_fp8mx_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

Nemotron 3 Super pretrain: 64× B200, MXFP8.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_super_pretrain_64gpu_b200_nvfp4_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

Nemotron 3 Super pretrain: 64× B200, NVFP4.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_nano_pretrain_8gpu_b200_bf16_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

Nemotron 3 Nano pretrain: 8× B200, BF16.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_nano_pretrain_8gpu_b200_fp8mx_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

Nemotron 3 Nano pretrain: 8× B200, MXFP8.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotron_3_nano_pretrain_8gpu_b200_nvfp4_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

Nemotron 3 Nano pretrain: 8× B200, NVFP4.

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotronh_56b_pretrain_256gpu_b200_bf16_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

NemotronH 56B pretrain: 256× B200, BF16 (same layout as FP8-CS).

bridge.perf_recipes.nemotronh.b200.nemotronh.nemotronh_56b_pretrain_256gpu_b200_fp8cs_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#

NemotronH 56B pretrain: 256× B200, FP8 current-scaling, legacy-scaled GBS.