bridge.perf_recipes.nemotronh.b300.nemotronh#
B300 performance recipes for NemotronH and Nemotron 3.
Module Contents#
Functions#
NemotronH 56B pretrain: 64× B300, FP8 current-scaling. |
|
Nemotron 3 Super pretrain: 64× B300, BF16. |
|
Nemotron 3 Super pretrain: 64× B300, MXFP8. |
|
Nemotron 3 Super pretrain: 64× B300, NVFP4. |
|
Nemotron 3 Nano pretrain: 8× B300, BF16. |
|
Nemotron 3 Nano pretrain: 8× B300, MXFP8. |
|
Nemotron 3 Nano pretrain: 8× B300, NVFP4. |
API#
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotronh_56b_pretrain_64gpu_b300_fp8cs_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
NemotronH 56B pretrain: 64× B300, FP8 current-scaling.
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotron_3_super_pretrain_64gpu_b300_bf16_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Super pretrain: 64× B300, BF16.
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotron_3_super_pretrain_64gpu_b300_fp8mx_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Super pretrain: 64× B300, MXFP8.
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotron_3_super_pretrain_64gpu_b300_nvfp4_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Super pretrain: 64× B300, NVFP4.
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotron_3_nano_pretrain_8gpu_b300_bf16_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Nano pretrain: 8× B300, BF16.
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotron_3_nano_pretrain_8gpu_b300_fp8mx_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Nano pretrain: 8× B300, MXFP8.
- bridge.perf_recipes.nemotronh.b300.nemotronh.nemotron_3_nano_pretrain_8gpu_b300_nvfp4_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Nano pretrain: 8× B300, NVFP4.