bridge.perf_recipes.nemotronh.h100.nemotronh#
H100 performance recipes for NemotronH and Nemotron 3.
Module Contents#
Functions#
NemotronH 56B pretrain: 64× H100, FP8 current-scaling. |
|
Nemotron 3 Nano pretrain: 16× H100, BF16, recompute MoE+layernorm. |
|
Nemotron 3 Nano pretrain: 16× H100, FP8 current-scaling, recompute. |
API#
- bridge.perf_recipes.nemotronh.h100.nemotronh.nemotronh_56b_pretrain_64gpu_h100_fp8cs_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
NemotronH 56B pretrain: 64× H100, FP8 current-scaling.
- bridge.perf_recipes.nemotronh.h100.nemotronh.nemotron_3_nano_pretrain_16gpu_h100_bf16_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Nano pretrain: 16× H100, BF16, recompute MoE+layernorm.
- bridge.perf_recipes.nemotronh.h100.nemotronh.nemotron_3_nano_pretrain_16gpu_h100_fp8cs_config() megatron.bridge.perf_recipes.nemotronh.common.ConfigContainer#
Nemotron 3 Nano pretrain: 16× H100, FP8 current-scaling, recompute.