`bridge.perf_recipes.llama.b300.llama31`#

B300 performance recipes for Llama 3.1.

Module Contents#

Functions#

`llama31_405b_pretrain_128gpu_b300_bf16_config`	Llama3.1 405B pretrain: 128× B300, BF16, TP=2 PP=8.
`llama31_405b_pretrain_128gpu_b300_fp8cs_config`	Llama3.1 405B pretrain: 128× B300, FP8 current-scaling, TP=2 PP=8.
`llama31_405b_pretrain_128gpu_b300_fp8mx_config`	Llama3.1 405B pretrain: 128× B300, MXFP8, TP=2 PP=8.
`llama31_405b_pretrain_128gpu_b300_nvfp4_config`	Llama3.1 405B pretrain: 128× B300, NVFP4, TP=4 PP=8 CP=2.
`llama31_405b_pretrain_256gpu_b300_bf16_config`	Llama3.1 405B pretrain: 256x B300, BF16, FSDP.

Data#

`llama31_405b_pretrain_256gpu_b300_fp8cs_config`
`llama31_405b_pretrain_256gpu_b300_fp8mx_config`
`llama31_405b_pretrain_256gpu_b300_nvfp4_config`

API#

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_128gpu_b300_bf16_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: Llama3.1 405B pretrain: 128× B300, BF16, TP=2 PP=8.

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_128gpu_b300_fp8cs_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: Llama3.1 405B pretrain: 128× B300, FP8 current-scaling, TP=2 PP=8.

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_128gpu_b300_fp8mx_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: Llama3.1 405B pretrain: 128× B300, MXFP8, TP=2 PP=8.

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_128gpu_b300_nvfp4_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: Llama3.1 405B pretrain: 128× B300, NVFP4, TP=4 PP=8 CP=2.

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_256gpu_b300_bf16_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: Llama3.1 405B pretrain: 256x B300, BF16, FSDP.

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_256gpu_b300_fp8cs_config#: None

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_256gpu_b300_fp8mx_config#: None

bridge.perf_recipes.llama.b300.llama31.llama31_405b_pretrain_256gpu_b300_nvfp4_config#: None