bridge.perf_recipes.llama.vr200.llama31#

VR200 performance recipes for Llama 3.1.

Module Contents#

Functions#

llama31_405b_pretrain_256gpu_vr200_nvfp4_config

Llama3.1 405B pretrain: 256x VR200, NVFP4.

Data#

API#

bridge.perf_recipes.llama.vr200.llama31.llama31_405b_pretrain_256gpu_vr200_bf16_config#

None

bridge.perf_recipes.llama.vr200.llama31.llama31_405b_pretrain_256gpu_vr200_fp8mx_config#

None

bridge.perf_recipes.llama.vr200.llama31.llama31_405b_pretrain_256gpu_vr200_nvfp4_config() megatron.bridge.perf_recipes.llama.common.ConfigContainer#

Llama3.1 405B pretrain: 256x VR200, NVFP4.