`bridge.perf_recipes.llama.vr200.llama3`#

VR200 performance recipes for Llama 3.

Module Contents#

Functions#

`llama3_8b_pretrain_8gpu_vr200_bf16_config`	LLaMA 3 8B pretrain: 8× VR200, BF16 (alias of GB200).
`llama3_8b_pretrain_8gpu_vr200_fp8cs_config`	LLaMA 3 8B pretrain: 8× VR200, FP8-CS (alias of GB200).
`llama3_8b_pretrain_8gpu_vr200_fp8mx_config`	LLaMA 3 8B pretrain: 8× VR200, FP8-MX (alias of GB200).
`llama3_8b_pretrain_8gpu_vr200_nvfp4_config`	LLaMA 3 8B pretrain: 8× VR200, NVFP4 (alias of GB200).
`llama3_70b_pretrain_64gpu_vr200_bf16_config`	LLaMA 3 70B pretrain: 64× VR200, BF16 (alias of GB200).
`llama3_70b_pretrain_64gpu_vr200_fp8mx_config`	LLaMA 3 70B pretrain: 64× VR200, FP8-MX (alias of GB200).
`llama3_70b_pretrain_64gpu_vr200_nvfp4_config`	LLaMA 3 70B pretrain: 64× VR200, NVFP4 (alias of GB200).

API#

bridge.perf_recipes.llama.vr200.llama3.llama3_8b_pretrain_8gpu_vr200_bf16_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 8B pretrain: 8× VR200, BF16 (alias of GB200).

bridge.perf_recipes.llama.vr200.llama3.llama3_8b_pretrain_8gpu_vr200_fp8cs_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 8B pretrain: 8× VR200, FP8-CS (alias of GB200).

bridge.perf_recipes.llama.vr200.llama3.llama3_8b_pretrain_8gpu_vr200_fp8mx_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 8B pretrain: 8× VR200, FP8-MX (alias of GB200).

bridge.perf_recipes.llama.vr200.llama3.llama3_8b_pretrain_8gpu_vr200_nvfp4_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 8B pretrain: 8× VR200, NVFP4 (alias of GB200).

bridge.perf_recipes.llama.vr200.llama3.llama3_70b_pretrain_64gpu_vr200_bf16_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 70B pretrain: 64× VR200, BF16 (alias of GB200).

bridge.perf_recipes.llama.vr200.llama3.llama3_70b_pretrain_64gpu_vr200_fp8mx_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 70B pretrain: 64× VR200, FP8-MX (alias of GB200).

bridge.perf_recipes.llama.vr200.llama3.llama3_70b_pretrain_64gpu_vr200_nvfp4_config() → megatron.bridge.perf_recipes.llama.common.ConfigContainer#: LLaMA 3 70B pretrain: 64× VR200, NVFP4 (alias of GB200).