bridge.perf_recipes.deepseek.gb300.deepseek_v3

GB300 performance recipes for DeepSeek V3.

Module Contents

Functions

deepseek_v3_pretrain_256gpu_gb300_bf16_config	DeepSeek V3 pretrain: 256× GB300, BF16.
deepseek_v3_pretrain_256gpu_gb300_fp8cs_config	DeepSeek V3 pretrain: 256× GB300, FP8 current-scaling.
deepseek_v3_pretrain_256gpu_gb300_fp8mx_config	DeepSeek V3 pretrain: 256× GB300, MXFP8.
deepseek_v3_pretrain_256gpu_gb300_nvfp4_config	DeepSeek V3 pretrain: 256× GB300, NVFP4.
deepseek_v3_pretrain_64gpu_gb300_bf16_fsdp_config	DeepSeek V3 pretrain: 64× GB300, BF16, Megatron FSDP.
deepseek_v3_pretrain_64gpu_gb300_fp8mx_fsdp_config	DeepSeek V3 pretrain: 64× GB300, MXFP8, Megatron FSDP.
deepseek_v3_pretrain_128gpu_gb300_fp8mx_hsdp_config	DeepSeek V3 pretrain: 128× GB300, MXFP8, Megatron Hybrid FSDP (HSDP).
deepseek_v3_pretrain_256gpu_gb300_fp8mx_large_scale_config	DeepSeek V3 pretrain: 256× GB300, MXFP8, large-scale proxy (PP=4, VP=4, EP=64).
deepseek_v3_pretrain_256gpu_gb300_fp8mx_partial_cg_dev_config	DeepSeek V3 pretrain: 256× GB300, MXFP8 and scoped CUDA graphs.

API

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_256gpu_gb300_bf16_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 256× GB300, BF16.

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_256gpu_gb300_fp8cs_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 256× GB300, FP8 current-scaling.

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_256gpu_gb300_fp8mx_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 256× GB300, MXFP8.

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_256gpu_gb300_nvfp4_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 256× GB300, NVFP4.

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_64gpu_gb300_bf16_fsdp_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 64× GB300, BF16, Megatron FSDP.

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_64gpu_gb300_fp8mx_fsdp_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 64× GB300, MXFP8, Megatron FSDP.

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_128gpu_gb300_fp8mx_hsdp_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 128× GB300, MXFP8, Megatron Hybrid FSDP (HSDP).

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_256gpu_gb300_fp8mx_large_scale_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 256× GB300, MXFP8, large-scale proxy (PP=4, VP=4, EP=64).

bridge.perf_recipes.deepseek.gb300.deepseek_v3.deepseek_v3_pretrain_256gpu_gb300_fp8mx_partial_cg_dev_config() → megatron.bridge.perf_recipes.deepseek.common.ConfigContainer

DeepSeek V3 pretrain: 256× GB300, MXFP8 and scoped CUDA graphs.