bridge.perf_recipes.kimi.gb300.kimi_k2#

GB300 performance recipes for Kimi K2.

Module Contents#

Functions#

kimi_k2_pretrain_256gpu_gb300_bf16_config

Kimi K2 pretrain: 256× GB300, BF16.

kimi_k2_pretrain_256gpu_gb300_fp8cs_config

Kimi K2 pretrain: 256× GB300, FP8 current-scaling.

_build_kimi_k2_gb300_fp8mx

Shared HybridEP MXFP8 base for the Kimi K2 GB300 recipe and its VRNVL72 alias.

kimi_k2_pretrain_256gpu_gb300_fp8mx_config

Kimi K2 pretrain: 256× GB300, MXFP8, NCCL EP.

kimi_k2_pretrain_256gpu_gb300_nvfp4_config

Kimi K2 pretrain: 256× GB300, NVFP4.

API#

bridge.perf_recipes.kimi.gb300.kimi_k2.kimi_k2_pretrain_256gpu_gb300_bf16_config() → megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB300, BF16.

bridge.perf_recipes.kimi.gb300.kimi_k2.kimi_k2_pretrain_256gpu_gb300_fp8cs_config() → megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB300, FP8 current-scaling.

bridge.perf_recipes.kimi.gb300.kimi_k2._build_kimi_k2_gb300_fp8mx() → megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Shared HybridEP MXFP8 base for the Kimi K2 GB300 recipe and its VRNVL72 alias.

bridge.perf_recipes.kimi.gb300.kimi_k2.kimi_k2_pretrain_256gpu_gb300_fp8mx_config() → megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB300, MXFP8, NCCL EP.

bridge.perf_recipes.kimi.gb300.kimi_k2.kimi_k2_pretrain_256gpu_gb300_nvfp4_config() → megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB300, NVFP4.