bridge.perf_recipes.kimi.gb200.kimi_k2#

GB200 performance recipes for Kimi K2.

Module Contents#

Functions#

kimi_k2_pretrain_256gpu_gb200_bf16_config

Kimi K2 pretrain: 256× GB200, BF16.

kimi_k2_pretrain_256gpu_gb200_fp8cs_config

Kimi K2 pretrain: 256× GB200, FP8 current-scaling.

kimi_k2_pretrain_256gpu_gb200_fp8mx_config

Kimi K2 pretrain: 256× GB200, MXFP8.

API#

bridge.perf_recipes.kimi.gb200.kimi_k2.kimi_k2_pretrain_256gpu_gb200_bf16_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB200, BF16.

bridge.perf_recipes.kimi.gb200.kimi_k2.kimi_k2_pretrain_256gpu_gb200_fp8cs_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB200, FP8 current-scaling.

bridge.perf_recipes.kimi.gb200.kimi_k2.kimi_k2_pretrain_256gpu_gb200_fp8mx_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× GB200, MXFP8.