bridge.perf_recipes.kimi.b200.kimi_k2#

B200 performance recipes for Kimi K2.

Module Contents#

Functions#

kimi_k2_pretrain_256gpu_b200_bf16_config

Kimi K2 pretrain: 256× B200, BF16.

kimi_k2_pretrain_256gpu_b200_fp8cs_config

Kimi K2 pretrain: 256× B200, FP8 current-scaling.

kimi_k2_pretrain_256gpu_b200_fp8mx_config

Kimi K2 pretrain: 256× B200, MXFP8.

API#

bridge.perf_recipes.kimi.b200.kimi_k2.kimi_k2_pretrain_256gpu_b200_bf16_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× B200, BF16.

bridge.perf_recipes.kimi.b200.kimi_k2.kimi_k2_pretrain_256gpu_b200_fp8cs_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× B200, FP8 current-scaling.

bridge.perf_recipes.kimi.b200.kimi_k2.kimi_k2_pretrain_256gpu_b200_fp8mx_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× B200, MXFP8.