bridge.perf_recipes.kimi.b300.kimi_k2#

B300 performance recipes for Kimi K2.

Module Contents#

Functions#

kimi_k2_pretrain_256gpu_b300_bf16_config

Kimi K2 pretrain: 256× B300, BF16.

kimi_k2_pretrain_256gpu_b300_fp8cs_config

Kimi K2 pretrain: 256× B300, FP8 current-scaling.

kimi_k2_pretrain_256gpu_b300_fp8mx_config

Kimi K2 pretrain: 256× B300, MXFP8.

API#

bridge.perf_recipes.kimi.b300.kimi_k2.kimi_k2_pretrain_256gpu_b300_bf16_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× B300, BF16.

bridge.perf_recipes.kimi.b300.kimi_k2.kimi_k2_pretrain_256gpu_b300_fp8cs_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× B300, FP8 current-scaling.

bridge.perf_recipes.kimi.b300.kimi_k2.kimi_k2_pretrain_256gpu_b300_fp8mx_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 256× B300, MXFP8.