bridge.perf_recipes.kimi.h100.kimi_k2#

H100 performance recipes for Kimi K2.

Module Contents#

Functions#

kimi_k2_pretrain_1024gpu_h100_bf16_config

Kimi K2 pretrain: 1024× H100, BF16.

kimi_k2_pretrain_1024gpu_h100_fp8cs_config

Kimi K2 pretrain: 1024× H100, FP8 current-scaling.

kimi_k2_pretrain_1024gpu_h100_fp8sc_config

Kimi K2 pretrain: 1024× H100, FP8-SC.

API#

bridge.perf_recipes.kimi.h100.kimi_k2.kimi_k2_pretrain_1024gpu_h100_bf16_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 1024× H100, BF16.

bridge.perf_recipes.kimi.h100.kimi_k2.kimi_k2_pretrain_1024gpu_h100_fp8cs_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 1024× H100, FP8 current-scaling.

bridge.perf_recipes.kimi.h100.kimi_k2.kimi_k2_pretrain_1024gpu_h100_fp8sc_config() megatron.bridge.perf_recipes.kimi.common.ConfigContainer#

Kimi K2 pretrain: 1024× H100, FP8-SC.