bridge.models.kimi.kimi_k3_spec

MCore layer specification for Kimi K3.

Module Contents

Functions

_with_situ_activation	Clone an MLP/MoE builder and replace every activation with SiTU.
build_kimi_k3_spec	Build the heterogeneous KDA/MLA and dense/MoE Kimi K3 block.

API

bridge.models.kimi.kimi_k3_spec._with_situ_activation(builder)

Clone an MLP/MoE builder and replace every activation with SiTU.

bridge.models.kimi.kimi_k3_spec.build_kimi_k3_spec(config, vp_stage=None)

Build the heterogeneous KDA/MLA and dense/MoE Kimi K3 block.