bridge.models.inkling.modeling_inkling2.spec#
MCore Hybrid stack specification for Inkling2.
Module Contents#
Functions#
Clone an MLP or MoE builder and install the softcapped SwiGLU activation. |
|
Compose Inkling2 attention and SiTU MoE layers for a repeated |
API#
- bridge.models.inkling.modeling_inkling2.spec._with_situ_activation(builder)#
Clone an MLP or MoE builder and install the softcapped SwiGLU activation.
- bridge.models.inkling.modeling_inkling2.spec.build_inkling2_hybrid_stack_spec(
- config,
Compose Inkling2 attention and SiTU MoE layers for a repeated
*EHybrid stack.- Parameters:
config – The Inkling2 transformer config.
- Returns:
A
HybridStackspec whose attention and MoE layers form the decoder blocks.