Is this page helpful?

`core.models.hybrid.hybrid_layer_specs`#

Module Contents#

Data#

`moe`
`moe_inference`
`_hybrid_mtp_block_spec`
`hybrid_stack_spec`
`hybrid_inference_stack_spec`
`mamba_stack_spec`
`mamba_inference_stack_spec`

API#

core.models.hybrid.hybrid_layer_specs.moe#: ‘get_moe_module_spec(…)’

core.models.hybrid.hybrid_layer_specs.moe_inference#: ‘get_inference_optimized_moe_spec(…)’

core.models.hybrid.hybrid_layer_specs._hybrid_mtp_block_spec#: ‘ModuleSpec(…)’

core.models.hybrid.hybrid_layer_specs.hybrid_stack_spec#: ‘ModuleSpec(…)’

core.models.hybrid.hybrid_layer_specs.hybrid_inference_stack_spec#: ‘ModuleSpec(…)’

core.models.hybrid.hybrid_layer_specs.mamba_stack_spec#: None

core.models.hybrid.hybrid_layer_specs.mamba_inference_stack_spec#: None