core.models.mamba.mamba_model#

Module Contents#

Classes#

MambaModel

Backward-compatible wrapper that accepts the deprecated mamba_stack_spec kwarg.

Data#

API#

core.models.mamba.mamba_model.logger#

‘getLogger(…)’

class core.models.mamba.mamba_model.MambaModel(
*args,
mamba_stack_spec: megatron.core.transformer.spec_utils.ModuleSpec = None,
**kwargs,
)#

Bases: megatron.core.models.hybrid.hybrid_model.HybridModel

Backward-compatible wrapper that accepts the deprecated mamba_stack_spec kwarg.

Initialization