bridge.models.muse_glimmer.muse_glimmer_bridge#

Hugging Face ↔ Megatron conversion bridge for Muse Glimmer.

Module Contents#

Classes#

MuseGlimmerQKVGMapping

Fuse Muse’s full-head Q/K/V/gate projections into MCore gated QKV.

MuseGlimmerBridge

Builder-backed bridge for the complete Muse Glimmer multimodal model.

Data#

API#

class bridge.models.muse_glimmer.muse_glimmer_bridge.MuseGlimmerQKVGMapping(
megatron_param: str,
*,
q: str,
k: str,
v: str,
gate: str,
)#

Bases: megatron.bridge.models.conversion.param_mapping.MegatronParamMapping[dict[str, torch.Tensor]]

Fuse Muse’s full-head Q/K/V/gate projections into MCore gated QKV.

Initialization

static _combine_query_and_gate(
config: megatron.bridge.models.muse_glimmer.muse_glimmer_config.MuseGlimmerTransformerConfig,
query: torch.Tensor,
gate: torch.Tensor,
) torch.Tensor#
hf_to_megatron(
hf_weights: dict[str, torch.Tensor],
megatron_module: torch.nn.Module,
) torch.Tensor#
megatron_to_hf(
megatron_weights: torch.Tensor | None,
megatron_module: torch.nn.Module | None,
) dict[str, torch.Tensor]#
resolve(
captures: tuple[str, ...],
) bridge.models.muse_glimmer.muse_glimmer_bridge.MuseGlimmerQKVGMapping#
class bridge.models.muse_glimmer.muse_glimmer_bridge.MuseGlimmerBridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Builder-backed bridge for the complete Muse Glimmer multimodal model.

MODEL_CONFIG_CLASS#

None

USE_MODEL_CONFIG_FOR_CONVERSION#

True

static _validate_architecture(
hf_config: transformers.PretrainedConfig,
) tuple[Any, Any]#
hf_config_to_model_config(
hf_config: transformers.PretrainedConfig,
) megatron.bridge.models.muse_glimmer.muse_glimmer_config.MuseGlimmerModelConfig#

Translate the nested HF config into a native HybridModel config.

classmethod megatron_to_hf_config(
model_config: megatron.bridge.models.muse_glimmer.muse_glimmer_config.MuseGlimmerModelConfig,
) dict[str, Any]#

Translate the serializable model config back to HF’s nested layout.

mapping_registry() megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#

Return complete text, vision, adapter, and projection mappings.

bridge.models.muse_glimmer.muse_glimmer_bridge.__all__#

[‘MuseGlimmerBridge’, ‘MuseGlimmerQKVGMapping’]