bridge.models.muse_glimmer.muse_glimmer_builder#

Model builder for Muse Glimmer.

Module Contents#

Classes#

MuseGlimmerModelBuilder

Construct the complete Muse Glimmer model on MCore HybridModel.

Data#

__all__

API#

class bridge.models.muse_glimmer.muse_glimmer_builder.MuseGlimmerModelBuilder(
model_config: megatron.bridge.models.muse_glimmer.muse_glimmer_config.MuseGlimmerModelConfig,
)#

Bases: megatron.training.models.hybrid.HybridModelBuilder

Construct the complete Muse Glimmer model on MCore HybridModel.

Initialization

build_model(
pg_collection: megatron.core.process_groups_config.ProcessGroupCollection,
pre_process: bool | None = None,
post_process: bool | None = None,
vp_stage: int | None = None,
) → megatron.bridge.models.muse_glimmer.modeling_muse_glimmer.MuseGlimmerModel#

Build one Muse Glimmer pipeline stage.

Parameters:

  • pg_collection – Process groups used for distributed construction.

  • pre_process – Whether this stage owns embeddings and the vision stack.

  • post_process – Whether this stage owns the language-model output head.

  • vp_stage – Optional virtual pipeline stage index.

Returns:

A combined Muse Glimmer model stage.

bridge.models.muse_glimmer.muse_glimmer_builder.__all__#

[‘MuseGlimmerModelBuilder’]