nemo_automodel.components.models.muse_glimmer.parallelization

View as Markdown

Distributed-parallelization registration for native MuseGlimmer.

Module Contents

Functions

NameDescription
register_muse_glimmer_parallel_strategyRegister the MuseGlimmer strategy and expose its CP mesh to model-owned embedding.

API

nemo_automodel.components.models.muse_glimmer.parallelization.register_muse_glimmer_parallel_strategy() -> None

Register the MuseGlimmer strategy and expose its CP mesh to model-owned embedding.