nemo_automodel.components.models.muse_glimmer.parallelization

Distributed-parallelization registration for native MuseGlimmer.

Module Contents

Name	Description
`MuseGlimmerModelParallelizer`	Apply standard dense parallelism and install the model-owned CP mesh.

class nemo_automodel.components.models.muse_glimmer.parallelization.MuseGlimmerModelParallelizer()

Bases: ModelParallelizer

Apply standard dense parallelism and install the model-owned CP mesh.

nemo_automodel.components.models.muse_glimmer.parallelization.MuseGlimmerModelParallelizer._apply(
    model,
    device_mesh,
    kwargs = {}
)

nemo_automodel.components.models.muse_glimmer.parallelization.PARALLELIZER = MuseGlimmerModelParallelizer()