nemo_automodel.components.models.lfm3.parallelization
nemo_automodel.components.models.lfm3.parallelization
Activation-checkpointing policy of LFM3.
Module Contents
Classes
Data
API
Bases: ModelParallelizer
Checkpoint whole decoder layers, which recomputes the convolution layers in backward as well.
A decoder layer takes all its inputs as arguments and the model builds no cache in training.