nemo_automodel.components.models.common.combined_projection

Combined projection modules for efficient transformer implementations.

Submodules

• nemo_automodel.components.models.common.combined_projection.combined_mlp
• nemo_automodel.components.models.common.combined_projection.state_dict_adapter
• nemo_automodel.components.models.common.combined_projection.combined_qkv

Package Contents

Data

__all__

API

nemo_automodel.components.models.common.combined_projection.__all__

[‘CombinedQKVAttentionMixin’, ‘CombinedGateUpMLP’]