bridge.models.exaone.exaone_moe.exaone_moe_bridge

Module Contents

Classes

ExaoneMoeBridge

Megatron Bridge for Hugging Face EXAONE MoE causal language models.

API

class bridge.models.exaone.exaone_moe.exaone_moe_bridge.ExaoneMoeBridge

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Bridge for Hugging Face EXAONE MoE causal language models.

classmethod megatron_to_hf_config(

provider: megatron.bridge.models.exaone.exaone_moe.exaone_moe_provider.ExaoneMoeModelProvider,

) → dict

Preserve EXAONE’s distinction between physical and repeated MTP layers.

provider_bridge(

hf_pretrained: megatron.bridge.models.hf_pretrained.causal_lm.PreTrainedCausalLM,

) → megatron.bridge.models.exaone.exaone_moe.exaone_moe_provider.ExaoneMoeModelProvider

mapping_registry() → megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry