bridge.models.qwen.qwen3_moe_bridge#

Module Contents#

Classes#

Qwen3MoEBridge

Megatron Hub Bridge for Qwen3 MoE Causal LM.

API#

class bridge.models.qwen.qwen3_moe_bridge.Qwen3MoEBridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Hub Bridge for Qwen3 MoE Causal LM.

This bridge handles the conversion between HuggingFace Qwen3MoeForCausalLM and Megatron-Core GPTModel formats. Qwen3 MoE models use mixture of experts architecture with QK layernorm.

.. rubric:: Example

from megatron.bridge import AutoBridge bridge = AutoBridge.from_hf_pretrained(“Qwen/Qwen3-235B-A22B”) provider = bridge.to_megatron_provider()

provider_bridge(
hf_pretrained: megatron.bridge.models.hf_pretrained.causal_lm.PreTrainedCausalLM,
) → megatron.bridge.models.qwen.qwen_provider.Qwen3MoEModelProvider#
mapping_registry() → megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#