bridge.models.qwen.qwen3_bridge#

Module Contents#

Classes#

Qwen3Bridge

Megatron Bridge for Qwen3 Causal LM.

API#

class bridge.models.qwen.qwen3_bridge.Qwen3Bridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Bridge for Qwen3 Causal LM.

This bridge handles the conversion between HuggingFace Qwen3ForCausalLM and Megatron-Core GPTModel formats. Qwen3 differs from Qwen2 by using QK layernorm and no QKV bias.

.. rubric:: Example

from megatron.bridge import AutoBridge bridge = AutoBridge.from_hf_pretrained(“Qwen/Qwen3-1.7B”) provider = bridge.to_megatron_provider()

provider_bridge(hf_pretrained)#

Convert HuggingFace Qwen3 config to GPTModelProvider.

mapping_registry() megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#