bridge.models.qwen.qwen2_bridge#
Module Contents#
Classes#
Megatron Bridge for Qwen2 Causal LM. |
API#
- class bridge.models.qwen.qwen2_bridge.Qwen2Bridge#
Bases:
megatron.bridge.models.conversion.model_bridge.MegatronModelBridgeMegatron Bridge for Qwen2 Causal LM.
This bridge handles the conversion between HuggingFace Qwen2ForCausalLM and Megatron-Core GPTModel formats, including weight mappings and configuration translation.
Qwen2 inherits CONFIG_MAPPING and ACTIVATION_MAPPING from MegatronModelBridge base class. Model-specific settings are applied in provider_bridge.
.. rubric:: Example
from megatron.bridge import AutoBridge bridge = AutoBridge.from_hf_pretrained(“Qwen/Qwen2-7B”) provider = bridge.to_megatron_provider()
- provider_bridge(hf_pretrained)#
Convert HuggingFace Qwen2 config to GPTModelProvider.
- mapping_registry() megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#