bridge.models.qwen.qwen2_bridge#

Module Contents#

Classes#

Qwen2Bridge

Megatron Bridge for Qwen2 Causal LM.

API#

class bridge.models.qwen.qwen2_bridge.Qwen2Bridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Bridge for Qwen2 Causal LM.

This bridge handles the conversion between HuggingFace Qwen2ForCausalLM and Megatron-Core GPTModel formats, including weight mappings and configuration translation.

Qwen2 inherits CONFIG_MAPPING from MegatronModelBridge base class. Model-specific settings are applied in hf_config_to_model_config_kwargs.

.. rubric:: Example

from megatron.bridge import AutoBridge bridge = AutoBridge.from_hf_pretrained(“Qwen/Qwen2-7B”) model_config = bridge.get_model_config()

MODEL_CONFIG_CLASS#

None

USE_MODEL_CONFIG_FOR_CONVERSION#

True

hf_config_to_model_config_kwargs(
hf_config: transformers.PretrainedConfig,
) → dict[str, Any]#

Convert a Hugging Face Qwen2 config to builder config kwargs.

hf_config_to_provider_kwargs(
hf_config: transformers.PretrainedConfig,
) → dict[str, Any]#

Adapt the canonical builder mapping to the deprecated provider path.

mapping_registry() → megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#