bridge.models.gemma.gemma2_bridge#

Module Contents#

Classes#

Gemma2Bridge

Megatron Bridge for Gemma2 Causal LM.

API#

class bridge.models.gemma.gemma2_bridge.Gemma2Bridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Bridge for Gemma2 Causal LM.

provider_bridge(
hf_pretrained: megatron.bridge.models.hf_pretrained.causal_lm.PreTrainedCausalLM,
) megatron.bridge.models.gemma.gemma2_provider.Gemma2ModelProvider#

Convert HuggingFace config to Gemma2ModelProvider.

mapping_registry() megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#

Return MegatronMappingRegistry containing parameter mappings from HF to Megatron format.

Returns:

Registry of parameter mappings

Return type:

MegatronMappingRegistry