bridge.models.llama.llama_bridge#

Module Contents#

Classes#

LlamaBridge

Megatron Bridge for Llama Causal LM.

API#

class bridge.models.llama.llama_bridge.LlamaBridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Bridge for Llama Causal LM.

As a user you would not use this bridge directly, but through AutoBridge.

.. rubric:: Example

from megatron.bridge import AutoBridge bridge = AutoBridge.from_hf_pretrained(“meta-llama/Llama-3.1-8B-Instruct”) provider = bridge.to_megatron_provider()

provider_bridge(
hf_pretrained: megatron.bridge.models.hf_pretrained.causal_lm.PreTrainedCausalLM,
) → megatron.bridge.models.llama.llama_provider.LlamaModelProvider#
mapping_registry() → megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#