`bridge.models.nemotron.nemotron_bridge`#

Module Contents#

Classes#

NemotronBridge

Megatron Bridge for Nemotron Causal LM.

Functions#

Squared ReLU activation function.

API#

bridge.models.nemotron.nemotron_bridge.squared_relu(x)#: Squared ReLU activation function.

class bridge.models.nemotron.nemotron_bridge.NemotronBridge#

Bases: megatron.bridge.models.conversion.model_bridge.MegatronModelBridge

Megatron Bridge for Nemotron Causal LM.

As a user you would not use this bridge directly, but through AutoBridge.

.. rubric:: Example

from megatron.bridge import AutoBridge bridge = AutoBridge.from_hf_pretrained(“nvidia/Nemotron-4-340B-Instruct”) provider = bridge.to_megatron_provider()

CONFIG_MAPPING#: None

provider_bridge( hf_pretrained: megatron.bridge.models.hf_pretrained.causal_lm.PreTrainedCausalLM, ) → megatron.bridge.models.gpt_provider.GPTModelProvider#: Convert HuggingFace Nemotron config to GPTModelProvider.

mapping_registry() → megatron.bridge.models.conversion.mapping_registry.MegatronMappingRegistry#