bridge

Megatron Bridge - A component of the Megatron ecosystem.

Subpackages

• bridge.recipes
  • bridge.recipes.olmoe
    • bridge.recipes.olmoe.olmoe_7b
  • bridge.recipes.gemma3_vl
    • bridge.recipes.gemma3_vl.gemma3_vl
  • bridge.recipes.gpt
    • bridge.recipes.gpt.vanilla_gpt
    • bridge.recipes.gpt.gpt3_175b
  • bridge.recipes.qwen
    • bridge.recipes.qwen.qwen3_moe
    • bridge.recipes.qwen.qwen3
    • bridge.recipes.qwen.qwen3_next
    • bridge.recipes.qwen.qwen2
  • bridge.recipes.utils
    • bridge.recipes.utils.optimizer_utils
    • bridge.recipes.utils.dataset_utils
    • bridge.recipes.utils.finetune_utils
    • bridge.recipes.utils.tokenizer_utils
  • bridge.recipes.glm
    • bridge.recipes.glm.glm45
  • bridge.recipes.gemma
    • bridge.recipes.gemma.gemma2
    • bridge.recipes.gemma.gemma3
  • bridge.recipes.nemotron_vl
    • bridge.recipes.nemotron_vl.nemotron_nano_v2_vl
  • bridge.recipes.ministral3
    • bridge.recipes.ministral3.ministral3
  • bridge.recipes.qwen2_audio
    • bridge.recipes.qwen2_audio.qwen2_audio
  • bridge.recipes.moonlight
    • bridge.recipes.moonlight.moonlight_16b
  • bridge.recipes.nemotronh
    • bridge.recipes.nemotronh.nemotronh
    • bridge.recipes.nemotronh.nemotron_3_nano
    • bridge.recipes.nemotronh.nemotron_3_super
    • bridge.recipes.nemotronh.nemotron_nano_v2
  • bridge.recipes.wan
  • bridge.recipes.flux
  • bridge.recipes.kimi_vl
    • bridge.recipes.kimi_vl.kimi_k25_vl
  • bridge.recipes.glm_vl
    • bridge.recipes.glm_vl.glm_45v
  • bridge.recipes.gpt_oss
    • bridge.recipes.gpt_oss.gpt_oss
  • bridge.recipes.llama
    • bridge.recipes.llama.llama2
    • bridge.recipes.llama.llama3
  • bridge.recipes.deepseek
    • bridge.recipes.deepseek.deepseek_v2
    • bridge.recipes.deepseek.deepseek_v3
  • bridge.recipes.qwen_vl
    • bridge.recipes.qwen_vl.qwen25_vl
    • bridge.recipes.qwen_vl.qwen3_vl
    • bridge.recipes.qwen_vl.qwen35_vl
    • bridge.recipes.qwen_vl.qwen25_vl_dataset
  • bridge.recipes.run_plugins
  • bridge.recipes.common
• bridge.utils
  • bridge.utils.slurm_utils
  • bridge.utils.instantiate_utils
  • bridge.utils.common_utils
  • bridge.utils.vocab_utils
  • bridge.utils.safe_pickle
  • bridge.utils.activation_map
  • bridge.utils.decorators
  • bridge.utils.import_utils
  • bridge.utils.fusions
  • bridge.utils.yaml_utils
• bridge.peft
  • bridge.peft.module_matcher
  • bridge.peft.walk_utils
  • bridge.peft.lora
  • bridge.peft.recompute
  • bridge.peft.base
  • bridge.peft.utils
  • bridge.peft.canonical_lora
  • bridge.peft.dora_layers
  • bridge.peft.lora_layers
  • bridge.peft.adapter_wrapper
  • bridge.peft.dora
• bridge.diffusion
  • bridge.diffusion.recipes
    • bridge.diffusion.recipes.wan
    • bridge.diffusion.recipes.flux
  • bridge.diffusion.conversion
    • bridge.diffusion.conversion.wan
    • bridge.diffusion.conversion.flux
  • bridge.diffusion.base
  • bridge.diffusion.common
    • bridge.diffusion.common.flow_matching
  • bridge.diffusion.models
    • bridge.diffusion.models.wan
    • bridge.diffusion.models.flux
    • bridge.diffusion.models.common
  • bridge.diffusion.data
    • bridge.diffusion.data.wan
    • bridge.diffusion.data.flux
    • bridge.diffusion.data.common
• bridge.training
  • bridge.training.utils
    • bridge.training.utils.checkpoint_utils
    • bridge.training.utils.theoretical_memory_utils
    • bridge.training.utils.wandb_utils
    • bridge.training.utils.omegaconf_utils
    • bridge.training.utils.padding_utils
    • bridge.training.utils.moe_token_drop
    • bridge.training.utils.comet_utils
    • bridge.training.utils.mlflow_utils
    • bridge.training.utils.train_utils
    • bridge.training.utils.pg_utils
    • bridge.training.utils.log_utils
    • bridge.training.utils.visual_inputs
    • bridge.training.utils.config_utils
    • bridge.training.utils.flop_utils
    • bridge.training.utils.sig_utils
    • bridge.training.utils.packed_seq_utils
    • bridge.training.utils.batch_utils
  • bridge.training.mlm_compat
    • bridge.training.mlm_compat.activations
    • bridge.training.mlm_compat.model
    • bridge.training.mlm_compat.arguments
  • bridge.training.tokenizers
    • bridge.training.tokenizers.config
    • bridge.training.tokenizers.tokenizer
  • bridge.training.post_training
    • bridge.training.post_training.distillation
    • bridge.training.post_training.checkpointing
  • bridge.training.setup
  • bridge.training.train_mimo
  • bridge.training.config
  • bridge.training.losses
  • bridge.training.finetune
  • bridge.training.fault_tolerance
  • bridge.training.llava_step
  • bridge.training.checkpointing
  • bridge.training.profiling
  • bridge.training.tensor_inspect
  • bridge.training.gpt_step
  • bridge.training.audio_lm_step
  • bridge.training.initialize
  • bridge.training.nvrx_straggler
  • bridge.training.eval
  • bridge.training.state
  • bridge.training.mimo_step
  • bridge.training.mimo_parallel_utils
  • bridge.training.optim
  • bridge.training.distill
  • bridge.training.forward_step_func_types
  • bridge.training.train
  • bridge.training.comm_overlap
  • bridge.training.mixed_precision
  • bridge.training.vlm_step
  • bridge.training.flex_dispatcher_backend
  • bridge.training.pretrain_mimo
  • bridge.training.callbacks
  • bridge.training.inprocess_restart
  • bridge.training.model_load_save
  • bridge.training.setup_mimo
  • bridge.training.pretrain
• bridge.models
  • bridge.models.mamba
    • bridge.models.mamba.mamba_provider
    • bridge.models.mamba.mamba_builder
  • bridge.models.olmoe
    • bridge.models.olmoe.olmoe_bridge
    • bridge.models.olmoe.olmoe_provider
  • bridge.models.qwen3_asr
    • bridge.models.qwen3_asr.modeling_qwen3_asr
    • bridge.models.qwen3_asr.hf_qwen3_asr
    • bridge.models.qwen3_asr.qwen3_asr_provider
    • bridge.models.qwen3_asr.qwen3_asr_bridge
  • bridge.models.sarvam
    • bridge.models.sarvam.sarvam_moe_bridge
    • bridge.models.sarvam.sarvam_provider
    • bridge.models.sarvam.sarvam_mla_bridge
    • bridge.models.sarvam.common
  • bridge.models.gpt
    • bridge.models.gpt.gpt_builder
  • bridge.models.llama_nemotron
    • bridge.models.llama_nemotron.llama_nemotron_bridge
    • bridge.models.llama_nemotron.llama_nemotron_provider
  • bridge.models.qwen
    • bridge.models.qwen.qwen3_moe_bridge
    • bridge.models.qwen.qwen3_bridge
    • bridge.models.qwen.qwen3_next_bridge
    • bridge.models.qwen.qwen2_bridge
  • bridge.models.conversion
    • bridge.models.conversion.peft_bridge
    • bridge.models.conversion.auto_bridge
    • bridge.models.conversion.utils
    • bridge.models.conversion.mapping_registry
    • bridge.models.conversion.model_bridge
    • bridge.models.conversion.transformers_compat
    • bridge.models.conversion.quant_mapping
    • bridge.models.conversion.param_mapping
  • bridge.models.decorators
    • bridge.models.decorators.torchrun
    • bridge.models.decorators.dispatch
  • bridge.models.mistral
    • bridge.models.mistral.mistral_bridge
    • bridge.models.mistral.mistral_provider
  • bridge.models.glm
    • bridge.models.glm.glm45_bridge
    • bridge.models.glm.glm_moe_mappings
  • bridge.models.qwen_omni
    • bridge.models.qwen_omni.modeling_qwen25_omni
    • bridge.models.qwen_omni.qwen25_omni_provider
    • bridge.models.qwen_omni.qwen25_omni_bridge
  • bridge.models.gemma
    • bridge.models.gemma.gemma_provider
    • bridge.models.gemma.modules
    • bridge.models.gemma.gemma2_bridge
    • bridge.models.gemma.gemma3_provider
    • bridge.models.gemma.gemma2_provider
    • bridge.models.gemma.gemma3_bridge
    • bridge.models.gemma.gemma_bridge
  • bridge.models.nemotron_vl
    • bridge.models.nemotron_vl.nemotron_vl_bridge
    • bridge.models.nemotron_vl.modeling_nemotron_vl
    • bridge.models.nemotron_vl.nemotron_vl_provider
    • bridge.models.nemotron_vl.nemotron_vl_utils
  • bridge.models.mimo
    • bridge.models.mimo.mimo_config
    • bridge.models.mimo.mimo_provider
    • bridge.models.mimo.mimo_ddp
    • bridge.models.mimo.llava_provider
    • bridge.models.mimo.mimo_builder
    • bridge.models.mimo.mimo_bridge
  • bridge.models.ministral3
    • bridge.models.ministral3.ministral3_bridge
    • bridge.models.ministral3.modeling_ministral3
    • bridge.models.ministral3.ministral3_provider
  • bridge.models.qwen_audio
    • bridge.models.qwen_audio.qwen2_audio_bridge
    • bridge.models.qwen_audio.qwen2_audio_provider
    • bridge.models.qwen_audio.modeling_qwen2_audio
  • bridge.models.minimax_m2
    • bridge.models.minimax_m2.minimax_m2_bridge
    • bridge.models.minimax_m2.minimax_m2_provider
  • bridge.models.gemma_vl
    • bridge.models.gemma_vl.gemma3_vl_provider
    • bridge.models.gemma_vl.modeling_gemma3_vl
    • bridge.models.gemma_vl.gemma3_vl_bridge
  • bridge.models.nemotronh
    • bridge.models.nemotronh.nemotron_h_provider
    • bridge.models.nemotronh.nemotron_h_bridge
  • bridge.models.kimi
    • bridge.models.kimi.kimi_bridge
  • bridge.models.kimi_vl
    • bridge.models.kimi_vl.utils
    • bridge.models.kimi_vl.modeling_kimi_k25_vl
    • bridge.models.kimi_vl.kimi_k25_vl_provider
    • bridge.models.kimi_vl.kimi_k25_vl_bridge
  • bridge.models.nemotron
    • bridge.models.nemotron.nemotron_bridge
  • bridge.models.bailing
    • bridge.models.bailing.bailing_moe2_bridge
    • bridge.models.bailing.modeling_bailing_moe_v2
    • bridge.models.bailing.configuration_bailing_moe_v2
  • bridge.models.glm_vl
    • bridge.models.glm_vl.modeling_glm_45v
    • bridge.models.glm_vl.glm_45v_provider
    • bridge.models.glm_vl.glm_45v_bridge
  • bridge.models.gpt_oss
    • bridge.models.gpt_oss.gpt_oss_bridge
  • bridge.models.hf_pretrained
    • bridge.models.hf_pretrained.causal_lm
    • bridge.models.hf_pretrained.base
    • bridge.models.hf_pretrained.utils
    • bridge.models.hf_pretrained.state
    • bridge.models.hf_pretrained.safe_config_loader
    • bridge.models.hf_pretrained.vlm
  • bridge.models.common
    • bridge.models.common.base
    • bridge.models.common.unimodal
  • bridge.models.llama
    • bridge.models.llama.llama4_utils
    • bridge.models.llama.llama_bridge
  • bridge.models.deepseek
    • bridge.models.deepseek.deepseek_v3_bridge
    • bridge.models.deepseek.deepseek_v2_bridge
    • bridge.models.deepseek.common
  • bridge.models.qwen_vl
    • bridge.models.qwen_vl.modelling_qwen3_vl
    • bridge.models.qwen_vl.modeling_qwen25_vl
    • bridge.models.qwen_vl.qwen25_vl_provider
    • bridge.models.qwen_vl.qwen35_vl_bridge
    • bridge.models.qwen_vl.qwen3_vl_provider
    • bridge.models.qwen_vl.qwen3_vl_bridge
    • bridge.models.qwen_vl.qwen35_vl_provider
    • bridge.models.qwen_vl.qwen3_vl_step
    • bridge.models.qwen_vl.qwen25_vl_bridge
  • bridge.models.t5_provider
  • bridge.models.gpt_provider
  • bridge.models.config
  • bridge.models.mla_provider
  • bridge.models.model_provider
  • bridge.models.transformer_config
  • bridge.models.gpt_full_te_layer_autocast_spec
  • bridge.models.distillation_provider
• bridge.data
  • bridge.data.energon
    • bridge.data.energon.task_encoder_utils
    • bridge.data.energon.energon_provider
    • bridge.data.energon.base_energon_datamodule
    • bridge.data.energon.hf_encoder_task_encoder
  • bridge.data.builders
    • bridge.data.builders.finetuning_dataset
    • bridge.data.builders.hf_dataset
  • bridge.data.hf_processors
    • bridge.data.hf_processors.openmathinstruct2
    • bridge.data.hf_processors.gsm8k
    • bridge.data.hf_processors.squad
  • bridge.data.mimo
    • bridge.data.mimo.dataset
    • bridge.data.mimo.collate
    • bridge.data.mimo.loaders
    • bridge.data.mimo.dp_utils
    • bridge.data.mimo.hf_provider
    • bridge.data.mimo.base_provider
    • bridge.data.mimo.mock_provider
  • bridge.data.vlm_datasets
    • bridge.data.vlm_datasets.collate
    • bridge.data.vlm_datasets.conversation_dataset
    • bridge.data.vlm_datasets.hf_dataset_makers
    • bridge.data.vlm_datasets.token_utils
    • bridge.data.vlm_datasets.hf_provider
    • bridge.data.vlm_datasets.mock_provider
    • bridge.data.vlm_datasets.preloaded_provider
  • bridge.data.datasets
    • bridge.data.datasets.utils
    • bridge.data.datasets.fim_dataset
    • bridge.data.datasets.packed_parquet
    • bridge.data.datasets.packed_sequence
    • bridge.data.datasets.packing_utils
    • bridge.data.datasets.sft
  • bridge.data.loaders
  • bridge.data.utils
  • bridge.data.samplers
  • bridge.data.finetuning
  • bridge.data.iterator_utils

Submodules

• bridge.package_info

Package Contents

Data

__all__

API

bridge.__all__

[’version’, ‘package_name’, ‘contact_names’, ‘contact_emails’, ‘homepage’, ‘__re…