Megatron Bridge
Table of Contents
Performance
Guides
Bridge with 🤗 Hugging Face
Supported Models
Training and Customization
Model Optimization with ModelOpt
Development
bridge
bridge.utils
bridge.utils.safe_url
bridge.utils.instantiate_utils
bridge.utils.safe_pickle
bridge.utils.vocab_utils
bridge.utils.yaml_utils
bridge.utils.slurm_utils
bridge.utils.fusions
bridge.utils.decorators
bridge.utils.import_utils
bridge.utils.activation_map
bridge.utils.common_utils
bridge.utils.cuda_graph
bridge.recipes
bridge.recipes.glm
bridge.recipes.deepseek
bridge.recipes.kimi_vl
bridge.recipes.qwen2_audio
bridge.recipes.nemotronh
bridge.recipes.utils
bridge.recipes.gpt
bridge.recipes.qwen
bridge.recipes.nemotron_omni
bridge.recipes.qwen_vl
bridge.recipes.moonlight
bridge.recipes.stepfun
bridge.recipes.glm_vl
bridge.recipes.llama
bridge.recipes.gemma3_vl
bridge.recipes.flux
bridge.recipes.wan
bridge.recipes.ministral3
bridge.recipes.qwen_omni
bridge.recipes.olmoe
bridge.recipes.nemotron_vl
bridge.recipes.gemma
bridge.recipes.gpt_oss
bridge.recipes.gemma4_vl
bridge.recipes.run_plugins
bridge.recipes.common
bridge.models
bridge.models.glm
bridge.models.deepseek
bridge.models.kimi_vl
bridge.models.nemotronh
bridge.models.minimax_m2
bridge.models.mimo_v2_flash
bridge.models.mimo
bridge.models.gpt
bridge.models.qwen
bridge.models.nemotron_omni
bridge.models.qwen3_asr
bridge.models.falcon_h1
bridge.models.megatron_mimo
bridge.models.qwen_vl
bridge.models.stepfun
bridge.models.sarvam
bridge.models.glm_vl
bridge.models.llama
bridge.models.common
bridge.models.nemotron
bridge.models.hf_pretrained
bridge.models.ministral3
bridge.models.ernie
bridge.models.llama_nemotron
bridge.models.qwen_omni
bridge.models.kimi
bridge.models.decorators
bridge.models.gemma_vl
bridge.models.olmoe
bridge.models.nemotron_vl
bridge.models.mamba
bridge.models.bailing
bridge.models.mistral
bridge.models.gemma
bridge.models.gpt_oss
bridge.models.glm_moe_dsa
bridge.models.ernie_vl
bridge.models.conversion
bridge.models.qwen_audio
bridge.models.config
bridge.models.model_provider
bridge.models.gpt_provider
bridge.models.distillation_provider
bridge.models.transformer_config
bridge.models.t5_provider
bridge.models.gpt_full_te_layer_autocast_spec
bridge.models.mla_provider
bridge.peft
bridge.peft.dora_layers
bridge.peft.recompute
bridge.peft.lora_layers
bridge.peft.utils
bridge.peft.module_matcher
bridge.peft.canonical_lora
bridge.peft.adapter_wrapper
bridge.peft.dora
bridge.peft.walk_utils
bridge.peft.lora
bridge.peft.base
bridge.diffusion
bridge.diffusion.recipes
bridge.diffusion.models
bridge.diffusion.common
bridge.diffusion.data
bridge.diffusion.base
bridge.diffusion.conversion
bridge.data
bridge.data.hf_processors
bridge.data.megatron_mimo
bridge.data.vlm_datasets
bridge.data.builders
bridge.data.datasets
bridge.data.energon
bridge.data.utils
bridge.data.iterator_utils
bridge.data.finetuning
bridge.data.loaders
bridge.data.samplers
bridge.training
bridge.training.utils
bridge.training.mlm_compat
bridge.training.tokenizers
bridge.training.post_training
bridge.training.audio_lm_step
bridge.training.nemotron_omni_step
bridge.training.flex_dispatcher_backend
bridge.training.comm_overlap
bridge.training.eval_context_parallel_rebinding
bridge.training.vlm_step
bridge.training.state
bridge.training.config
bridge.training.losses
bridge.training.megatron_mimo_step
bridge.training.setup
bridge.training.nvrx_straggler
bridge.training.checkpointing
bridge.training.llava_step
bridge.training.profiling
bridge.training.inprocess_restart
bridge.training.optim
bridge.training.finetune
bridge.training.setup_megatron_mimo
bridge.training.pretrain
bridge.training.train
bridge.training.megatron_mimo_parallel_utils
bridge.training.pretrain_megatron_mimo
bridge.training.gpt_step
bridge.training.forward_step_func_types
bridge.training.mixed_precision
bridge.training.distill
bridge.training.initialize
bridge.training.fault_tolerance
bridge.training.callbacks
bridge.training.tensor_inspect
bridge.training.train_megatron_mimo
bridge.training.model_load_save
bridge.training.eval
bridge.package_info
Releases
Agent Skills
Directory Readme Files
Sarvam model documentation is organized by model variant.
Variant
Guide
Sarvam
sarvam.md
