Skip to main content

Ctrl+K

Megatron Bridge

GitHub

Megatron Bridge

GitHub

Table of Contents

Guides

Parallelisms Guide
Performance
Performance Tuning Guide
Using Recipes
NeMo 2.0 to Megatron Bridge Migration Guide
Megatron-LM to Megatron Bridge Guide

Bridge with 🤗 Hugging Face

Get Started with 🤗 Hugging Face Conversion
Megatron Bridge Conversion Technical Details

Supported Models

Large Language Models
- DeepSeek V2
- DeepSeek V3
- Gemma 2
- Gemma 3
- GLM 4.5
- GPT OSS
- Llama 3
- Llama Nemotron
- Mistral
- Moonlight
- Nemotron H and Nemotron Nano v2
- OLMoE
- Qwen
Vision Language Models

Training and Customization

Configuration Overview
Training Entry Points
Training Loop Configuration
Optimizer and Scheduler Configuration
Logging and Monitoring
Profiling
Checkpointing
Resiliency
Mixed Precision Training
Communication Overlap
Attention Optimizations
Activation Recomputation
CPU Offloading
Parameter-Efficient Fine-Tuning (PEFT)
Packed Sequences
Knowledge Distillation

Development

Contribute a New Model to Megatron Bridge
Adapting Megatron Bridge in Reinforcement Learning Frameworks
Documentation Development
API Reference
- bridge

Releases

Software Component Versions
Changelog
Known Issues

API Reference
bridge
bridge.training
bridge.training.post_training

`bridge.training.post_training`#

Submodules#

bridge.training.post_training.distillation
bridge.training.post_training.checkpointing

previous

bridge.training.tokenizers.tokenizer

next

bridge.training.post_training.distillation

On this page

Submodules

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.