Skip to main content

Ctrl+K

Megatron Bridge

GitHub

Megatron Bridge

GitHub

Table of Contents

Guides

Parallelisms Guide
Performance
Performance Tuning Guide
Using Recipes
NeMo 2.0 to Megatron Bridge Migration Guide
Megatron-LM to Megatron Bridge Guide

Bridge with 🤗 Hugging Face

Get Started with 🤗 Hugging Face Conversion
Megatron Bridge Conversion Technical Details

Supported Models

Large Language Models
- DeepSeek V2
- DeepSeek V3
- Gemma 2
- Gemma 3
- GLM 4.5
- GPT OSS
- Llama 3
- Llama Nemotron
- Mistral
- Moonlight
- Nemotron 3 Nano
- Nemotron H and Nemotron Nano v2
- OLMoE
- Qwen
Vision Language Models

Training and Customization

Configuration Overview
Training Entry Points
Training Loop Configuration
Optimizer and Scheduler Configuration
Logging and Monitoring
Profiling
Checkpointing
Resiliency
Mixed Precision Training
Communication Overlap
Attention Optimizations
Activation Recomputation
CPU Offloading
Parameter-Efficient Fine-Tuning (PEFT)
Packed Sequences
Multi-Token Prediction (MTP)
Knowledge Distillation
Pruning
Callbacks

Model Optimization with ModelOpt

Quantization

Development

Contribute a New Model to Megatron Bridge
Adapting Megatron Bridge in Reinforcement Learning Frameworks
Documentation Development
API Reference
- bridge

Releases

Software Component Versions
Changelog
Known Issues

Directory Readme Files

Megatron Bridge Documentation
Supported Models
Large Language Models
Vision Language Models
Releases
Training and Customization
Model Optimization

API Reference
bridge
bridge.training
bridge.training.tokenizers

`bridge.training.tokenizers`#

Submodules#

bridge.training.tokenizers.tokenizer
bridge.training.tokenizers.config

previous

bridge.training.mlm_compat.model

next

bridge.training.tokenizers.tokenizer

On this page

Submodules

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.