API Guide# API reference documentation for Megatron Core components. Model APIs models package Subpackages models.gpt package models.bert package models.t5 package Core APIs transformer package tensor_parallel package pipeline_parallel package fusions package distributed package datasets package Data Pipeline Data pre-processing Data loading: construction Data loading: implementation Fast DataLoader initialization dist_checkpointing package Safe Checkpoint Loading Checkpointing Distributed Optimizer Subpackages dist_checkpointing.strategies package Internal Utilities Microbatches Calculator Optimizer Parameters Scheduler
