Core APIs# Low-level API reference for core Megatron components. transformer package tensor_parallel package pipeline_parallel package fusions package distributed package datasets package Data Pipeline Data pre-processing Data loading: construction Data loading: implementation dist_checkpointing package Safe Checkpoint Loading Checkpointing Distributed Optimizer Subpackages dist_checkpointing.strategies package
