Megatron Core User Guide#

Megatron Core is a Python library that has the core components required to build your language models. A reference implementation of Megatron Core can be found in NeMo It offers a simple and intuitive API.

API Guide