NVIDIA Megatron-Core

Developer Guide (Latest)

Megatron Core is a Python library that has the core components required to build your language models. A reference implementation of megatorn core can be found in NeMo It offers a simple and intuitive API.

User Guide

API Guide

© Copyright 2022-2024, NVIDIA. Last updated on Mar 16, 2024.