What can I help you with?
Megatron Core User Guide

models package

This package contains most of the popular LLMs . Currently we have support for GPT, Bert, T5 and Retro . This is an ever growing list so keep an eye out.

Previous API Guide
Next models.gpt package
© Copyright 2022-2025, NVIDIA. Last updated on Jan 14, 2025.