NVIDIA Deep Learning Transformer Engine Documentation - Last updated August 26, 2022 - Send Feedback -

NVIDIA Transformer Engine (TE)

Release Notes (BETA)
This document describes the key features, software enhancements and improvements, and known issues for Transformer Engine 0.2.0 and earlier releases.
User Guide (BETA)
This NVIDIA Transformer Engine (TE) 0.2.0 User Guide demonstrates how to install and use Transformer Engine. Transformer Engine is a library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper GPUs, to provide better performance with lower memory utilization in both training and inference.


Software License Agreement
This document is Apache License, version 2.0, the Software License Agreement (SLA) whose terms apply to NVIDIA Transformer Engine. Apache License is an open source license defined and maintained by the Apache Software Foundation. By accepting this agreement, you agree to comply with all the terms and conditions applicable to the specific product(s) included herein.


Documentation Archives
This Archives document provides access to previously released versions of Transformer Engine documentation.