Installation¶
Prerequisites¶
Linux x86_64
NVIDIA Driver supporting CUDA 11.8 or later.
Transformer Engine in NGC Containers¶
Transformer Engine library is preinstalled in the PyTorch container in versions 22.09 and later on NVIDIA GPU Cloud.
pip - from GitHub¶
Additional Prerequisites¶
Installation (stable release)¶
Execute the following command to install the latest stable version of Transformer Engine:
pip install --upgrade git+https://github.com/NVIDIA/TransformerEngine.git@stable
Installation (development build)¶
Warning
While the development build of Transformer Engine could contain new features not available in the official build yet, it is not supported and so its usage is not recommended for general use.
Execute the following command to install the latest development build of Transformer Engine:
pip install --upgrade git+https://github.com/NVIDIA/TransformerEngine.git@main