Release Notes – Release 0.5.0 (BETA)¶

Key Features and Enhancements¶

Added a C API for RMSNorm and GeGLU operations as well as their gradients.

Added support for NVTX markers.

Fixed an issue preventing Transformer Engine from work with an interleaved pipeline parallelism scheme.

Fixed an issue which resulted in increasing checkpoint size during evaluation when using activation checkpointing.

There are no known issues in this release.

There are no breaking changes in this release.

There are no deprecated features in this release.