This document describes the key features, software enhancements and improvements, and known issues for cuDNN v7.2.1 and earlier releases.