NVIDIA cuDNN Backend

Use the NVIDIA cuDNN backend API only if you want to use the legacy fixed-function routines that are not graph-based interfaces and are not exposed by the frontend API layers.

The NVIDIA cuDNN frontend API provides a simplified programming model that is sufficient for most use cases.

• Overview
• Installation Guide
• Release Notes
  • cuDNN 9.8.0
  • cuDNN 9.7.1
  • cuDNN 9.7.0
  • cuDNN 9.6.0
  • cuDNN 9.5.1
  • cuDNN 9.5.0
  • cuDNN 9.4.0
  • cuDNN 9.3.0
  • cuDNN 9.2.1
  • cuDNN 9.2.0
  • cuDNN 9.1.1
  • cuDNN 9.1.0
  • cuDNN 9.0.0

Backend API

• Backend API Overview
• cudnn_graph Library
• cudnn_ops Library
• cudnn_cnn Library
• cudnn_adv Library

Backend Developer Guide

• Overview
• Core Concepts
  • cuDNN Handle
  • Tensor Core Operations
    • Notes on Tensor Core Precision
• Graph API
  • Backend Native CUDA Graph API
• Legacy API
  • Convolution Functions
    • Prerequisites
    • Supported Algorithms
    • Data and Filter Formats
  • RNN Functions
    • Prerequisites
    • Supported Algorithms
    • Data and Filter Formats
    • Features of RNN Functions
  • Tensor Transformations
    • Conversion Between FP32 and FP16
    • Padding
    • Folding
    • Conversion Between NCHW And NHWC
  • Mixed Precision Numerical Accuracy
• Compatibility
  • cuDNN API Compatibility
  • Forward-Compatibility and the Legacy API
• Odds and Ends
  • Reproducibility (Determinism)
  • Scaling Parameters
  • Deprecation Policy
  • GPU And Driver Requirements
  • Conventions And Features For Convolutions
    • Convolution Formulas
    • Grouped Convolutions
    • Best Practices for 3D Convolutions
      • Recommended Settings
      • Limitations
  • Environment Variables
  • Version Checking Against CUDNN_VERSION
  • cuDNN Symbol Server
    • Example: Symbolizing
  • API Usage During Initialization and Termination

Reference

• Support Matrix
  • GPU, CUDA Toolkit, and CUDA Driver Requirements
  • CPU Architecture and OS Requirements
    • Linux
    • Windows
• Troubleshooting
  • Error Reporting And API Logging
• Documentation Archives
• Software License Agreement
  • LICENSE AGREEMENT FOR NVIDIA SOFTWARE DEVELOPMENT KITS
  • License.
    • Grant
    • Distribution Requirements
    • Authorized Users
    • Pre-Release SDK
    • Updates
    • Components Under Other Licenses
    • Reservation of Rights
  • Limitations.
  • Ownership.
  • No Warranties.
  • Limitations of Liability.
  • Termination.
  • General.
  • cuDNN SUPPLEMENT TO SOFTWARE LICENSE AGREEMENT FOR NVIDIA SOFTWARE DEVELOPMENT KITS
• Acknowledgements
  • University of Tennessee
  • University of California, Berkeley
  • Facebook AI Research, New York
  • Institutions and their Contributions
• Notices