PyG Release 24.11

This PyG container release is intended for use on the NVIDIA® Hopper Architecture GPU, NVIDIA H100, the NVIDIA® Ampere Architecture GPU, NVIDIA A100, and the associated NVIDIA CUDA® 12 and NVIDIA cuDNN 9 libraries.

Driver Requirements

Release 24.11 is based on CUDA 12.6.3 which requires NVIDIA Driver release 560 or later. However, if you are running on a data center GPU (for example, T4 or any other data center GPU), you can use NVIDIA driver release 470.57 (or later R470), 525.85 (or later R525), 535.86 (or later R535), or 545.23 (or later R545).

The CUDA driver's compatibility package only supports particular drivers. Thus, users should upgrade from all R418, R440, R450, R460, R510, R520, R530, R545 and R555 drivers, which are not forward-compatible with CUDA 12.6. For a complete list of supported drivers, see the CUDA Application Compatibility topic. For more information, see CUDA Compatibility and Upgrades.

Contents of the PyG container

This container image includes the complete source of the NVIDIA version of PyG in /opt/pyg/pytorch_geometric. It is prebuilt and installed as a system Python module. The /workspace/examples folder is copied from /opt/pyg/pytorch_geometric/examples for users starting to run PyG. For example, to run the gcn.py example:

            

            
/workspace/examples# python gcn.py
        

See /workspace/README.md for details. The container also includes the following:

• torch-geometric 2.7.0
• pyg-lib 0.4.0
• Built on PyTorch 24.11, which contains the following:
  • Ubuntu 24.04 including Python 3.12
  • NVIDIA CUDA 12.6.3
  • NVIDIA cuBLAS 12.6.4.1
  • NVIDIA cuDNN 9.5.1.17
  • NVIDIA NCCL 2.23.4
  • NVIDIA RAPIDS™ 24.10
  • Apex
  • rdma-core 39.0
  • NVIDIA HPC-X 2.21
  • OpenMPI 4.1.7
  • GDRCopy 2.4.1
  • TensorBoard 2.9.0
  • Nsight Compute 2024.3.2.3
  • Nsight Systems 2024.6.1.90
  • NVIDIA TensorRT™ 10.6.0.26
  • Torch-TensorRT 2.6.0a0
  • NVIDIA DALI® 1.43
  • MAGMA 2.6.2
  • JupyterLab 4.2.5 including Jupyter-TensorBoard
  • TransformerEngine v1.12
  • PyTorch quantization wheel 2.1.2

GPU Requirements

Release 24.11 supports CUDA compute capability 6.0 and later. This corresponds to GPUs in the NVIDIA Pascal, NVIDIA Volta™, NVIDIA Turing™, NVIDIA Ampere architecture, and NVIDIA Hopper™ architecture families. For a list of GPUs to which this compute capability corresponds, see CUDA GPUs. For additional support details, see Deep Learning Frameworks Support Matrix.

Key Features and Enhancements

• The latest GNN+LLM features. See examples/llm for details
• Much faster and more resource efficient examples for multigpu/multinode using WholeGraph. See examples/distributed/NVIDIA-RAPIDS/WholeGraph.

Announcements

Volta GPU compute architecture support will be discontinued by the 25.01 release.

NVIDIA PyG Container Versions

The PyG container supports the same version of Ubuntu and CUDA as the PyTorch container.

Known Issues

• None.