PyG Release 24.05

This PyG container release is intended for use on the NVIDIA® Hopper Architecture GPU, NVIDIA H100, the NVIDIA® Ampere Architecture GPU, NVIDIA A100, and the associated NVIDIA CUDA® 12 and NVIDIA cuDNN 9 libraries.

Driver Requirements

Release 24.05 is based on NVIDIA CUDA 12.4.0.41, which requires NVIDIA Driver release 535 or later. However, if you are running on a data center GPU (for example, T4 or any other data center GPU), you can use NVIDIA driver release 450.51 (or later R450), 470.57 (or later R470), 510.47 (or later R510), or 525.85 (or later R525), or 535.86 (or later R535). The CUDA driver's compatibility package only supports particular drivers. Thus, users should upgrade from all R418, R440, R460, and R520 drivers, which are not forward-compatible with CUDA 12.2. For a complete list of supported drivers, see the CUDA Application Compatibility topic. For more information, see CUDA Compatibility and Upgrades.

Contents of the PyG container

This container image includes the complete source of the NVIDIA version of PyG in /opt/pyg/pytorch_geometric. It is prebuilt and installed as a system Python module. The /workspace/examples folder is copied from /opt/pyg/pytorch_geometric/examples for users starting to run PyG. For example, to run the gcn.py example:

            

            
/workspace/examples# python gcn.py
        

See /workspace/README.md for details. The container also includes the following:

• torch-geometric 2.6.0
• pyg-lib 0.4.0
• Built on PyTorch 24.05, which contains the following:
  • Ubuntu 22.04 including Python 3.10
  • NVIDIA CUDA 12.4.1
  • NVIDIA cuBLAS 12.4.5.8
  • NVIDIA cuDNN 9.1.0.70
  • NVIDIA NCCL 2.21.5
  • NVIDIA RAPIDS™ 24.04
  • Apex
  • rdma-core 39.0
  • NVIDIA HPC-X 2.19
  • OpenMPI 4.1.4+
  • GDRCopy 2.3
  • TensorBoard 2.9.0
  • Nsight Compute 2024.1.1.4
  • Nsight Systems 2024.2.1.106
  • NVIDIA TensorRT™ 10.0.1.6
  • Torch-TensorRT 2.4.0a0
  • NVIDIA DALI® 1.37.1
  • MAGMA 2.6.2
  • JupyterLab 2.3.2 including Jupyter-TensorBoard
  • TransformerEngine v1.6
  • PyTorch quantization wheel 2.1.2

GPU Requirements

Release 24.05 supports CUDA compute capability 6.0 and later. This corresponds to GPUs in the NVIDIA Pascal, NVIDIA Volta™, NVIDIA Turing™, NVIDIA Ampere architecture, and NVIDIA Hopper™ architecture families. For a list of GPUs to which this compute capability corresponds, see CUDA GPUs. For additional support details, see Deep Learning Frameworks Support Matrix.

Key Features and Enhancements

• GNN+LLM based Knowledge Graph RAG system calledG-retriever integrated into PyG. Example comes with a demonstration of GNNs reducing hallucinations of LLM. This enables a playground for users to combine any PyG GNN and Huggingface LLM.
• GNN Platform removed

Announcements

There are no announces for PyG in this release.

NVIDIA PyG Container Versions

The PyG container supports the same version of Ubuntu and CUDA as the PyTorch container.

Known Issues

• /workspace/examples/multi_gpu/papers100m_gcn.py and papers100m_gcn_cugraph.py can hit OOM on certain systems. If this issue is encountered NVIDIA recommends downgrading to the previous version of the container or upgrading to the latest, when available.