NVIDIA Math Libraries for the Python Ecosystem

Welcome to the nvmath-python documentation!

nvmath-python is a Python library to enable cutting-edge performance, productivity, and interoperability within the Python computational ecosystem by providing access to the full capabilities of NVIDIA’s high-performance math libraries.

To quickly get started with nvmath-python, take a look at our Getting Started manual. Refer to our Installation Guide for detailed instructions on the various installation choices available.

Contents

User Guide

• Getting Started
  • Installation
  • Examples
• Overview
  • Architecture
  • Host APIs
  • Host APIs with Callbacks
  • Distributed Host APIs
  • Device APIs
  • Compatibility Policy
• Installation
  • Install from PyPI
  • Install from conda
  • Build from Source
  • Support Matrix
  • Troubleshooting
  • Tests
• API Design and Usage Patterns
  • Stateful APIs
  • Stream Semantics

Examples and tutorials

• Linear Algebra Host APIs Tutorial
  • Introduction to GEMM with nvmath-python
  • Fused Epilogs
  • Implementing a simple neural network
  • Narrow-precision operations
• Examples on GitHub

API Reference

• Host APIs
  • Key Concepts
    • Matrix and Tensor Qualifiers
  • Contents
    • Linear Algebra
    • Sparse Linear Algebra
    • Fast Fourier Transform
    • Tensor Operations
    • Host API Utilities
• Distributed Host APIs
  • Overview
  • Contents
    • Distributed runtime
    • Operand distribution
    • Linear Algebra
    • Fast Fourier Transform
    • Distributed Host API Utilities
• Device APIs
  • Supported Compilers
  • Using Device APIs with Third-party Compilers
    • Device API utilities
    • cuBLASDx
    • cuFFTDx
    • cuSOLVERDx
    • cuRAND Device APIs
• Bindings
  • Overview
  • Compatibility Policy
  • Naming & Calling Convention
  • Memory management
    • Pointer and data lifetime
  • API Reference
    • cuBLAS (nvmath.bindings.cublas)
    • cuBLASLt (nvmath.bindings.cublaslt)
    • cuBLASMp (nvmath.bindings.cublasMp)
    • cuDSS (nvmath.bindings.cudss)
    • cuFFT (nvmath.bindings.cufft)
    • cuSOLVER (nvmath.bindings.cusolver)
    • cuSOLVERDn (nvmath.bindings.cusolverDn)
    • cuSOLVERSp (nvmath.bindings.cusolverSp)
    • cuSOLVERMp (nvmath.bindings.cusolverMp)
    • cuSPARSE (nvmath.bindings.cusparse)
    • cuSPARSELt (nvmath.bindings.cusparseLt)
    • cuTENSOR (nvmath.bindings.cutensor)
    • cuRAND (nvmath.bindings.curand)
    • NVPL BLAS (nvmath.bindings.nvpl.blas)
    • NVPL FFT (nvmath.bindings.nvpl.fft)

Other Resources

• Release Notes
• Code of Conduct
• Contributing
• License
• GitHub Repository