Contents

White paper covering the most common issues related to NVIDIA GPUs.

• 1. Volta Tuning Guide
  • 1.1. NVIDIA Volta Compute Architecture
  • 1.2. CUDA Best Practices
  • 1.3. Application Compatibility
  • 1.4. Volta Tuning
    • 1.4.1. Streaming Multiprocessor
      • 1.4.1.1. Instruction Scheduling
      • 1.4.1.2. Independent Thread Scheduling
      • 1.4.1.3. Occupancy
      • 1.4.1.4. Integer Arithmetic
    • 1.4.2. Tensor Core Operations
    • 1.4.3. Memory Throughput
      • 1.4.3.1. High Bandwidth Memory
      • 1.4.3.2. Unified Shared Memory/L1/Texture Cache
    • 1.4.4. Cooperative Groups
    • 1.4.5. Multi-Process Service
    • 1.4.6. NVLink Interconnect
• 2. Revision History
• 3. Notices
  • 3.1. Notice
  • 3.2. OpenCL
  • 3.3. Trademarks