NVIDIA RTX vWS: Sizing and GPU Selection Guide for Virtualized Workloads

Sizing Guide

• Overview
  
  • What is NVIDIA RTX vWS?
  • Why NVIDIA vGPU?
  • NVIDIA vGPU Architecture
• Recommended NVIDIA GPUs for NVIDIA RTX vWS
  
  • vGPU Profile Selection Considerations
• Selecting the Right NVIDIA GPU for Virtualization
  
  • NVIDIA GPUs for Virtualization
    
    • NVIDIA RTX PRO 6000 Blackwell Server Edition
      
      • MIG-Backed vGPU Support
    • NVIDIA L40S
    • NVIDIA L40
    • NVIDIA L4
    • NVIDIA A40
    • NVIDIA A16
    • NVIDIA A10
  • GPU Performance Benchmark Tests
  • Professional Graphics
    
    • Test Results
    • Benchmark Server Configuration
• Selecting the Right NVIDIA GPU Virtualization Software
  
  • Summary of Product Features
  • Product Details
    
    • NVIDIA RTX Virtual Workstation
    • NVIDIA Virtual PC
  • Impact of GPU Sharing
    
    • Time-Sliced vGPU Sharing
      
      • Scheduling Options for GPU Sharing
    • MIG-Backed vGPU Sharing
      
      • Performance Allocation
    • Effect of GPU Sharing on Overall Throughput
• Sizing Methodology
  
  • vGPU Profiles
    
    • Example Homogeneous vGPU Configurations for NVIDIA L40S
    • Example Heterogeneous vGPU Configurations for NVIDIA L40S
• Tools
  
  • GPU Profiler
  • NVIDIA System Management Interface (nvidia-smi)
  • VMware esxtop
  • VMware Aria Operations
  • AI vWS Sizing Advisor
• Performance Metrics
  
  • Virtual Machine Metrics
    
    • Framebuffer Usage
    • vCPU Usage
    • Video Encode/Decode
  • Physical Host Metrics
    
    • CPU Core Utilization
    • GPU Utilization
  • AI vWS Workloads
• Performance Analysis
  
  • Single VM Testing FB Analysis
  • Host Utilization Analysis
• Example VDI Deployment Configurations
• Deployment Best Practices
  
  • Understand Your Environment
  • Run a Proof of Concept
  • Leverage Management and Monitoring Tools
  • Understand Your Users & Applications
  • Use Benchmark Testing
  • Understanding the GPU Scheduler
  • Understanding GPU Channels
    
    • Monitoring GPU Channel Usage During POC
• Conclusion
  
  • Process for Success
  • Virtualize Any Workstation with an Amazing User Experience

Appendix

• Additional Resources
  
  • NVIDIA vPC Resources
  • NVIDIA RTX Virtual Workstation Resources
  • Other Resources
• Support and Services