Audio

The Audio GEMs in the Isaac SDK provide a collection of GPU-accelerated features that enable audio intelligibility in applications. The following sections explain the supported features in detail and their usage through sample applications.

Contents

• Audio Capture
  
  • Configuration Parameters
  • Messages
  • Sample Application
• Audio Playback
  
  • Messages
  • Sample Application
• Audio Energy Calculation
  
  • Configuration Parameters
  • Messages
  • Sight Variables
  • Sample Application
• Sound Source Localization
  
  • Configuration Parameters
  • Messages
  • Sight Variables
  • Sample Application
• Text To Speech
  
  • Text To Mel
  • WaveGlow Vocoder (Torch Inference)
  • Tensor To Audio Decoder
  • The text_to_speech Sample Application
• Voice Command Detection
  
  • Voice Command Feature Extraction
  • Voice Command Construction
  • Sight Variables
  • Sample Application
  • Creating Your Own Application
• Voice Command Training
  
  • Dataset Collection
  • Data Pre-processing
  • Model Training
  • Training Process
  • Model and Metadata