Getting Started

• Overview
• Quick Start Guide
• NVIDIA AI Enterprise Trial
• Release Notes
• Support Matrix

Installation

• Best Practices
  • Security
  • Autoscaling Configurations
  • Monitoring GPU and CPU Telemetry
  • Load-Balancing Types
  • Optimizing Resource Usage for Embedded Platforms
• Local (Docker)
  • Configuring
  • Downloading Required Models and Containers from NGC
  • Launching the Servers and Client Container
  • Stopping
  • Clean-up
• Kubernetes
  • Installation with Helm
  • Kubernetes Secrets
  • Riva Settings
  • Deploying Custom RMIR Models with Helm
  • Enabling Model Cache for Scalable Deployment
  • Ingress Controller

Tutorials

• Speech Recognition
• Speech Recognition - New Language Adaptation
• Cloud Deployment
• Speech Synthesis
• Translation

Architecture

• Overview
  • Using Your Own Data
  • Model Development with NeMo
  • Riva Build
  • Riva Deploy
  • Deploying Your Custom Model into Riva
  • Build Process
  • Deploy Process
• Clients in a New Programming Language
  • Download the Riva API
  • Generate Language Bindings
  • Write the Client

Speech Recognition

• ASR Overview
  • Try It Out
  • Pretrained ASR Models
  • Language and Model Support
  • Features
  • Checking deployed models
• Basics of Speech Recognition and Customization of Riva ASR
• Basics of Automatic Speech Recognition
  • Speech Recognition by Humans
  • Speech Recognition by Machines
• Evaluation of ASR Accuracy
• Riva ASR
  • The Alignment Problem
  • The Greedy Search Decoder
  • The Beam Search Decoder
• Riva Speech Recognition Pipeline
  • Summary of Riva ASR Customizations
  • Basic Customization of Riva ASR
  • Advanced Customization of Riva ASR
  • WFST Decoding
• Building and Deploying ASR Pipelines
  • Understanding riva-build
  • Building ASR Pipelines: Practical Examples
  • Streaming/Offline Recognition
  • Language Models
  • Flashlight Decoder Lexicon
  • Flashlight Decoder Lexicon Free
  • OpenSeq2Seq Decoder
  • Beginning/End of Utterance Detection
  • Streaming Speaker Diarization
  • Neural-Based Voice Activity Detection
  • Generating Multiple Transcript Hypotheses
  • Impact of Chunk Size and Padding Size on Performance and Accuracy (Advanced)
  • Sharing Acoustic and Feature Extractor Models Across Multiple ASR Pipelines (Advanced)
  • Riva-build Optional Parameters
  • Riva Deploy
• Performance
  • Evaluation Process
  • Results
  • On-Prem Hardware Specifications
  • Model Accuracy
• ASR Advanced Details
  • Confidence Estimates

Speech Synthesis

• TTS Overview
  • Try It Out
  • Pretrained TTS Models
• Features
  • Language and Model Support
  • Zero Shot TTS (Beta Feature)
  • SSML input
  • Emotion mixing (Beta feature)
  • Custom pronunciation dictionary
  • Checking deployed models
  • Output Audio Encoding
• TTS Zero Shot
  • OOTB Voices
  • Setting up the TTS Python API parameters
  • Understanding TTS Python API parameters
  • Make a gRPC request to the Riva server
  • Binary Client Example
• Speaker Adapter for Custom Voice
  • Download the Models
  • Fine-Tune the Existing Model
  • Generate the Riva Checkpoint
  • Generate RMIR
  • Conclusion
• Custom Models
  • Model Deployment
  • Creating Riva Files
  • Customization
  • Riva-build Pipeline Instructions
• Performance
  • Evaluation Process
  • Results
  • On-Prem Hardware Specifications
  • Performance Considerations
  • Model Accuracy
• Phoneme Support
  • English-US
• Data Collection - Script Generation
  • Identifying Data Sources:
  • Phoneme Coverage and Distribution
  • Technical Requirements
  • Heuristics for Manually Normalizing
  • Conclusion

Natural Language Processing

• NLP Overview
  • Punctuation and captilization
  • Checking deployed models
• Custom Models
  • Pretrained Models

Translation

• Translation Overview
  • Language Pairs Supported
  • Translation Features
  • Speech-to-Speech Translation (S2S)
  • Speech-to-Text Translation (S2T)
  • Model Deployment
  • Multiple Deployed Models
  • Punctuation and Inverse Text Normalization (ITN) with S2S and S2T
• Custom Models
  • Example
  • Supported Models
• Performance
  • Evaluation Process
  • Results
  • Hardware Specifications
  • Model Accuracy

SDKs and Sample Apps

• Python
  • Installation
  • Python Example
• Command-line Clients
  • Speech Recognition
  • Natural Language Processing
  • Speech Synthesis
  • Machine Translation
  • Speech-to-Speech Translation
  • Speech-to-Text Translation
• Sample Apps
  • SpeechSquad
  • AudioCodes VoiceGateway Sample

Reference

• Models
  • Speech Recognition
  • Natural Language Processing
  • Natural Machine Translation(NMT)
  • Speech Synthesis
• gRPC & Protocol Buffers
• Troubleshooting
  • NGC
  • Model Export and ServiceMaker
  • Services
  • Client Integration
  • Riva Helm Deployment
  • SpeechSquad
• Upgrading
• Acknowledgements
  • Google APIs
  • GoogleTest
  • gflags
  • Google Logging Library (glog)
  • speexdsp
  • libFLAC
  • gRPC
  • Triton Inference Server
  • NVlabs cub
  • KenLM
  • Kaldi
  • grpc_health_probe
  • OpenFST
  • Yamale
  • PyTorch
  • requests
  • PyCUDA
  • RapidJSON
  • protobuf
  • onnx
  • librosa
  • omegaconf
  • utf8proc
  • re2
  • thrax
  • Sparrowhawk
  • SentencePiece
  • YouTokenToMe
  • MS-SNSD
  • Silero VAD
• End User License Agreement
• Notice
  • Google
  • Trademarks
  • Copyright