Toggle navigation

Contents

Getting Started

• Overview
• Quick Start Guide
• Riva Enterprise
• Release Notes

Tutorials

• How do I use Riva ASR APIs with out-of-the-box models?
  • NVIDIA Riva Overview
  • Transcription with Riva ASR APIs
    • Requirements and setup
    • Import the Riva client libraries
    • Create a Riva client and connect to the Riva Speech API server
    • Offline recognition for English
    • Offline recognition for non-English languages - Spanish example
  • Go deeper into Riva capabilities
    • Additional Riva tutorials
    • Sample applications
    • Riva Text-To-Speech (TTS)
    • Additional resources
• How do I boost specific words at runtime with word boosting?
  • NVIDIA Riva Overview
  • Word boosting with Riva ASR APIs
    • Requirements and setup
    • Import the Riva client libraries
    • Create a Riva client and connect to the Riva Speech API server
    • ASR inference without word boosting
    • ASR inference with word boosting
    • Boosting different words at different levels
    • Negative word boosting for undesired words
  • Go deeper into Riva capabilities
    • Additional Riva tutorials
    • Sample applications
    • Riva Text-To-Speech (TTS)
    • Additional resources
• How to Customize Riva ASR Vocabulary and Pronunciation with Lexicon Mapping
  • Overview
    • Pre requisite
    • Terminologies
  • What can be customized?
  • Extending the vocabulary
    • How to modify vocabulary file
  • Customizing pronunciation with lexicon mapping
    • How to modify the lexicon file
    • How to generate the correct tokenized form
  • Go deeper into Riva capabilities
    • Additional Riva tutorials
    • Sample applications
    • Riva Text-To-Speech (TTS)
    • Additional resources
• How to Improve Recognition of Specific Words
  • Overview of Riva customization techniques
  • 1. Word boosting
  • 2. Custom vocabulary
  • 3. Custom pronunciation (Lexicon mapping)
  • 4. Retrain language model
  • 5. Fine tune the acoustic model
    • Low-resource domain adaptation
    • Data quality and augmentation
    • Train models from scratch
• Conclusion
• How do I use Riva TTS APIs with out-of-the-box models?
  • NVIDIA Riva Overview
  • Speech generation with Riva TTS APIs
    • Requirements and setup
    • Import Riva clent libraries
    • Create Riva clients and connect to Riva Speech API server
    • Batch mode TTS
    • Understanding TTS API parameters
  • Go deeper into Riva capabilities
    • Additional Riva tutorials
    • Sample applications
    • Riva Automated Speech Recognition (ASR)
    • Additional resources
• How do I customize Riva TTS audio output with SSML?
  • NVIDIA Riva Overview
  • Customizing Riva TTS audio output with SSML
    • Requirements and setup
    • Import Riva Client Libraries
    • Create Riva Clients and connect to the Riva Speech API server
    • Customizing rate and pitch with the prosody tag
    • Customizing pronunciation with the phenome tag
  • Go deeper into Riva capabilities
    • Additional Riva tutorials
    • Sample applications
    • Riva Automated Speech Recognition (ASR)
    • Additional resources
• The Making of the Riva Mandarin ASR Service
  • Overview
  • 1. Data collection
  • 2. Data preparation
    • 2.1. Data preprocessing
    • 2.2. Data cleaning/filtering
    • 2.3. Train and Test splitting
  • 3. Training and validation
    • 3.1. Acoustic model
    • 3.2. Language model
    • 3.3. Punctuation model
  • 4. Riva deployment
    • Bring your own Mandarin models
    • Riva pretrained Mandarin models on NGC
• Conclusion
• The Making of RIVA Hindi ASR Service
  • Overview
  • 1. Data collection
  • 2. Data preparation
    • 2.1. Data preprocessing
    • 2.2. Data cleaning and filtering
    • 2.3. Train and Test splitting
    • 2.4. Tarring
  • 3. Training and validation
    • 3.1. Acoustic model
    • 3.2. Language model
    • 3.3. Punctuation and Capitalization model
  • 4. Model Testing
  • 5. Riva Deployment
    • Bring your own Hindi models
    • Riva pretrained Hindi models on NGC
  • Conclusion
• The Making of RIVA German ASR Service
  • Overview
  • 1. Data collection
  • 2. Data preparation
    • 2.1. Data preprocessing
    • 2.2. Data cleaning/filtering
    • 2.3. Binning
    • 2.4. Train and Test splitting
    • 2.5. Tarring
  • 3. Training and validation
    • 3.1. Acoustic model
    • 3.2. Language model
    • 3.3. Punctuation and capitalization model
    • 3.4. Inverse text normalization model
  • 4. Riva deployment
    • BYO German models
    • Riva pretrained German models on NGC
• Conclusion

Architecture

• Overview
  • Using Your Own Data
  • Model Development with TAO Toolkit
  • Model Development with NeMo
  • Riva Build
  • Riva Deploy
  • Deploying Your Custom Model into Riva
  • Build Process
  • Deploy Process
• Clients in a New Programming Language
  • Download Riva Skills API
  • Generate Language Bindings
  • Write the Client

Speech Recognition

• ASR Overview
  • Try It Out
  • Language Support
  • Features
• Custom Recognition
  • Training or Fine-Tuning an Acoustic Model
  • Inverse Text Normalization
  • Word Boosting
  • Pipeline Configuration
  • Training Language Models
• Performance
  • Evaluation Process
  • Results
  • Hardware Specifications

Speech Synthesis

• TTS Overview
  • Try It Out
  • Voices
• Controllable TTS (SSML)
  • Prosody
  • Phoneme
  • Try It Now
• Custom Models
  • Model Deployment
  • Creating Riva Files
  • Custom Pronunciations
  • Multispeaker Models
  • Custom Voice
  • Pretrained Models
  • Pipeline Configuration
  • Pretrained Quick Start Pipelines
• Performance
  • Evaluation Process
  • Results
  • Hardware Specifications
  • Performance Considerations

Natural Language Processing

• NLP Overview
• Custom Models
  • Pretrained Models

Installation

• Best Practices
  • Security
  • Autoscaling Configurations
  • Monitoring GPU and CPU Telemetry
  • Load-Balancing Types
  • Optimizing Resource Usage for Embedded Platforms
• Local (Docker)
  • Configuring
  • Downloading Required Models and Containers from NGC
  • Launching the Servers and Client Container
  • Stopping
  • Clean-up
• Kubernetes
  • Installation with Helm
  • Kubernetes Secrets
  • Riva Settings
  • Ingress Controller
  • Load Balancer
  • Autoscaling Configurations
  • gRPC Streams with SSL/TLS
  • Monitoring GPU and CPU Telemetry
  • Load-Balancing Types
• How to Deploy Riva at Scale on AWS with EKS
  • Prerequisites
  • Creating the EKS Cluster
  • Deploying the Riva API
  • Deploying the Traefik edge router
  • Creating the IngressRoute
  • Deploying a Sample Client
  • Scaling the cluster
• NVIDIA Fleet Command
  • Application Setup
  • Deployment Setup

SDKs and Sample Apps

• Python
  • Installation
  • Install the Python Wheel
  • Python Example
• Command-line Clients
  • Speech Recognition
  • Natural Language Processing
  • Speech Synthesis
• Sample Apps
  • Riva Contact
  • Riva Virtual Assistant Example
  • Virtual Assistant (with Rasa)
  • Virtual Assistant (with Google Dialogflow)
  • SpeechSquad
  • AudioCodes VoiceGateway Sample

Reference

• Models
  • Speech Recognition
  • Natural Language Processing
  • Speech Synthesis
• gRPC & Protocol Buffers
  • riva/proto/riva_asr.proto
  • riva/proto/riva_nlp.proto
  • riva/proto/riva_tts.proto
  • riva/proto/riva_audio.proto
  • riva/proto/health.proto
• Troubleshooting
  • NGC
  • Model Export and ServiceMaker
  • Services
  • Client Integration
  • Riva Helm Deployment
  • SpeechSquad
• Support Matrix
  • Riva Speech Skills 2.2.0
  • Riva Speech Skills 2.1.0
  • Riva Speech Skills 2.0.0
  • Riva Speech Skills 1.10.0 Beta
  • Riva Speech Skills 1.9.0 Beta
  • Riva Speech Skills 1.8.0 Beta
  • Riva Speech Skills 1.7.0 Beta
  • Riva Speech Skills 1.6.0 Beta
  • Riva Speech Skills 1.5.0 Beta
  • Riva Speech Skills 1.4.0 Beta
• Archives
• Upgrading
• Acknowledgements
  • Google APIs
  • GoogleTest
  • gflags
  • Google Logging Library (glog)
  • speexdsp
  • libFLAC
  • gRPC
  • Triton Inference Server
  • NVlabs cub
  • KenLM
  • Kaldi
  • grpc_health_probe
  • gRPCurl
  • OpenFST
  • Yamale
  • PyTorch
  • requests
  • PyCUDA
  • RapidJSON
  • protobuf
  • onnx
  • librosa
  • omegaconf
  • utf8proc
  • re2
  • thrax
  • Sparrowhawk
  • SentencePiece
  • YouTokenToMe
• Notice
  • Google
  • Trademarks
  • Copyright

next

Overview