Integrating Conversational AI Models into Riva

NVIDIA TAO Release tlt.30

While the Transfer Learning Toolkit is an excellent resource to train and finetune models, Riva provides resources to deploy those models into scalable services running on GPUs.

Along with the TLT conversational AI package, we provide the following sample resources on NGC to capture the end to end workflow of training a model with TLT and deploying them to Riva.

Conversational AI Task

Jupyter Notebooks

Speech to Text

Speech to Text Notebook

Speech to Text Citrinet

Speech to Text Citrinet Notebook

Question Answering

Question Answering Notebook

Text Classification

Text Classification Notebook

Token Classification

Token Classification Notebook

Punctuation and Capitalization

Punctuation Capitalization Notebook

Intent and Slot Classification

Intent Slot Classification Notebook

Each sample resouce contain 2 sample notebooks,

  1. To train the respective model using TLT and generate an exported .ejrvs

  2. To use this exported .ejrvs file and deploy it to Riva.

You may find more information about the same in the Riva Documentation.

© Copyright 2020, NVIDIA. Last updated on Jul 28, 2021.