Appendix#

Component

Interacts With

Integration Type

Riva SDK

Speech recognition, synthesis, and NLP inference APIs

Speech SDK

DALI

GPU-accelerated data loading and preprocessing for deep learning pipelines

Data Processing

Triton Inference Server

Multi-framework model serving supporting TensorRT, PyTorch, ONNX, OpenVINO, Python, RAPIDS FIL, and more

Inference Serving Software