Support Matrix
Model Name |
Model ID |
Publisher |
|---|---|---|
| Parakeet CTC Riva 1.1b | parakeet-ctc-riva-1-1b | NVIDIA |
GPU |
GPU Memory (GB) |
Precision |
# of GPUs |
|---|---|---|---|
| H100 | 15 | FP16 | 1 |
| A100 | 15 | FP16 | 1 |
| L40 | 15 | FP16 | 1 |
GPU |
GPU Memory (GB) |
Precision |
# of GPUs |
|---|---|---|---|
| Any NVIDIA GPU with sufficient GPU memory and compute capability > 7.0 | 23 | FP16 | 1 |
NVIDIA Driver
Release 1.0.0 uses Triton Inference Server 23.11. Please refer to the Release Notes for Triton on NVIDIA driver support, including the CUDA and TensorRT versions used within the docker container.
NVIDIA Container Toolkit
Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.