Support Matrix#
Models#
Model Name |
Model ID |
Publisher |
---|---|---|
mark |
mark_v2.3 |
NVIDIA |
claire |
claire_v2.3 |
NVIDIA |
james |
james_v2.3 |
NVIDIA |
Optimized configurations#
GPU |
GPU Memory (GB) |
Precision |
---|---|---|
A10G |
24 |
FP16 |
L40S |
48 |
FP16 |
A100 |
15 |
FP16 |
H100 |
80 |
FP16 |
RTX6000 |
48 |
FP16 |
RTX4090 |
24 |
FP16 |
Audio2Face-3D does not have multi GPU support. If you want to use more GPUs, you will have to start multiple instances of Audio2Face-3D for each GPU and manage how requests are routed to each instance.
Non-optimized configurations#
The GPU memory usage is dependend on the number of concurrent connections (number_of_streams) configured when starting up Audio2Face-3D.
Note
This approximation was observed on an RTX 4090 and RTX 3080 Ti, without generating the TRT engines.
GPU |
GPU Memory (GB) |
Precision |
---|---|---|
Any NVIDIA GPU with sufficient GPU memory and compute capability |
0.15 * number_of_streams + 9 |
FP16 |
Software#
Operating System |
Ubuntu 22.04 (bare-metal or with WSL) |
NVIDIA CUDA |
12.6 |
NVIDIA Driver |
535.183.06 (for Data Center GPUs), 560.35.03 (for RTX GPUs) and 560.94 (for Windows WSL) |
NVIDIA Container Toolkit |
latest version |
Docker |
latest version |
Any Linux distribution should work but has not been tested by our teams
Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.