Support Matrix#

Models#

Model Name

Model ID

Publisher

mark

mark_v2.3

NVIDIA

claire

claire_v2.3

NVIDIA

james

james_v2.3

NVIDIA

Optimized configurations#

GPU

GPU Memory (GB)

Precision

A10G

24

FP16

L40S

48

FP16

A100

15

FP16

H100

80

FP16

RTX6000

48

FP16

RTX4090

24

FP16

Audio2Face-3D does not have multi GPU support. If you want to use more GPUs, you will have to start multiple instances of Audio2Face-3D for each GPU and manage how requests are routed to each instance.

Non-optimized configurations#

The GPU memory usage is dependend on the number of concurrent connections (number_of_streams) configured when starting up Audio2Face-3D.

Note

This approximation was observed on an RTX 4090 and RTX 3080 Ti, without generating the TRT engines.

GPU

GPU Memory (GB)

Precision

Any NVIDIA GPU with sufficient GPU memory and compute capability

0.15 * number_of_streams + 9

FP16

Software#

Operating System

Ubuntu 22.04 (bare-metal or with WSL)

NVIDIA CUDA

12.6

NVIDIA Driver

535.183.06 (for Data Center GPUs), 560.35.03 (for RTX GPUs) and 560.94 (for Windows WSL)

NVIDIA Container Toolkit

latest version

Docker

latest version

  • Any Linux distribution should work but has not been tested by our teams

  • Your Docker environment must support NVIDIA GPUs. Please refer to the NVIDIA Container Toolkit for more information.