Audio2Face-3D Tuning Visual Studio Code Extension - Experimental#

The Audio2Face-3D Tuning Tool is a Visual Studio Code extension designed for configuring Audio2Face-3D (A2F-3D) NIM stylization parameters. It allows users to interactively tune emotion, blendshape parameters and change the AI model used. This extension uses a tuning workflow that relies on the experimental Tuning API.

For accessing, managaing and updating the parameters, you need to use the ACE Configurator Visual Studio Code extension.

Key Capabilities#

  • Custom editor for stylization_config.yaml configuration file

  • Interactive parameter tuning for emotion, Audio2Face-3D, and blendshape parameters

  • Swap between different AI models

  • Playback controls for audio and animation

Requirements#

The Audio2Face-3D Tuning Tool requires the following:

  • Access to a deployment with the following components:

    • Audio2Face-3D NIM

    • A microservice that implements the Tuning API

    • ACE Configurator microservice

  • A local installation of the ACE Configurator Visual Studio Code extension.

  • A local installation of the Audio2Face-3D Tuning Tool Visual Studio Code extension.

Non-Goals & Limitations#

The Audio2Face-3D Tuning Tool is an experimental tool and has the following limitations:

  • The Tuning API is experimental and subject to change.

  • It is meant to be used for development purposes and not in a production environment.

On this page