Overview#
What is Maya-ACE#
Maya-ACE is a reference implementation designed as a client for the ACE Audio2Face service, which leverages NVIDIA’s cutting-edge Digital Human Technology to generate high-quality, audio-driven facial animation. With Maya-ACE, users can effortlessly access and utilize the Audio2Face service through a simple, streamlined interface, or dive into the source code to develop their own custom clients.
This repository includes a Maya plugin, gRPC client libraries, test assets, and a sample scene—everything you need to explore, learn, and innovate with the ACE Audio2Face service. Whether you’re looking to integrate this technology into your own projects or simply experiment with its capabilities, Maya-ACE provides a robust foundation.
The project is released under the MIT license, granting you freedom to use and modify the code, with the responsibility to ensure its appropriate use. Please note that NVIDIA assumes no liability for any issues arising from the use of this software.
The ACE Audio2Face service is accessible through NVIDIA NIM , and all the information for the service can be found from the Document Portal.
What Can Be Done#
Send Audio, Receive Animation#
Maya-ACE allows users to send audio inputs and receive corresponding facial animations. These animations can be directly connected to a blendshape node, enabling you to animate any character in Maya seamlessly.
Learning with User-Friendly Interface#
Maya-ACE provides all the necessary functionalities through a straightforward UI. It serves as an excellent tool for learning and experiencing the ACE Audio2Face service, helping users gain a deeper understanding of how it works.
Seamless Transition to Unreal Engine and Tokkio#
For those looking to expand their workflow, users can elevate their projects by transitioning to the Kairos Unreal Engine integration or Tokkio: an interactive avatar virtual customer service assistant product SDK. This allows for the continued use of Audio2Face within other platforms, sharing the same parameters from Maya-ACE for a consistent experience.
Integration with Standard Maya Nodes#
Maya-ACE is designed to work seamlessly with standard Maya nodes, including the blendshape node, making it adaptable to drive any character in your scene.
Customizable and Extendable#
The source code and scripts provided with Maya-ACE can be modified to create a custom pipeline within Maya or to develop a client for other platforms, giving users the flexibility to tailor the tool to their specific needs.