NVIDIA ACE#

Important

NVIDIA ACE is a suite of digital human technologies for developers that powers knowledgeable, actionable and conversational characters using generative AI. ACE provides ready-to-integrate cloud and on-device AI models for each aspect of digital humans—from speech to intelligence to animation. The animation components are now open sourced and availability is below:

Tech

Availability

NVIDIA ACE Controller (renamed Voice Agent Examples)

GitHub

Audio2Face-3D SDK

GitHub

Audio2Face-3D / Audio2Emotion Models (v2.3 + 3.0)

Hugging Face

Maya ACE v1.x

GitHub

Audio2Face-3D Training Framework

GitHub

Audio2Face-3D Training Sample Dataset

Hugging Face

Audio2Face-3D Microservices (NIM) v2.0

NGC

ACE Unreal Engine (UE) Plugin 2.5

NVIDIA Developer (UE 5.5 + 5.6)

_images/teaser.jpg

NVIDIA ACE is a suite of real-time AI solutions for end-to-end development of interactive avatars and digital human applications at-scale. Its customizable microservices offer the fastest and most versatile solution for bringing avatars to life at-scale, based on NVIDIA’s Unified Compute Services, full-stack AI platform and RTX technology. Leverage ACE to seamlessly integrate NVIDIA AI into your application, including Riva for speech and translation AI, Voice Font for transferring your voice to a digital avatar, NeMo LLM for natural language understanding, Audio2Emotion, Animation Graph, Omniverse Renderer or A2F-2D or A2F-3D for AI powered 2D and 3D character animation. Or, further optimize for cloud scale with microservices and domain-specific AI workflows like NVIDIA Maxine, NVIDIA Tokkio, Animation Pipeline, and NVIDIA Gaming Avatar, to deliver advanced avatars across video conferencing customer service use cases and gaming.