Overview
Note
The Omniverse Renderer Microservice is released as a developer preview!
RTX Renderer
The microservice wraps the Omniverse RTX real-time renderer that is used to render an avatar scene.
Streaming
The rendered frame is streamed out of the microservice using and inofficial RTP over UDP variant of the Kit livestream extension. The rendered image together with the input audio are streamed as two separate video and audio streams using the RTP over UDP protocol.
Animation Data
The primary function of the Omniverse rendering microservice is the real-time rendering of an avatar pose. This pose is provided through a gRPC interface in the form of Animation Data, while the avatar assets and the surrounding scene are provided as a configuration in Pixar’s USD format. The renderer takes the scene description and the real-time pose data and renders an avatar frame in real-time.
Avatar Customization
This rendering microservice stands as a versatile and powerful tool for real-time rendering, supporting a range of use cases and customization options. Users have the flexibility to create and customize scenes in two distinct ways. Scenes can be effortlessly generated and tailored using the avatar configurator, or for more advanced users, manual scene creation is also supported.
Typical Use Case
Typically, the Animation Graph microservice serves as the source of the Animation Data, while the RTP stream is received by the VST microservice.