NVIDIA Maxine Video Effects (VFX) SDK User Guide#

NVIDIA® Video Effects SDK (VFX SDK) is used to apply effect filters to videos. The SDK is powered by NVIDIA GPUs with Tensor Cores. With Tensor Cores, the algorithm throughput is greatly accelerated and latency is reduced.

The SDK provides the following filters:

  • AI Green Screen (video background segmentation), which segments and masks the background areas in a video or image.

  • Background Blur, which uses the segmentation mask from the AI Green Screen filter (or other sources) and produces a blur effect in the background of a video or an image.

  • Super Resolution, which upscales a video. This filter enhances the details, sharpens the output, and preserves the content.

  • Upscale, which is a fast and lightweight method to upscale an input video and sharpen the resulting output.

  • Webcam Denoising, which removes noise from a webcam video while preserving the texture details.

  • Video Relighting, which reilluminates a person in a video to match the target lighting condition. This effect uses a 360°×180° HDRI image to provide environmental lighting.