NVIDIA Maxine Video Effects (VFX) SDK User Guide#

NVIDIA® Video Effects SDK (VFX SDK) is used to apply effect filters to videos. The SDK is powered by NVIDIA GPUs with Tensor Cores. With Tensor Cores, the algorithm throughput is greatly accelerated and latency is reduced.

The SDK provides the following filters:

  • AI Green Screen (video background segmentation), which segments and masks the background areas in a video or image.

  • Background Blur, which uses the segmentation mask from the AI Green Screen filter (or other sources) and produces a blur effect in the background of a video or an image.

  • Encoder Artifact Reduction, which reduces the blocking and noisy artifacts that are produced from encoding while preserving the details of the original video.

    The Artifact Reduction effect has the following modes:

    • Mode 0, which applies a weak effect.

    • Mode 1, which applies a strong effect.

  • Super Resolution, which upscales a video and reduces encoding artifacts. This filter enhances the details, sharpens the output, and preserves the content. The Super Resolution effect has two modes:

    • Mode 1, which applies strong enhancements.

    • Mode 0, which applies weaker enhancements while reducing encoding artifacts.

  • Upscale, which is a fast and lightweight method to upscale an input video and sharpen the resulting output. This filter can optionally be pipelined with Encoder Artifact Reduction to enhance the scale while reducing the video artifacts.

  • Webcam Denoising, which removes noise from a webcam video while preserving the texture details. This effect has the following modes:

    • Strength 0, which applies a weak effect.

    • Strength 1, which applies a strong effect.

  • Video Relighting, which reilluminates a person in a video to match the target lighting condition. This effect uses a 360°×180° HDRI image to provide environmental lighting.