Is this page helpful?

NVIDIA Video Effects (VFX) SDK User Guide#

The NVIDIA Video Effects SDK (VFX SDK) is a comprehensive collection of AI-powered video effects for real-time video enhancement and processing.

The VFX SDK enables developers to build state-of-the-art video processing applications with AI-powered features, such as video relighting, video super resolution, and AI green screen. The SDK is powered by NVIDIA graphics processing units (GPUs) with Tensor Cores, supporting high throughput and low latency processing.

The VFX SDK has the following features:

  • AI Green Screen (video background segmentation), which segments and masks the background areas in a video or image.

  • Background Blur, which uses the segmentation mask from the AI Green Screen filter (or other sources) and produces a blur effect in the background of a video or an image.

  • Upscale, which is a fast and lightweight method to upscale an input video and sharpen the resulting output.

  • Webcam Denoising, which removes noise from a webcam video while preserving the texture details.

  • Video Relighting, which reilluminates a person in a video to match the target lighting condition. This effect uses a 360°×180° HDRI image to provide environmental lighting.

  • Video Super Resolution, which enhances video resolution by upscaling low-resolution content to higher resolutions. This feature uses deep learning to intelligently add detail and improve visual quality beyond traditional upscaling methods.