Is this page helpful?

NVIDIA Video Effects (VFX) SDK User Guide#

Download this guide as a PDF

The NVIDIA Video Effects SDK (VFX SDK) is a comprehensive collection of AI-powered video effects for real-time video enhancement and processing.

The VFX SDK enables developers to build state-of-the-art video processing applications with AI-powered features, such as video relighting, video super resolution, and AI green screen. The SDK is powered by NVIDIA graphics processing units (GPUs) with Tensor Cores, supporting high throughput and low latency processing.

The VFX SDK has the following features:

  • AI Green Screen (video background segmentation), which segments and masks the background areas in a video or image.

  • Background Blur, which uses the segmentation mask from the AI Green Screen filter (or other sources) and produces a blur effect in the background of a video or an image.

  • Upscale, which is a fast and lightweight method to upscale an input video and sharpen the resulting output.

  • Webcam Denoising, which removes noise from a webcam video while preserving the texture details.

  • Video Relighting, which reilluminates a person in a video to match the target lighting condition. This effect uses a 360°×180° HDRI image to provide environmental lighting.

  • Video Super Resolution, which enhances video resolution by upscaling low-resolution content to higher resolutions. This feature uses deep learning to intelligently add detail and improve visual quality beyond traditional upscaling methods.

  • Video Frame Generation, which synthesizes intermediate frames between consecutive source frames. This feature increases effective frame rates and supports both uniform and application-selected temporal positions.

  • TrueHDR, which converts SDR video content to HDR10 in real time. This feature uses deep learning to expand dynamic range, extend the color gamut, and remove banding artifacts.

Note

The Windows SDK supports x64 systems and Windows on Arm (ARM64) systems with a supported iGPU such as RTX Spark. The Linux SDK is designed and optimized for server-side (datacenter or cloud) deployments.