Support Matrix
Models
Relighting uses the following models.
Optimized Configurations
Relighting has optimized configurations for the following server GPUs.
Other Architectures (Consumer and Desktop GPUs)
Relighting also runs on the following consumer and desktop GPUs.
Relighting is compatible with professional, datacenter, and consumer GPUs that have Tensor cores and are based on the NVIDIA Blackwell, Ada, or Ampere architecture. The GPU must have NVENC. The NIM encodes its output on the GPU’s video encoder, so a GPU without NVENC, such as the A100, is not supported. The GPU needs more than 17 GB of memory, because the NIM uses about 17 GB after its models are loaded. Refer to GPU Memory for the figures.
Relighting requires NVENC/NVDEC hardware for video encoding/decoding. For details about supported GPUs and H264 YUV formats, refer to the Video Encode and Decode Support Matrix.
GPU Memory
The NIM uses about 17 GB of GPU memory once its models are loaded and it has served its first request. Each request adds about 0.3 GB for 1080p input and about 0.7 GB for 4K input, the same with eight concurrent requests. On a GPU with 24 GB of memory, two concurrent 4K requests complete with every frame: in NVIDIA internal benchmark runs on the 4K clip of Performance Results, each request ran at 14.7 fps on the A10G and 11.6 fps on the L4. More than two concurrent 4K requests were not benchmarked on these GPUs (refer to Multiple Concurrent Inputs).
On the RTX 6000 Ada Generation GPU used for these measurements, eight concurrent requests peaked at about 19.4 GB in total for 1080p input and 22.6 GB for 4K input. The figures come from the sample video (1080p) and a 4K H.264 clip, on a freshly started NIM, as the peak nvidia-smi memory use during the requests minus the use with the NIM idle after its first request, sampled every 100 ms, in GB (1 GB = 10^9 bytes). They vary slightly by GPU architecture and by input clip.
Host Resource Requirements
Approximate figures for planning, measured with one request at a time on a host with an RTX 6000 Ada Generation GPU and 12 CPU threads, as docker stats reports the container’s memory use (MEM USAGE) and CPU. docker stats shows memory in GiB. The following figures are approximate and are for planning (1 GB = 10^9 bytes). Concurrent requests use more host memory and CPU.
Input Media
Relighting accepts the following input media.
Software
The Relighting NIM requires the following host software, NVIDIA platform components, and disk and memory resources.
NVIDIA Driver and Prerequisites
NVIDIA driver requirements and other prerequisites for Relighting. The NIM runs on Linux x86-64 (amd64) hosts.
Relighting uses the following NVIDIA software platforms: