GXF extensions - NVIDIA Docs

aja: support AJA capture card as source. It offers support for GPUDirect-RDMA on Quadro GPUs. The output is a VideoBuffer object.

bayer_demosaic: calls to the NVIDIA CUDA based demosaicing algorithm to create RGB planes from Bayer format.

custom_lstm_inference: provide LSTM (Long-Short Term Memory) stateful inference module using TensorRT

emergent: support camera from Emergent Vision Technologies as the source. The datastream from this camera is transferred through Mellanox ConnectX NIC using Rivermax SDK.

format_converter: provide common video or tensor operations in inference pipelines to change datatypes, resize images, reorder channels, and normalize and scale values.

holoviz_viewer: Holoviz is a Vulkan api based visualizer to display video buffer from a tensor. Holoviz viewer provides means to use Holoviz.

opengl: OpenGL Renderer(visualizer) to display a VideoBuffer, leveraging OpenGL/CUDA interop.

probe: print tensor information

segmentation_postprocessor: segmentation model postprocessing converting inference output to highest-probability class index, including support for sigmoid, softmax, and activations.

segmentation_visualizer: OpenGL renderer that combines segmentation output overlayed on video input, using CUDA/OpenGL interop.

stream_playback: provide video stream playback module to output video frames as a Tensor object.

tensor_rt _(duplicate from GXF)_: Run inference with TensorRT

v4l2: Video for Linux 2 source supporting USB cameras and other media inputs. The output is a VideoBuffer object.

visualizer_tool_tracking: custom visualizer component that handles compositing, blending, and visualization of tool labels, tips, and masks given the output tensors of the custom_lstm_inference

mocks: provide mock components such as VideoBufferMock.

sample: provide sample ping_tx/ping_rx components.