GXF extensions

See the User Guide for details regarding the extensions in GXF and Holoscan SDK, and for instructions to build your own extensions

• aja: support AJA capture card as source. It offers support for GPUDirect-RDMA on Quadro GPUs. The output is a VideoBuffer object.

• bayer_demosaic: calls to the NVIDIA CUDA based demosaicing algorithm to create RGB planes from Bayer format.

• custom_lstm_inference: provide LSTM (Long-Short Term Memory) stateful inference module using TensorRT

• emergent: support camera from Emergent Vision Technologies as the source. The datastream from this camera is transferred through Mellanox ConnectX NIC using Rivermax SDK.

• format_converter: provide common video or tensor operations in inference pipelines to change datatypes, resize images, reorder channels, and normalize and scale values.

• holoviz_viewer: Holoviz is a Vulkan api based visualizer to display video buffer from a tensor. Holoviz viewer provides means to use Holoviz.

• opengl: OpenGL Renderer(visualizer) to display a VideoBuffer, leveraging OpenGL/CUDA interop.

• probe: print tensor information

• segmentation_postprocessor: segmentation model postprocessing converting inference output to highest-probability class index, including support for sigmoid, softmax, and activations.

• segmentation_visualizer: OpenGL renderer that combines segmentation output overlayed on video input, using CUDA/OpenGL interop.

• stream_playback: provide video stream playback module to output video frames as a Tensor object.

• tensor_rt _(duplicate from GXF)_: Run inference with TensorRT

• v4l2: Video for Linux 2 source supporting USB cameras and other media inputs. The output is a VideoBuffer object.

• visualizer_tool_tracking: custom visualizer component that handles compositing, blending, and visualization of tool labels, tips, and masks given the output tensors of the custom_lstm_inference

• mocks: provide mock components such as VideoBufferMock.

• sample: provide sample ping_tx/ping_rx components.