GXF extensions

See the User Guide for details regarding the extensions in GXF and Holoscan SDK, and for instructions to build your own extensions

• aja: support AJA capture card as source. It offers support for GPUDirect-RDMA on Quadro GPUs. The output is a VideoBuffer object.

• custom_lstm_inference: provide LSTM (Long-Short Term Memory) stateful inference module using TensorRT

• format_converter: provide common video or tensor operations in inference pipelines to change datatypes, resize images, reorder channels, and normalize and scale values.

• opengl: OpenGL Renderer(visualizer) to display a VideoBuffer, leveraging OpenGL/CUDA interop.

• probe: print tensor information

• segmentation_postprocessor: segmentation model postprocessing converting inference output to highest-probability class index, including support for sigmoid, softmax, and activations.

• segmentation_visualizer: OpenGL renderer that combines segmentation output overlayed on video input, using CUDA/OpenGL interop.

• stream_playback: provide video stream playback module to output video frames as a Tensor object.

• tensor_rt _(duplicate from GXF)_: Run inference with TensorRT

• v4l2: Video for Linux 2 source supporting USB cameras and other media inputs. The output is a VideoBuffer object.

• visualizer_tool_tracking: custom visualizer component that handles compositing, blending, and visualization of tool labels, tips, and masks given the output tensors of the custom_lstm_inference