Clara Holoscan v0.2.0
1.0

MultimediaExtension

Extension for multimedia related data types, interfaces and components in GXF Core.

  • UUID: 6f2d1afc-1057-481a-9da6-a5f61fed178e

  • Version: 2.0.0

  • Author: NVIDIA

nvidia::gxf::AudioBuffer

AudioBuffer is similar to Tensor component in the standard extension and holds memory and metadata corresponding to an audio buffer.

  • Component ID: a914cac6-5f19-449d-9ade-8c5cdcebe7c3

AudioBufferInfo structure captures the following metadata:

Field

Description

channels

Number of channels in an audio frame

samples

Number of samples in an audio frame

sampling_rate

sampling rate in Hz

bytes_per_sample

Number of bytes required per sample

audio_format

AudioFormat of an audio frame

audio_layout

AudioLayout of an audio frame

Supported AudioFormat types:

AudioFormat

Description

GXF_AUDIO_FORMAT_S16LE

16-bit signed PCM audio

GXF_AUDIO_FORMAT_F32LE

32-bit floating-point audio

Supported AudioLayout types:

AudioLayout

Description

GXF_AUDIO_LAYOUT_INTERLEAVED

Data from all the channels to be interleaved - LRLRLR

GXF_AUDIO_LAYOUT_NON_INTERLEAVED

Data from all the channels not to be interleaved - LLLRRR

nvidia::gxf::VideoBuffer

VideoBuffer is similar to Tensor component in the standard extension and holds memory and metadata corresponding to a video buffer.

  • Component ID: 16ad58c8-b463-422c-b097-61a9acc5050e

VideoBufferInfo structure captures the following metadata:

Field

Description

width

width of a video frame

height

height of a video frame

color_format

VideoFormat of a video frame

color_planes

ColorPlane(s) associated with the VideoFormat

surface_layout

SurfaceLayout of the video frame

Supported VideoFormat types:

VideoFormat

Description

GXF_VIDEO_FORMAT_YUV420

BT.601 multi planar 4:2:0 YUV

GXF_VIDEO_FORMAT_YUV420_ER

BT.601 multi planar 4:2:0 YUV ER

GXF_VIDEO_FORMAT_YUV420_709

BT.709 multi planar 4:2:0 YUV

GXF_VIDEO_FORMAT_YUV420_709_ER

BT.709 multi planar 4:2:0 YUV ER

GXF_VIDEO_FORMAT_NV12

BT.601 multi planar 4:2:0 YUV with interleaved UV

GXF_VIDEO_FORMAT_NV12_ER

BT.601 multi planar 4:2:0 YUV ER with interleaved UV

GXF_VIDEO_FORMAT_NV12_709

BT.709 multi planar 4:2:0 YUV with interleaved UV

GXF_VIDEO_FORMAT_NV12_709_ER

BT.709 multi planar 4:2:0 YUV ER with interleaved UV

GXF_VIDEO_FORMAT_RGBA

RGBA-8-8-8-8 single plane

GXF_VIDEO_FORMAT_BGRA

BGRA-8-8-8-8 single plane

GXF_VIDEO_FORMAT_ARGB

ARGB-8-8-8-8 single plane

GXF_VIDEO_FORMAT_ABGR

ABGR-8-8-8-8 single plane

GXF_VIDEO_FORMAT_RGBX

RGBX-8-8-8-8 single plane

GXF_VIDEO_FORMAT_BGRX

BGRX-8-8-8-8 single plane

GXF_VIDEO_FORMAT_XRGB

XRGB-8-8-8-8 single plane

GXF_VIDEO_FORMAT_XBGR

XBGR-8-8-8-8 single plane

GXF_VIDEO_FORMAT_RGB

RGB-8-8-8 single plane

GXF_VIDEO_FORMAT_BGR

BGR-8-8-8 single plane

GXF_VIDEO_FORMAT_R8_G8_B8

RGB - unsigned 8 bit multiplanar

GXF_VIDEO_FORMAT_B8_G8_R8

BGR - unsigned 8 bit multiplanar

GXF_VIDEO_FORMAT_GRAY

8 bit GRAY scale single plane

Supported SurfaceLayout types:

SurfaceLayout

Description

GXF_SURFACE_LAYOUT_PITCH_LINEAR

pitch linear surface memory

GXF_SURFACE_LAYOUT_BLOCK_LINEAR

block linear surface memory

© Copyright 2022, NVIDIA. Last updated on Jun 28, 2023.