Multimedia APIs

The Multimedia API is a collection of low-level APIs that support flexible application development. These low-level APIs enable flexibility by providing better control over the underlying hardware blocks.

The Multimedia API includes:

  • libargus for imaging applications

  • V4L2 API for encoding, decoding, scaling, and other media functions

  • NVOSD for On-Screen display

  • Buffer Utility for buffer allocation, management, and sharing, transform, composition, and blending

Example applications are provided to demonstrate:

  • Video decode (dual decode support with NVDEC)

  • Video encode (dual encode support with NVENC)

  • Video decode and DRM based render

  • Video convert

  • Video decode with multi-channels

  • Multivideo decode (decoding of multiple video streams in parallel)

  • JPEG decode and JPEG encode

  • Image and video processing with NVIDIA ® CUDA ®

  • Camera JPEG capture and video record

  • Camera capture and CUDA processing

  • Multicamera capture with composition

  • Object detection and classification with cuDNN

  • NVIDIA ® TensorRT and OpenCV usage

The Multimedia API provides another application development path for those not using a framework such as GStreamer, or for developers leveraging custom frameworks.

The multimedia API is described in the Jetson Linux API Reference , available for download from the Jetson Download Center .

Installing GStreamer

Download and install GStreamer directly on the target. The wrapper library, gst-openmax , is an interface between GStreamer and OpenMAX. It enables accelerated NVIDIA plug-ins to operate in the GStreamer framework.

For more information about GStreamer, see the GStreamer web site sponsored by .

Multimedia Demo Applications

NvGstPlayer and NvGstCapture are applications that demonstrate and test GStreamer-based multimedia functionality. NvGstPlayer is a multimedia player. NvGstCapture is a multimedia capture application that generates image and video output files.

Before you run NvGstPlayer and NvGstCapture , complete the prerequisite steps and install GStreamer as directed in the README file included in the release.

About NvGstPlayer

NvGstPlayer is a media file player that runs from the command line. It plays audio and video files encapsulated in these formats:

  • MP4

  • 3GP

  • AVI

  • ASF

  • WMA

  • MKV

  • M2TS

  • WEBM

  • MOV

NvGstPlayer supports local file playback and playback over RSTP, HTTP, and UDP.

For more information about NvGstPlayer , see the README nvgstplayer-1.0_README.txt .


The gst-omx plugin is deprecated as of NVIDIA ® Jetson™ Linux release 32.1. Use the gst-v4l2 plugin for development instead.

About NvGstCapture

NvGstCapture is a command line camera capture application. NvGstCapture captures video data using a camera and encapsulates encoded video data in a container file.

NvGstCapture supports the ARGUS API using the nvarguscamerasrc plugin.


Use of the legacy nvcamerasrc plugin with NvGstCapture is deprecated.

For more information about NvGstCapture, see the README nvgstcapture-1.0_README.txt .