The Multimedia API is a collection of low-level APIs that support flexible application development. These low-level APIs enable flexibility by providing better control over the underlying hardware blocks.
The Multimedia API includes:
libargusfor imaging applications
V4L2 API for encoding, decoding, scaling, and other media functions
NVOSD for On-Screen display
Buffer Utility for buffer allocation, management, and sharing, transform, composition, and blending
Example applications are provided to demonstrate:
Video decode (dual decode support with NVDEC)
Video encode (dual encode support with NVENC)
Video decode and DRM based render
Video decode with multi-channels
Multivideo decode (decoding of multiple video streams in parallel)
JPEG decode and JPEG encode
Image and video processing with NVIDIA® CUDA®
Camera JPEG capture and video record
Camera capture and CUDA processing
Multicamera capture with composition
Object detection and classification with cuDNN
NVIDIA® TensorRT™ and OpenCV usage
The Multimedia API provides another application development path for those not using a framework such as GStreamer, or for developers leveraging custom frameworks.
The multimedia API is described in the Jetson Linux API Reference, available for download from the Jetson Download Center.
Download and install GStreamer directly on the target. The wrapper
gst-openmax, is an interface between GStreamer and OpenMAX. It
enables accelerated NVIDIA plug-ins to operate in the GStreamer framework.
Multimedia Demo Applications¶
NvGstCapture are applications that demonstrate and test GStreamer-based multimedia functionality.
NvGstPlayer is a multimedia player.
NvGstCapture is a multimedia capture application that generates image and video output files.
Before you run
NvGstCapture, complete the prerequisite steps and install GStreamer as directed in the README file included in the release.
NvGstPlayer is a media file player that runs from the command line. It plays audio and video files encapsulated in these formats:
NvGstPlayer supports local file playback and playback over RSTP, HTTP, and UDP.
For more information about
NvGstPlayer, see the README
gst-omx plugin is deprecated as of NVIDIA® Jetson™ Linux release 32.1. Use the
gst-v4l2 plugin for development instead.
NvGstCapture is a command line camera capture application.
captures video data using a camera and encapsulates encoded video data in a
NvGstCapture supports the ARGUS API using the
Use of the legacy
nvcamerasrc plugin with NvGstCapture is deprecated.
For more information about NvGstCapture, see the README