Multimedia APIs

The Multimedia API is a collection of low-level APIs that support flexible application development. These low-level APIs enable flexibility by providing better control over the underlying hardware blocks.

The Multimedia API includes:

• libargus for capture applications

• V4L2 API for encoding, decoding, and other media functions

• NVOSD for On-Screen display

• Buffer Utility for buffer allocation, management, and sharing, transform, composition, and blending

Example applications are provided to demonstrate:

• Video decode.

• Video encode.

• Video decode with cuda processing.

• Video encode with cuda processing.

• |NVIDIA(r)| TensorRT|tm| video decode.

• JPEG encode.

• JPEG decode.

• Video convert.

• Video Decode DRM.

• Camera JPEG capture.

• Camera video record.

• Video OSD.

• Camera capture and CUDA processing.

• Multicamera capture with composition.

• Multivideo decode.

• Multivideo encode.

• Multivideo transcode.

• |NVIDIA(r)| TensorRT|tm| multi-channel video capture.

• CUDA-based format conversion.

• |NVIDIA(r)| TensorRT|tm| and OpenCV usage.

The Multimedia API provides additional application development path for those not using a framework such as GStreamer, or for developers leveraging custom frameworks.

The multimedia API is described in the Jetson Linux API Reference, available for download from the Jetson Download Center.

Multimedia Demo Applications

nvgstplayer-1.0 and nvgstcapture-1.0 are applications that demonstrate and test GStreamer-based multimedia functionality. nvgstplayer-1.0 is a multimedia player. nvgstcapture-1.0 is a multimedia capture application that generates image and video output files.

nvgstplayer-1.0

nvgstplayer-1.0 is a media file player that runs from the command line. It plays audio and video files encapsulated in these formats:

• MP4

• 3GP

• AVI

• ASF

• WMA

• MKV

• M2TS

• WEBM

• MOV

nvgstplayer-1.0 supports local file playback and playback over RSTP, HTTP, and UDP.

For more information about nvgstplayer-1.0, see the README nvgstplayer-1.0_README.txt.

nvgstcapture-1.0

nvgstcapture-1.0 is a command line camera capture application. nvgstcapture-1.0 captures video data using a camera and encapsulates encoded video data in a container file.

nvgstcapture-1.0 supports the ARGUS API using the nvarguscamerasrc plugin.

For more information about nvgstcapture-1.0, see the README nvgstcapture-1.0-1.0_README.txt.