Multimedia APIs

The Multimedia API is a collection of low-level APIs that support flexible application development. These low-level APIs enable flexibility by providing better control over the underlying hardware blocks.

The Multimedia API includes the following:

• Libargus Camera API for capture applications.

• V4L2 API for encoding, decoding, and other media functions.

• NVOSD for on-screen display.

• Buffer Utility for buffer allocation, management, and sharing, transform, composition, and blending.

Example applications demonstrate the following processes:

• Video decode

• Video encode

• Video decode with CUDA processing

• Video encode with CUDA processing

• TensorRT video decode

• JPEG encode

• JPEG decode

• Video convert

• Video decode using Direct Rendering Manager

• Camera JPEG capture

• Camera video record

• Video OSD

• Camera capture with CUDA processing

• Multicamera capture with composition

• Multivideo decode

• Multivideo encode

• Multivideo transcode

• TensorRT multichannel video capture

• CUDA-based format conversion

• TensorRT and OpenCV analytics

The Multimedia API provides an additional application-development path for developers who are not using a framework such as GStreamer or who are using custom frameworks.

Documentation for the Multimedia API is available in the Multimedia APIs section of the Jetson Linux API Reference.

Multimedia Demo Applications

nvgstplayer-1.0 and nvgstcapture-1.0 are applications that demonstrate and test GStreamer-based multimedia functionality.

nvgstplayer-1.0

nvgstplayer-1.0 is a media file player that runs from the command line. It plays audio and video files encapsulated in the following formats:

• MP4

• 3GP

• AVI

• ASF

• WMA

• MKV

• M2TS

• WEBM

• MOV

nvgstplayer-1.0 supports local file playback and playback over RSTP, HTTP, and UDP.

For more information about nvgstplayer-1.0, see the README nvgstplayer-1.0_README.txt.

nvgstcapture-1.0

nvgstcapture-1.0 is a command-line camera capture application. nvgstcapture-1.0 captures video data using a camera and encapsulates encoded video data in a container file.

nvgstcapture-1.0 supports the Argus API using the nvarguscamerasrc plug-in.

For more information about nvgstcapture-1.0, see the README nvgstcapture-1.0-1.0_README.txt.