NVIDIA DALI
0.17.0 -e61c304
Version select:
Current release
master (unstable)
Older releases
Documentation home
User Guide
Installation
DALI and NGC
Installing prebuilt DALI packages
Prerequisites
Installation
Pre-built packages in Watson Machine Learing Community Edition
Nightly and weekly release channels
Compiling DALI from source
Compiling DALI from source (using Docker builder) - recommended
Prerequisites
Building Python wheel and (optionally) Docker image
Compiling DALI from source (bare metal)
Prerequisites
Get the DALI source
Make the build directory
Compile DALI
Building DALI without LMDB support:
Building DALI with LMDB support:
Building DALI using Clang (experimental):
Install Python bindings
Cross-compiling DALI C++ API for aarch64 Linux (Docker)
Build the aarch64 Linux Build Container
Compile
Cross-compiling DALI C++ API for aarch64 QNX (Docker)
Setup
Build the aarch64 Build Container
Compile
Getting started
Overview
Optimal configuration
Pipeline
Defining the pipeline
Building the pipeline
Running the pipeline
Adding augmentations
Random shuffle
Augmentations
Tensors as arguments and Random Number Generation
GPU acceleration
Copying tensors to GPU
Important notice
Hybrid decoding
Tutorials
Data Loading
Data loading: LMDB database
Overview
Caffe LMDB format
Caffe 2 LMDB format
Data loading: MXNet recordIO
Overview
Creating index
Defining and running the pipeline
Data loading: TensorFlow TFRecord
Overview
Creating index
Defining and running the pipeline
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
COCO Reader
Simple Video pipeline reading from multiple files
Goal
Setting up
Running the pipeline
Visualizing the results
Video pipeline reading labelled videos from a directory
Goal
Setting up
Running the pipeline
Visualizing the results
Simple Sequence pipeline reading from multiple files
Serialization
Overview
Serialization
COCO Reader with augmentations
Augmentation Gallery
WarpAffine
Introduction
Warp operators
Affine transform
Usage example
Example output
3D Transforms
Warp operators
Affine transform
3D Rotation
Usage example
Example output
Color Space Conversion
Defining the pipeline
Building and running the pipeline
Visualizing the results
Image Decoder examples (CPU)
Common code
Image Decoder (CPU)
Image Decoder (CPU) with random cropping window size and anchor
Image Decoder with fixed cropping window size and external anchor
Image Decoder (CPU) with external window size and anchor
Image Decoder (Hybrid)
Image Decoder (Hybrid) with random cropping window size and anchor
Image Decoder (Hybrid) with fixed cropping window size and external anchor
Image Decoder (Hybrid) with external window size and anchor
Multiple GPU support
Overview
Run pipeline on selected GPU
Sharding
Example VideoReader usage: Video Super-Resolution
Dataloaders
Data loader performance
Requirements
FlowNet2-SD implementation and pre-trained model
Data
Training
Results on Myanmar validation set
Reference
Optical Flow example
Using Dali
Define the Pipeline.
Build and run DALI Pipeline.
Visualize results
Create a custom operator
Operator definition
CPU operator implementation
GPU operator implementation
Building the plugin
Importing the plugin
Python Operator
Defining an operator implementation
Example pipeline
Running the pipeline and visualizing results
DALI expressions and arithmetic operations
DALI expressions and arithmetic operators
Supported operators
Operating on tensors
Constant and scalar operands
Constants
Scalars
DALI binary arithmetic operators - type promotions
Prepare the test pipeline
Defining the data
Defining the pipeline
Using the Pipeline
Custom augmentations with arithmetic operations
Blending images
Audio processing with DALI
Audio spectrogram
Background
Reference implementation
Calculating the spectrogram using DALI
Mel spectrogram
Framework integration
MXNet
Gluon example with DALI
Overview
Sample
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
MXNet with DALI - ResNet 50 example
Overview
ResNet 50 pipeline
Training with MXNet
Using MXNet DALI plugin: using various readers
Overview
MXNet Plugin API reference
PyTorch
Using DALI in PyTorch
Overview
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
Using PyTorch DALI plugin: using various readers
Overview
ImageNet training in PyTorch
Requirements
Training
Usage
Single Shot MultiBox Detector training in PyTorch
Requirements
Usage
PyTorch Plugin API reference
TensorFlow
ResNet-N with TensorFlow and DALI
Requirements
Using Tensorflow DALI plugin: DALI and tf.data
Overview
Keras
Estimators
Custom models and training loops
Using Tensorflow DALI plugin: DALI tf.data.Dataset with multiple GPUs
Overview
Using Tensorflow DALI plugin with sparse tensors
Overview
Defining the data loading pipeline
Using DALI TensorFlow plugin
Using the tensors in a simple Tensorflow graph
Using Tensorflow DALI plugin: simple example
Overview
Defining the data loading pipeline
Using DALI TensorFlow plugin
Using the tensors in a simple Tensorflow graph
Using Tensorflow DALI plugin: using various readers
Overview
TensorFlow Plugin API reference
PaddlePaddle
Using DALI in PaddlePaddle
Overview
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
Using Paddle DALI plugin: using various readers
Overview
ResNet training in PaddlePaddle
Training
Usage
Single Shot MultiBox Detector training in PaddlePaddle
Requirements
Usage
Temporal Shift Module inference in PaddlePaddle
Requirements
Usage
PaddlePaddle Plugin API reference
Python API
Pipeline
Tensor
TensorList
Enums
Supported operations
Advanced topics
DALI internal data format
Thread affinity
Memory consumption
Operator buffer presizing
Prefetching queue depth
Running DALI pipeline
C++ API
NVIDIA DALI
Docs
»
Framework integration
»
PaddlePaddle
»
PaddlePaddle Plugin API reference
View page source
PaddlePaddle Plugin API reference
ΒΆ