NVIDIA DALI
0.16.0 -b33c5ac
Version select:
Current release
master (unstable)
Older releases
Documentation home
User Guide
Installation
DALI and NGC
Installing prebuilt DALI packages
Prerequisites
Installation
Pre-built packages in Watson Machine Learing Community Edition
Nightly and weekly release channels
Compiling DALI from source
Compiling DALI from source (using Docker builder) - recommended
Prerequisites
Building Python wheel and (optionally) Docker image
Compiling DALI from source (bare metal)
Prerequisites
Get the DALI source
Make the build directory
Compile DALI
Building DALI without LMDB support:
Building DALI with LMDB support:
Building DALI using Clang (experimental):
Install Python bindings
Cross-compiling DALI C++ API for aarch64 Linux (Docker)
Build the aarch64 Linux Build Container
Compile
Cross-compiling DALI C++ API for aarch64 QNX (Docker)
Setup
Build the aarch64 Build Container
Compile
Getting started
Overview
Optimal configuration
Pipeline
Defining the pipeline
Building the pipeline
Running the pipeline
Adding augmentations
Random shuffle
Augmentations
Tensors as arguments and Random Number Generation
GPU acceleration
Copying tensors to GPU
Important notice
Hybrid decoding
Tutorials
Data Loading
Data loading: LMDB database
Overview
Caffe LMDB format
Caffe 2 LMDB format
Data loading: MXNet recordIO
Overview
Creating index
Defining and running the pipeline
Data loading: TensorFlow TFRecord
Overview
Creating index
Defining and running the pipeline
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
COCO Reader
Simple Video pipeline reading from multiple files
Goal
Setting up
Running the pipeline
Visualizing the results
Video pipeline reading labelled videos from a directory
Goal
Setting up
Running the pipeline
Visualizing the results
Simple Sequence pipeline reading from multiple files
Serialization
Overview
Serialization
COCO Reader with augmentations
Augmentation Gallery
WarpAffine
Introduction
Warp operators
Affine transform
Usage example
Example output
Color Space Conversion
Defining the pipeline
Building and running the pipeline
Visualizing the results
Image Decoder examples (CPU)
Common code
Image Decoder (CPU)
Image Decoder (CPU) with random cropping window size and anchor
Image Decoder with fixed cropping window size and external anchor
Image Decoder (CPU) with external window size and anchor
Image Decoder (Hybrid)
Image Decoder (Hybrid) with random cropping window size and anchor
Image Decoder (Hybrid) with fixed cropping window size and external anchor
Image Decoder (Hybrid) with external window size and anchor
Multiple GPU support
Overview
Run pipeline on selected GPU
Sharding
Example VideoReader usage: Video Super-Resolution
Dataloaders
Data loader performance
Requirements
FlowNet2-SD implementation and pre-trained model
Data
Training
Results on Myanmar validation set
Reference
Optical Flow example
Using Dali
Define the Pipeline.
Build and run DALI Pipeline.
Visualize results
Create a custom operator
Operator definition
CPU operator implementation
GPU operator implementation
Building the plugin
Importing the plugin
Python Operator
Defining an operator implementation
Example pipeline
Running the pipeline and visualizing results
DALI expressions and arithmetic operators
Defining the iterator
Instantiating the iterators
Defining the pipeline
Using the pipeline
Framework integration
MXNet
Gluon example with DALI
Overview
Sample
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
MXNet with DALI - ResNet 50 example
Overview
ResNet 50 pipeline
Training with MXNet
Using MXNet DALI plugin: using various readers
Overview
MXNet Plugin API reference
PyTorch
Using DALI in PyTorch
Overview
ExternalSource operator
Defining the iterator
Defining the pipeline
Using the pipeline
Using PyTorch DALI plugin: using various readers
Overview
ImageNet training in PyTorch
Requirements
Training
Usage
Single Shot MultiBox Detector training in PyTorch
Requirements
Usage
PyTorch Plugin API reference
TensorFlow
ResNet-N with TensorFlow and DALI
Requirements
Using Tensorflow DALI plugin with sparse tensors
Overview
Defining the data loading pipeline
Using DALI TensorFlow plugin
Using the tensors in a simple Tensorflow graph
Using Tensorflow DALI plugin: simple example
Overview
Defining the data loading pipeline
Using DALI TensorFlow plugin
Using the tensors in a simple Tensorflow graph
Using Tensorflow DALI plugin: using various readers
Overview
TensorFlow Plugin API reference
Python API
Pipeline
Tensor
TensorList
Enums
Supported operations
Advanced topics
DALI internal data format
Thread affinity
Memory consumption
Operator buffer presizing
Prefetching queue depth
Running DALI pipeline
C++ API
NVIDIA DALI
Docs
»
Index
Index
A
|
B
|
C
|
D
|
E
|
F
|
G
|
H
|
I
|
J
|
L
|
M
|
N
|
O
|
P
|
R
|
S
|
T
|
U
|
V
|
W
|
Y
A
ANY_DATA (nvidia.dali.types.DALIImageType attribute)
ArithmeticGenericOp (class in nvidia.dali.ops)
as_array() (nvidia.dali.backend.TensorListCPU method)
as_cpu() (nvidia.dali.backend.TensorListGPU method)
as_reshaped_tensor() (nvidia.dali.backend.TensorListCPU method)
(nvidia.dali.backend.TensorListGPU method)
as_tensor() (nvidia.dali.backend.TensorListCPU method)
(nvidia.dali.backend.TensorListGPU method)
at() (nvidia.dali.backend.TensorListCPU method)
(nvidia.dali.backend.TensorListGPU method)
B
BASIC (nvidia.dali.types.PipelineAPIType attribute)
batch_size() (nvidia.dali.pipeline.Pipeline property)
BbFlip (class in nvidia.dali.ops)
BBoxPaste (class in nvidia.dali.ops)
BGR (nvidia.dali.types.DALIImageType attribute)
BOOL (nvidia.dali.types.DALIDataType attribute)
BoxEncoder (class in nvidia.dali.ops)
Brightness (class in nvidia.dali.ops)
BrightnessContrast (class in nvidia.dali.ops)
build() (nvidia.dali.pipeline.Pipeline method)
C
Caffe2Reader (class in nvidia.dali.ops)
CaffeReader (class in nvidia.dali.ops)
Cast (class in nvidia.dali.ops)
COCOReader (class in nvidia.dali.ops)
CoinFlip (class in nvidia.dali.ops)
ColorSpaceConversion (class in nvidia.dali.ops)
ColorTwist (class in nvidia.dali.ops)
Contrast (class in nvidia.dali.ops)
Copy (class in nvidia.dali.ops)
copy_to_external() (nvidia.dali.backend.TensorCPU method)
(nvidia.dali.backend.TensorGPU method)
(nvidia.dali.backend.TensorListCPU method)
(nvidia.dali.backend.TensorListGPU method)
Crop (class in nvidia.dali.ops)
CropMirrorNormalize (class in nvidia.dali.ops)
current_stream() (nvidia.dali.ops.PythonFunction static method)
D
DALIClassificationIterator (class in nvidia.dali.plugin.mxnet)
(class in nvidia.dali.plugin.pytorch)
DALIDataset (class in nvidia.dali.plugin.tf)
DALIDataType (class in nvidia.dali.types)
DALIGenericIterator (class in nvidia.dali.plugin.mxnet)
(class in nvidia.dali.plugin.pytorch)
DALIImageType (class in nvidia.dali.types)
DALIInterpType (class in nvidia.dali.types)
DALIIterator() (in module nvidia.dali.plugin.tf)
DALIIteratorWrapper() (in module nvidia.dali.plugin.tf)
DALIRawIterator() (in module nvidia.dali.plugin.tf)
DATA_TAG (nvidia.dali.plugin.mxnet.DALIClassificationIterator attribute)
(nvidia.dali.plugin.mxnet.DALIGenericIterator attribute)
DATA_TYPE (nvidia.dali.types.DALIDataType attribute)
define_graph() (nvidia.dali.pipeline.Pipeline method)
deserialize_and_build() (nvidia.dali.pipeline.Pipeline method)
device_id() (nvidia.dali.pipeline.Pipeline property)
DLTensorPythonFunction (class in nvidia.dali.ops)
dtype() (nvidia.dali.backend.TensorCPU method)
(nvidia.dali.backend.TensorGPU method)
DumpImage (class in nvidia.dali.ops)
E
ElementExtract (class in nvidia.dali.ops)
empty() (nvidia.dali.pipeline.Pipeline method)
enable_api_check() (nvidia.dali.pipeline.Pipeline method)
epoch_size() (nvidia.dali.pipeline.Pipeline method)
ExternalSource (class in nvidia.dali.ops)
F
FastResizeCropMirror (class in nvidia.dali.ops)
FEATURE (nvidia.dali.types.DALIDataType attribute)
feed_input() (nvidia.dali.pipeline.Pipeline method)
feed_ndarray() (in module nvidia.dali.plugin.mxnet)
(in module nvidia.dali.plugin.pytorch)
FileReader (class in nvidia.dali.ops)
Flip (class in nvidia.dali.ops)
FLOAT (nvidia.dali.types.DALIDataType attribute)
FLOAT16 (nvidia.dali.types.DALIDataType attribute)
FLOAT64 (nvidia.dali.types.DALIDataType attribute)
G
GRAY (nvidia.dali.types.DALIImageType attribute)
H
Hsv (class in nvidia.dali.ops)
Hue (class in nvidia.dali.ops)
I
IMAGE_TYPE (nvidia.dali.types.DALIDataType attribute)
ImageDecoder (class in nvidia.dali.ops)
ImageDecoderCrop (class in nvidia.dali.ops)
ImageDecoderRandomCrop (class in nvidia.dali.ops)
ImageDecoderSlice (class in nvidia.dali.ops)
INT16 (nvidia.dali.types.DALIDataType attribute)
INT32 (nvidia.dali.types.DALIDataType attribute)
INT64 (nvidia.dali.types.DALIDataType attribute)
INT8 (nvidia.dali.types.DALIDataType attribute)
INTERP_CUBIC (nvidia.dali.types.DALIInterpType attribute)
INTERP_GAUSSIAN (nvidia.dali.types.DALIInterpType attribute)
INTERP_LANCZOS3 (nvidia.dali.types.DALIInterpType attribute)
INTERP_LINEAR (nvidia.dali.types.DALIInterpType attribute)
INTERP_NN (nvidia.dali.types.DALIInterpType attribute)
INTERP_TRIANGULAR (nvidia.dali.types.DALIInterpType attribute)
INTERP_TYPE (nvidia.dali.types.DALIDataType attribute)
is_dense_tensor() (nvidia.dali.backend.TensorListCPU method)
(nvidia.dali.backend.TensorListGPU method)
iter_setup() (nvidia.dali.pipeline.Pipeline method)
ITERATOR (nvidia.dali.types.PipelineAPIType attribute)
J
Jitter (class in nvidia.dali.ops)
L
LABEL_TAG (nvidia.dali.plugin.mxnet.DALIClassificationIterator attribute)
(nvidia.dali.plugin.mxnet.DALIGenericIterator attribute)
layout() (nvidia.dali.backend.TensorCPU method)
(nvidia.dali.backend.TensorGPU method)
(nvidia.dali.backend.TensorListCPU method)
(nvidia.dali.backend.TensorListGPU method)
LookupTable (class in nvidia.dali.ops)
M
MXNetReader (class in nvidia.dali.ops)
N
next() (nvidia.dali.plugin.mxnet.DALIClassificationIterator method)
(nvidia.dali.plugin.mxnet.DALIGenericIterator method)
(nvidia.dali.plugin.pytorch.DALIGenericIterator method)
NO_TYPE (nvidia.dali.types.DALIDataType attribute)
num_threads() (nvidia.dali.pipeline.Pipeline property)
nvidia.dali.ops (module)
nvidia.dali.pipeline (module)
nvidia.dali.plugin.mxnet (module)
nvidia.dali.plugin.pytorch (module)
nvidia.dali.plugin.tf (module)
O
OpticalFlow (class in nvidia.dali.ops)
outputs() (nvidia.dali.pipeline.Pipeline method)
P
Pad (class in nvidia.dali.ops)
Paste (class in nvidia.dali.ops)
Pipeline (class in nvidia.dali.pipeline)
PipelineAPIType (class in nvidia.dali.types)
PYTHON_OBJECT (nvidia.dali.types.DALIDataType attribute)
PythonFunction (class in nvidia.dali.ops)
PythonFunctionBase (class in nvidia.dali.ops)
R
RandomBBoxCrop (class in nvidia.dali.ops)
RandomResizedCrop (class in nvidia.dali.ops)
release_outputs() (nvidia.dali.pipeline.Pipeline method)
reset() (nvidia.dali.pipeline.Pipeline method)
(nvidia.dali.plugin.mxnet.DALIClassificationIterator method)
(nvidia.dali.plugin.mxnet.DALIGenericIterator method)
(nvidia.dali.plugin.pytorch.DALIGenericIterator method)
Reshape (class in nvidia.dali.ops)
Resize (class in nvidia.dali.ops)
ResizeCropMirror (class in nvidia.dali.ops)
RGB (nvidia.dali.types.DALIImageType attribute)
Rotate (class in nvidia.dali.ops)
run() (nvidia.dali.pipeline.Pipeline method)
S
Saturation (class in nvidia.dali.ops)
save_graph_to_dot_file() (nvidia.dali.pipeline.Pipeline method)
schedule_run() (nvidia.dali.pipeline.Pipeline method)
SCHEDULED (nvidia.dali.types.PipelineAPIType attribute)
SequenceReader (class in nvidia.dali.ops)
serialize() (nvidia.dali.pipeline.Pipeline method)
shape() (nvidia.dali.backend.TensorCPU method)
(nvidia.dali.backend.TensorGPU method)
Shapes (class in nvidia.dali.ops)
share_outputs() (nvidia.dali.pipeline.Pipeline method)
Slice (class in nvidia.dali.ops)
Sphere (class in nvidia.dali.ops)
squeeze() (nvidia.dali.backend.TensorCPU method)
(nvidia.dali.backend.TensorGPU method)
SSDRandomCrop (class in nvidia.dali.ops)
STRING (nvidia.dali.types.DALIDataType attribute)
T
TENSOR_LAYOUT (nvidia.dali.types.DALIDataType attribute)
TensorCPU (class in nvidia.dali.backend)
TensorGPU (class in nvidia.dali.backend)
TensorLayout (class in nvidia.dali.types)
TensorListCPU (class in nvidia.dali.backend)
TensorListGPU (class in nvidia.dali.backend)
TFRecordReader (class in nvidia.dali.ops)
TorchPythonFunction (class in nvidia.dali.plugin.pytorch)
Transpose (class in nvidia.dali.ops)
U
UINT16 (nvidia.dali.types.DALIDataType attribute)
UINT32 (nvidia.dali.types.DALIDataType attribute)
UINT64 (nvidia.dali.types.DALIDataType attribute)
UINT8 (nvidia.dali.types.DALIDataType attribute)
Uniform (class in nvidia.dali.ops)
V
VideoReader (class in nvidia.dali.ops)
W
WarpAffine (class in nvidia.dali.ops)
Water (class in nvidia.dali.ops)
Y
YCbCr (nvidia.dali.types.DALIImageType attribute)