NVIDIA DALI
0.17.0 -e61c304
Version select:
  • Documentation home

User Guide

  • Installation
    • DALI and NGC
    • Installing prebuilt DALI packages
      • Prerequisites
      • Installation
        • Pre-built packages in Watson Machine Learing Community Edition
        • Nightly and weekly release channels
  • Compiling DALI from source
    • Compiling DALI from source (using Docker builder) - recommended
      • Prerequisites
      • Building Python wheel and (optionally) Docker image
    • Compiling DALI from source (bare metal)
      • Prerequisites
      • Get the DALI source
      • Make the build directory
      • Compile DALI
      • Building DALI without LMDB support:
      • Building DALI with LMDB support:
      • Building DALI using Clang (experimental):
      • Install Python bindings
    • Cross-compiling DALI C++ API for aarch64 Linux (Docker)
      • Build the aarch64 Linux Build Container
      • Compile
    • Cross-compiling DALI C++ API for aarch64 QNX (Docker)
      • Setup
      • Build the aarch64 Build Container
      • Compile
  • Getting started
    • Overview
    • Optimal configuration
    • Pipeline
      • Defining the pipeline
      • Building the pipeline
      • Running the pipeline
    • Adding augmentations
      • Random shuffle
      • Augmentations
      • Tensors as arguments and Random Number Generation
    • GPU acceleration
      • Copying tensors to GPU
        • Important notice
      • Hybrid decoding
  • Tutorials
    • Data Loading
      • Data loading: LMDB database
        • Overview
        • Caffe LMDB format
        • Caffe 2 LMDB format
      • Data loading: MXNet recordIO
        • Overview
        • Creating index
        • Defining and running the pipeline
      • Data loading: TensorFlow TFRecord
        • Overview
        • Creating index
        • Defining and running the pipeline
      • ExternalSource operator
        • Defining the iterator
        • Defining the pipeline
        • Using the pipeline
      • COCO Reader
      • Simple Video pipeline reading from multiple files
        • Goal
        • Setting up
        • Running the pipeline
        • Visualizing the results
      • Video pipeline reading labelled videos from a directory
        • Goal
        • Setting up
        • Running the pipeline
        • Visualizing the results
      • Simple Sequence pipeline reading from multiple files
    • Serialization
      • Overview
      • Serialization
    • COCO Reader with augmentations
    • Augmentation Gallery
    • WarpAffine
      • Introduction
        • Warp operators
        • Affine transform
      • Usage example
      • Example output
    • 3D Transforms
      • Warp operators
        • Affine transform
        • 3D Rotation
      • Usage example
      • Example output
    • Color Space Conversion
      • Defining the pipeline
      • Building and running the pipeline
      • Visualizing the results
    • Image Decoder examples (CPU)
      • Common code
      • Image Decoder (CPU)
      • Image Decoder (CPU) with random cropping window size and anchor
      • Image Decoder with fixed cropping window size and external anchor
      • Image Decoder (CPU) with external window size and anchor
    • Image Decoder (Hybrid)
      • Image Decoder (Hybrid) with random cropping window size and anchor
      • Image Decoder (Hybrid) with fixed cropping window size and external anchor
      • Image Decoder (Hybrid) with external window size and anchor
    • Multiple GPU support
      • Overview
      • Run pipeline on selected GPU
      • Sharding
    • Example VideoReader usage: Video Super-Resolution
      • Dataloaders
      • Data loader performance
      • Requirements
      • FlowNet2-SD implementation and pre-trained model
      • Data
      • Training
      • Results on Myanmar validation set
      • Reference
    • Optical Flow example
      • Using Dali
        • Define the Pipeline.
        • Build and run DALI Pipeline.
        • Visualize results
    • Create a custom operator
      • Operator definition
      • CPU operator implementation
      • GPU operator implementation
      • Building the plugin
      • Importing the plugin
    • Python Operator
      • Defining an operator implementation
      • Example pipeline
      • Running the pipeline and visualizing results
    • DALI expressions and arithmetic operations
      • DALI expressions and arithmetic operators
        • Supported operators
        • Operating on tensors
        • Constant and scalar operands
        • Constants
        • Scalars
      • DALI binary arithmetic operators - type promotions
        • Prepare the test pipeline
        • Defining the data
        • Defining the pipeline
        • Using the Pipeline
      • Custom augmentations with arithmetic operations
        • Blending images
    • Audio processing with DALI
      • Audio spectrogram
        • Background
        • Reference implementation
        • Calculating the spectrogram using DALI
        • Mel spectrogram
  • Framework integration
    • MXNet
      • Gluon example with DALI
        • Overview
        • Sample
      • ExternalSource operator
        • Defining the iterator
        • Defining the pipeline
        • Using the pipeline
      • MXNet with DALI - ResNet 50 example
        • Overview
        • ResNet 50 pipeline
        • Training with MXNet
      • Using MXNet DALI plugin: using various readers
        • Overview
      • MXNet Plugin API reference
    • PyTorch
      • Using DALI in PyTorch
        • Overview
      • ExternalSource operator
        • Defining the iterator
        • Defining the pipeline
        • Using the pipeline
      • Using PyTorch DALI plugin: using various readers
        • Overview
      • ImageNet training in PyTorch
        • Requirements
        • Training
        • Usage
      • Single Shot MultiBox Detector training in PyTorch
        • Requirements
        • Usage
      • PyTorch Plugin API reference
    • TensorFlow
      • ResNet-N with TensorFlow and DALI
        • Requirements
      • Using Tensorflow DALI plugin: DALI and tf.data
        • Overview
        • Keras
        • Estimators
        • Custom models and training loops
      • Using Tensorflow DALI plugin: DALI tf.data.Dataset with multiple GPUs
        • Overview
      • Using Tensorflow DALI plugin with sparse tensors
        • Overview
        • Defining the data loading pipeline
        • Using DALI TensorFlow plugin
        • Using the tensors in a simple Tensorflow graph
      • Using Tensorflow DALI plugin: simple example
        • Overview
        • Defining the data loading pipeline
        • Using DALI TensorFlow plugin
        • Using the tensors in a simple Tensorflow graph
      • Using Tensorflow DALI plugin: using various readers
        • Overview
      • TensorFlow Plugin API reference
    • PaddlePaddle
      • Using DALI in PaddlePaddle
        • Overview
      • ExternalSource operator
        • Defining the iterator
        • Defining the pipeline
        • Using the pipeline
      • Using Paddle DALI plugin: using various readers
        • Overview
      • ResNet training in PaddlePaddle
        • Training
        • Usage
      • Single Shot MultiBox Detector training in PaddlePaddle
        • Requirements
        • Usage
      • Temporal Shift Module inference in PaddlePaddle
        • Requirements
        • Usage
      • PaddlePaddle Plugin API reference
  • Python API
    • Pipeline
    • Tensor
    • TensorList
    • Enums
  • Supported operations
  • Advanced topics
    • DALI internal data format
    • Thread affinity
    • Memory consumption
    • Operator buffer presizing
    • Prefetching queue depth
    • Running DALI pipeline
    • C++ API
NVIDIA DALI
  • Docs »
  • Framework integration »
  • TensorFlow
  • View page source

TensorFlowΒΆ

  • ResNet-N with TensorFlow and DALI
    • Requirements
  • Using Tensorflow DALI plugin: DALI and tf.data
    • Overview
    • Keras
    • Estimators
    • Custom models and training loops
  • Using Tensorflow DALI plugin: DALI tf.data.Dataset with multiple GPUs
    • Overview
  • Using Tensorflow DALI plugin with sparse tensors
    • Overview
    • Defining the data loading pipeline
    • Using DALI TensorFlow plugin
    • Using the tensors in a simple Tensorflow graph
  • Using Tensorflow DALI plugin: simple example
    • Overview
    • Defining the data loading pipeline
    • Using DALI TensorFlow plugin
    • Using the tensors in a simple Tensorflow graph
  • Using Tensorflow DALI plugin: using various readers
    • Overview
  • TensorFlow Plugin API reference
Next Previous

© Copyright 2018-2019, NVIDIA Corporation

Built with Sphinx using a theme provided by Read the Docs.