Data Loading

• External Source Operator - basic usage
  • Define the Data Source
  • Defining the Pipeline
  • Using the Pipeline
• Parallel External Source
  • Accepted source
  • Principle of Operation
  • Example Pipeline and source
  • Going Parallel
  • Running the Pipeline with Spawned Python Workers
  • Shuffling and sharding
  • Parallel external source in containers
• Parallel External Source - Fork
  • Steps to Start with Fork
  • Example Pipeline and source
  • Starting Python Workers
• LMDB Reader
  • Pipeline Mode
  • Dynamic Mode
• MXNet RecordIO Reader
  • Pipeline Mode
  • Dynamic Mode
• TFRecord Reader
  • Pipeline Mode
  • Dynamic Mode
• Webdataset Reader
  • Pipeline Mode
  • Dynamic Mode
• COCO Reader
  • Pipeline Mode
  • Dynamic Mode
• NumPy Reader
  • Pipeline Mode
  • Dynamic Mode