TAO Toolkit

Version 4.0

Introduction

Overview
TAO Toolkit Quick Start Guide
TAO Toolkit Launcher
Migrating from older TLT to TAO Toolkit
Migrating from TAO Toolkit 3.x to TAO Toolkit 4.0
- Container Mapping
TAO Model Export and INT8 Calibration Changes
Working With the Containers

Model Zoo

Overview
- Computer Vision Model Zoo
- Conversational AI
Computer Vision Model Zoo
Conversational AI Model Zoo

Running TAO Toolkit in the Cloud

Running TAO Toolkit in the Cloud
Running TAO Toolkit on an AWS VM
Running TAO Toolkit on Google Cloud Platform
Running TAO Toolkit on an Azure VM
Running TAO Toolkit on Google Colab
Running TAO Toolkit on an EKS
Running TAO Toolkit on an AKS

TAO Toolkit API

Overview
Setup
Deployment
REST API
Remote Client
API Reference
Action Specs
- classification
  - evaluate
  - export
  - inference
  - train
  - convert
  - prune
  - retrain
- detectnet_v2
  - convert
  - evaluate
  - export
  - inference
  - prune
  - train
  - retrain
- dssd
  - evaluate
  - inference
  - train
  - prune
  - export
  - retrain
  - convert
- efficientdet
  - convert
  - evaluate
  - export
  - inference
  - prune
  - train
  - retrain
- faster_rcnn
  - export
  - prune
  - train
  - inference
  - convert
  - evaluate
  - retrain
- semantic_segmentation
  - convert
- instance_segmentation
  - convert
- lprnet
  - evaluate
  - export
  - inference
  - train
  - convert
- mask_rcnn
  - export
  - inference
  - prune
  - train
  - retrain
  - convert
  - evaluate
- multitask_classification
  - export
  - train
  - retrain
  - prune
  - evaluate
  - convert
  - inference
- object_detection
- retinanet
  - evaluate
  - export
  - inference
  - prune
  - train
  - retrain
  - convert
- spectro_gen
  - dataset_convert
  - export
  - finetune
  - infer
  - infer_onnx
  - train
- speech
  - pitch_stats
  - convert
- ssd
  - evaluate
  - inference
  - train
  - retrain
  - prune
  - export
  - convert
- unet
  - export
  - prune
  - train
  - convert
  - retrain
  - evaluate
  - inference
- vocoder
  - export
  - finetune
  - infer
  - infer_onnx
  - train
  - dataset_convert
- yolo_v3
  - convert
  - evaluate
  - export
  - inference
  - prune
  - train
  - retrain
- yolo_v4
  - convert
  - evaluate
  - export
  - inference
  - prune
  - train
  - retrain
- yolo_v4_tinny
  - train
  - prune
  - export
  - convert
  - evaluate
  - inference
  - retrain

AutoML

AutoML

CV Applications

Offline Data Augmentation
- Object Detection
  - Configuring the Augmentor
  - Running the Augmentor Tool
Optimizing the Training Pipeline
- Quantization Aware Training
- Automatic Mixed Precision
Visualizing Training
Data Annotation Format
Image Classification (TF1)
Image Classification (TF2)
Object Detection
Instance Segmentation
- Data Input for Instance Segmentation
- MaskRCNN
Semantic Segmentation
- UNET
- SegFormer
Gaze Estimation
- Gaze Estimation
Emotion Classification
- Emotion Classification
HeartRate Estimation
- Heart Rate Estimation
Facial Landmarks Estimation
- Facial Landmarks Estimation
Gesture Recognition
- Gesture Recognition
Body Pose Estimation
- Body Pose Estimation
Multitask Image Classification
Character Recognition
- LPRNet
ActionRecognitionNet
Re-Identification
- ReIdentificationNet
Pose Classification
- PoseClassificationNet

MLOPS integration

TAO Toolkit MLOPS Integration
TAO Toolkit WandB Integration
TAO Toolkit Clearml Integration

Conversational AI Applications

ASR
Natural Language Processing
Language Models
- N-Gram Language Model
Speech Synthesis or Text To Speech

Point Cloud Applications

3D Object Detection
- PointPillars

Deploying to Inference SDKs

Integrating TAO CV Models with Triton Inference Server
Integrating Conversational AI Models into Riva
TAO Converter
Integrating TAO Models into DeepStream
Image classification
- Deploying to DeepStream for Classification TF1/TF2
  - Generating an Engine Using tao-converter
  - Integrating the model with DeepStream
    - Integrating a Classification Model
Multitask Classification
- Deploying to DeepStream for Multitask Classification
  - Generating an Engine Using tao-converter
  - Integrating the Model with DeepStream
    - Integrating a Multitask Image Classification Model
Object Detection
Instance Segmentation
- Deploying to DeepStream for MaskRCNN
Semantic Segmentation
- Deploying to Deepstream
- Deploying to Deepstream

Deploying with TAO Deploy

TAO Deploy Overview
- Running TAO Deploy with the Launcher
TAO Deploy Installation
- Invoking the TAO Deploy Container Directly
- Installing TAO Deploy through wheel
  - Installing TAO Deploy on Google Colab
  - Installing TAO Deploy on a Jetson Platform
Classification (TF1) with TAO Deploy
Classification (TF2) with TAO Deploy
Deformable DETR with TAO Deploy
DetectNet_v2 with TAO Deploy
DSSD with TAO Deploy
EfficientDet (TF1) with TAO Deploy
EfficientDet (TF2) with TAO Deploy
Faster RCNN with TAO Deploy
LPRNet with TAO Deploy
Mask RCNN with TAO Deploy
Multitask Image Classification with TAO Deploy
RetinaNet with TAO Deploy
SSD with TAO Deploy
Segformer with TAO Deploy
UNet with TAO Deploy
YOLOv3 with TAO Deploy
YOLOv4 with TAO Deploy
YOLOv4-tiny with TAO Deploy

Bring Your Own Model (BYOM)

BYOM Converter
BYOM Image Classification
BYOM UNET

More Information

Release Notes
Frequently Asked Questions
Troubleshooting Guide
Support Information
Acknowledgements
- nitime
- OpenSSL
- JsonCpp
- Python
- libcurl
- OpenCV
- zlib
- TensorFlow
- Keras
- PyTorch
- ssd_keras
- Yamale
- PyCUDA
- protobuf
- onnx
- PIL
- PyYAML
- addict
- argcomplete
- bto3
- cryptography
- docker
- dockerpty
- gRPC
- h5py
- jupyter
- numba
- numpy
- pandas
- posix_ipc
- prettytable
- arrow
- PyJWT
- requests
- retrying
- seaborn
- scikit-image
- scikit-learn
- semver
- Shapely
- simplejson
- six
- python-tabulate
- toposort
- tqdm
- uplink
- xmltodict
- recordclass
- cocoapi
- mpi4py
- Open MPI
- lazy_object_proxy
- onnxruntime
- pytorch-lightning
- KenLM
- Eigen
- google/automl
- open-mmlab/OpenPCDet
- VainF/Torch-Pruning
- gmalivenko/onnx2keras
- open-mmlab/mmskeleton

TAO Toolkit

»
API Reference
View page source

API Reference¶

Documentation is available for the following TAO Toolkit OpenAPI versions:

4.0
3.22.05

Next Previous

Built with Sphinx using a theme provided by Read the Docs.