Python API

Warning

You are currently viewing an out-of-date version of the Triton documentation. For the latest documentation visit the Triton documentation on GitHub.

GRPC Client

This module contains the GRPC client including the ability to send health, status, metadata and inference requests to a Triton server.

HTTP/REST Client

This module contains the HTTP/REST client including the ability to send health, status, metadata and inference requests to a Triton server.

Client Utilities

This module includes common utilities used by both GRPC and HTTP/REST clients.

Shared Memory Utilities

This module contains an example API for accessing system and CUDA shared memory for use with Triton.