Python API

GRPC Client

This module contains the GRPC client including the ability to send health, status, metadata and inference requests to a Triton server.

HTTP/REST Client

This module contains the HTTP/REST client including the ability to send health, status, metadata and inference requests to a Triton server.

Client Utilities

This module includes common utilities used by both GRPC and HTTP/REST clients.

Shared Memory Utilities

This module contains an example API for accessing system and CUDA shared memory for use with Triton.