Header file for the gRPC client and request class for inference using the Triton Inference Server. Uses the Triton client library for inference using gRPC.
Definition in file 9.0/sources/libs/nvdsinferserver/infer_grpc_client.h.
Go to the source code of this file.
Data Structures | |
| class | nvdsinferserver::TritonGrpcRequest |
| Triton gRPC inference request class holding data associated with one inference request. More... | |
| class | nvdsinferserver::InferGrpcClient |
| Wrapper class for the gRPC client of the Triton Inference Server, interfaces with the Triton client library. More... | |
Namespaces | |
| nvdsinferserver | |
| This is a header file for pre-processing cuda kernels with normalization and mean subtraction required by nvdsinfer. | |