Header file for the gRPC client and request class for inference using the Triton Inference Server. Uses the Triton client library for inference using gRPC.
Definition in file infer_grpc_client.h.
Go to the source code of this file.
Data Structures | |
| class | nvdsinferserver::TritonGrpcRequest |
| Triton gRPC inference request class holding data associated with one inference request. More... | |
| class | nvdsinferserver::InferGrpcClient |
| Wrapper class for the gRPC client of the Triton Inference Server, interfaces with the Triton client library. More... | |
Namespaces | |
| nvdsinferserver | |
| This is a header file for pre-processing cuda kernels with normalization and mean subtraction required by nvdsinfer. | |
Typedefs | |
| typedef std::map< std::string, std::string > | nvdsinferserver::Headers |
| using | nvdsinferserver::SharedGrpcRequest = std::shared_ptr< TritonGrpcRequest > |
| using | nvdsinferserver::TritonGrpcAsyncDone = std::function< void(NvDsInferStatus, SharedBatchArray)> |