C++ API¶
Class Hierarchy¶
-
- Namespace nvidia
- Namespace nvidia::inferenceserver
- Namespace nvidia::inferenceserver::client
- Class Error
- Class InferContext
- Struct InferContext::Stat
- Class InferContext::Input
- Class InferContext::Options
- Class InferContext::Output
- Class InferContext::Request
- Class InferContext::Result
- Struct Result::ClassResult
- Class InferGrpcContext
- Class InferGrpcStreamContext
- Class InferHttpContext
- Class ModelControlContext
- Class ModelControlGrpcContext
- Class ModelControlHttpContext
- Class ServerHealthContext
- Class ServerHealthGrpcContext
- Class ServerHealthHttpContext
- Class ServerStatusContext
- Class ServerStatusGrpcContext
- Class ServerStatusHttpContext
- Class SharedMemoryControlContext
- Class SharedMemoryControlGrpcContext
- Class SharedMemoryControlHttpContext
- Namespace nvidia::inferenceserver::custom
- Class CustomInstance
- Namespace nvidia::inferenceserver::client
- Namespace nvidia::inferenceserver
- Struct cudaIpcMemHandle_t
- Struct custom_initdata_struct
- Struct custom_payload_struct
- Enum custom_memorytype_enum
- Enum custom_serverparamkind_enum
- Enum trtserver_errorcode_enum
- Enum trtserver_memorytype_enum
- Enum trtserver_metricformat_enum
- Enum trtserver_modelcontrolmode_enum
- Enum trtserver_traceactivity_enum
- Enum trtserver_tracelevel_enum
- Namespace nvidia
File Hierarchy¶
-
- Directory src
- Directory backends
- Directory clients
- Directory c++
- Directory library
- File request.h
- File request_grpc.h
- File request_http.h
- Directory library
- Directory c++
- Directory core
- File trtserver.h
- Directory custom
- Directory sdk
- File custom_instance.h
- Directory sdk
- Directory src