Triton Inference Server utilies header file.
Definition in file infer_trtis_utils.h.
Go to the source code of this file.
Namespaces | |
nvdsinferserver | |
Copyright (c) 2021, NVIDIA CORPORATION. | |
Macros | |
#define | CHECK_TRTIS_ERR_W_ACTION(trtisExpr, action, fmt, ...) |
Checks the TRITONSERVER_Error object returned by the trtisExpr. More... | |
#define | RETURN_TRTIS_ERROR(trtisExpr, fmt, ...) CHECK_TRTIS_ERR_W_ACTION(trtisExpr, return NVDSINFER_TRITON_ERROR, fmt, ##__VA_ARGS__) |
Checks the TRITONSERVER_Error object returned by the trtisExpr. More... | |
#define | CONTINUE_TRTIS_ERROR(trtisExpr, fmt, ...) CHECK_TRTIS_ERR_W_ACTION(trtisExpr, , fmt, ##__VA_ARGS__) |
Check the TRITONSERVER_Error object returned by the trtisExpr. More... | |
Functions | |
InferDataType | nvdsinferserver::DataTypeFromTriton (TRITONSERVER_DataType type) |
Maps the TRITONSERVER_DataType to the InferDataType. More... | |
TRITONSERVER_DataType | nvdsinferserver::DataTypeToTriton (InferDataType type) |
Maps the InferDataType to TRITONSERVER_DataType. More... | |
InferDataType | nvdsinferserver::DataTypeFromTritonPb (ni::DataType type) |
Maps the data type from Triton model configuration proto definition to InferDataType. More... | |
InferTensorOrder | nvdsinferserver::TensorOrderFromTritonPb (ni::ModelInput::Format order) |
Maps the tensor order from Triton model configuration proto definition to the InferTensorOrder type. More... | |
InferTensorOrder | nvdsinferserver::TensorOrderFromTritonMeta (const std::string &format) |
Maps the tensor order from Triton metadata string to the InferTensorOrder type. More... | |
TRITONSERVER_MemoryType | nvdsinferserver::MemTypeToTriton (InferMemType type) |
Maps the InferMemType to the TRITONSERVER_MemoryType. More... | |
InferMemType | nvdsinferserver::MemTypeFromTriton (TRITONSERVER_MemoryType type) |
Maps the TRITONSERVER_MemoryType to the InferMemType. More... | |
template<typename VecDims > | |
InferDims | nvdsinferserver::DimsFromTriton (const VecDims &shape) |
Converts the input shape vector from Triton to InferDims type. More... | |
const char * | nvdsinferserver::TritonControlModeToStr (int32_t mode) |
Returns a string describing the TRITONSERVER_ModelControlMode: none, explicit or poll. More... | |
#define CHECK_TRTIS_ERR_W_ACTION | ( | trtisExpr, | |
action, | |||
fmt, | |||
... | |||
) |
Checks the TRITONSERVER_Error object returned by the trtisExpr.
In case of error, performs the specified action after logging the error message.
Definition at line 40 of file infer_trtis_utils.h.
#define CONTINUE_TRTIS_ERROR | ( | trtisExpr, | |
fmt, | |||
... | |||
) | CHECK_TRTIS_ERR_W_ACTION(trtisExpr, , fmt, ##__VA_ARGS__) |
Check the TRITONSERVER_Error object returned by the trtisExpr.
In case of error, log the error and continue.
Definition at line 64 of file infer_trtis_utils.h.
#define RETURN_TRTIS_ERROR | ( | trtisExpr, | |
fmt, | |||
... | |||
) | CHECK_TRTIS_ERR_W_ACTION(trtisExpr, return NVDSINFER_TRITON_ERROR, fmt, ##__VA_ARGS__) |
Checks the TRITONSERVER_Error object returned by the trtisExpr.
In case of error, logs the error and returns with NVDSINFER_TRITON_ERROR.
Definition at line 57 of file infer_trtis_utils.h.