nvdsinferserver::TrtServerResponse Class Reference

Detailed Description

Wrapper class for Triton output parsing.

Definition at line 219 of file infer_trtis_server.h.

Public Member Functions
NvDsInferStatus	parse (const TrtServerRequest *req)
	Check for error and parse the inference output. More...
const std::string &	model () const
	Get the model name parsed from the Triton response. More...
std::vector< SharedBatchBuf > &	mutableOutputs ()
	Get the list of output batch buffers. More...
NvDsInferStatus	getStatus () const
	Check if the response could be parsed correctly. More...
SharedOptions	takeoverOptions ()
	Get and own the options list. More...

Protected Member Functions
	TrtServerResponse (TrtServerPtr server, UniqTritonT< TRITONSERVER_InferenceResponse > data, uint64_t id)
	Constructor. More...

Friends
class	TrtISServer

Constructor & Destructor Documentation

TrtServerResponse()

nvdsinferserver::TrtServerResponse::TrtServerResponse ( TrtServerPtr  server, UniqTritonT< TRITONSERVER_InferenceResponse >  data, uint64_t  id  )

protected

Constructor.

Parameters

server	Handle to the server class instance.
data	Pointer to the inference result.
id	The corresponding request ID.

Member Function Documentation

getStatus()

NvDsInferStatus nvdsinferserver::TrtServerResponse::getStatus ( ) const

inline

Check if the response could be parsed correctly.

Definition at line 256 of file infer_trtis_server.h.

model()

const std::string& nvdsinferserver::TrtServerResponse::model ( ) const

inline

Get the model name parsed from the Triton response.

Definition at line 248 of file infer_trtis_server.h.

mutableOutputs()

std::vector<SharedBatchBuf>& nvdsinferserver::TrtServerResponse::mutableOutputs ( )

inline

Get the list of output batch buffers.

Definition at line 252 of file infer_trtis_server.h.

parse()

NvDsInferStatus nvdsinferserver::TrtServerResponse::parse

(

const TrtServerRequest *

req

)

Check for error and parse the inference output.

This functions checks the error status of the response and gets the model name and version from the response. It then call the parseParams() and parseOutputData() functions.

Parameters

req	Pointer to the corresponding Triton request.

Returns

NVDSINFER_SUCCESS or NVDSINFER_TRITON_ERROR.

takeoverOptions()

SharedOptions nvdsinferserver::TrtServerResponse::takeoverOptions ( )

inline

Get and own the options list.

Definition at line 260 of file infer_trtis_server.h.

Friends And Related Function Documentation

TrtISServer

friend class TrtISServer

friend

Definition at line 220 of file infer_trtis_server.h.

---

The documentation for this class was generated from the following file:

• infer_trtis_server.h