nvdsinferserver::TrtServerResponse Class Reference

Detailed Description

Wrapper class for Triton output parsing.

Definition at line 219 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

Public Member Functions
NvDsInferStatus	parse (const TrtServerRequest *req)
	Check for error and parse the inference output. More...
const std::string &	model () const
	Get the model name parsed from the Triton response. More...
std::vector< SharedBatchBuf > &	mutableOutputs ()
	Get the list of output batch buffers. More...
NvDsInferStatus	getStatus () const
	Check if the response could be parsed correctly. More...
SharedOptions	takeoverOptions ()
	Get and own the options list. More...
NvDsInferStatus	parse (const TrtServerRequest *req)
	Check for error and parse the inference output. More...
const std::string &	model () const
	Get the model name parsed from the Triton response. More...
std::vector< SharedBatchBuf > &	mutableOutputs ()
	Get the list of output batch buffers. More...
NvDsInferStatus	getStatus () const
	Check if the response could be parsed correctly. More...
SharedOptions	takeoverOptions ()
	Get and own the options list. More...

Protected Member Functions
	TrtServerResponse (TrtServerPtr server, UniqTritonT< TRITONSERVER_InferenceResponse > data, uint64_t id)
	Constructor. More...
	TrtServerResponse (TrtServerPtr server, UniqTritonT< TRITONSERVER_InferenceResponse > data, uint64_t id)
	Constructor. More...

Friends
class	TrtISServer

Constructor & Destructor Documentation

TrtServerResponse() [1/2]

nvdsinferserver::TrtServerResponse::TrtServerResponse ( TrtServerPtr  server, UniqTritonT< TRITONSERVER_InferenceResponse >  data, uint64_t  id  )

protected

Constructor.

Parameters

server	Handle to the server class instance.
data	Pointer to the inference result.
id	The corresponding request ID.

TrtServerResponse() [2/2]

nvdsinferserver::TrtServerResponse::TrtServerResponse ( TrtServerPtr  server, UniqTritonT< TRITONSERVER_InferenceResponse >  data, uint64_t  id  )

protected

Constructor.

Parameters

server	Handle to the server class instance.
data	Pointer to the inference result.
id	The corresponding request ID.

Member Function Documentation

getStatus() [1/2]

NvDsInferStatus nvdsinferserver::TrtServerResponse::getStatus ( ) const

inline

Check if the response could be parsed correctly.

Definition at line 256 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

getStatus() [2/2]

NvDsInferStatus nvdsinferserver::TrtServerResponse::getStatus ( ) const

inline

Check if the response could be parsed correctly.

Definition at line 256 of file 9.0/sources/libs/nvdsinferserver/infer_trtis_server.h.

model() [1/2]

const std::string& nvdsinferserver::TrtServerResponse::model ( ) const

inline

Get the model name parsed from the Triton response.

Definition at line 248 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

model() [2/2]

const std::string& nvdsinferserver::TrtServerResponse::model ( ) const

inline

Get the model name parsed from the Triton response.

Definition at line 248 of file 9.0/sources/libs/nvdsinferserver/infer_trtis_server.h.

mutableOutputs() [1/2]

std::vector<SharedBatchBuf>& nvdsinferserver::TrtServerResponse::mutableOutputs ( )

inline

Get the list of output batch buffers.

Definition at line 252 of file 9.0/sources/libs/nvdsinferserver/infer_trtis_server.h.

mutableOutputs() [2/2]

std::vector<SharedBatchBuf>& nvdsinferserver::TrtServerResponse::mutableOutputs ( )

inline

Get the list of output batch buffers.

Definition at line 252 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

parse() [1/2]

NvDsInferStatus nvdsinferserver::TrtServerResponse::parse

(

const TrtServerRequest *

req

)

Check for error and parse the inference output.

This functions checks the error status of the response and gets the model name and version from the response. It then call the parseParams() and parseOutputData() functions.

Parameters

req	Pointer to the corresponding Triton request.

Returns

NVDSINFER_SUCCESS or NVDSINFER_TRITON_ERROR.

parse() [2/2]

NvDsInferStatus nvdsinferserver::TrtServerResponse::parse

(

const TrtServerRequest *

req

)

Check for error and parse the inference output.

This functions checks the error status of the response and gets the model name and version from the response. It then call the parseParams() and parseOutputData() functions.

Parameters

req	Pointer to the corresponding Triton request.

Returns

NVDSINFER_SUCCESS or NVDSINFER_TRITON_ERROR.

takeoverOptions() [1/2]

SharedOptions nvdsinferserver::TrtServerResponse::takeoverOptions ( )

inline

Get and own the options list.

Definition at line 260 of file 9.0/sources/libs/nvdsinferserver/infer_trtis_server.h.

takeoverOptions() [2/2]

SharedOptions nvdsinferserver::TrtServerResponse::takeoverOptions ( )

inline

Get and own the options list.

Definition at line 260 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

Friends And Related Function Documentation

TrtISServer

TrtISServer

friend

Definition at line 220 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

---

The documentation for this class was generated from the following file:

• sources/libs/nvdsinferserver/infer_trtis_server.h