Wrapper class for Triton inference request.
Definition at line 68 of file infer_trtis_server.h.
|
static void | RequestOnRelease (TRITONSERVER_InferenceRequest *request, const uint32_t flags, void *userp) |
| The callback function to release the request instance. More...
|
|
◆ TrtServerRequest()
nvdsinferserver::TrtServerRequest::TrtServerRequest |
( |
TrtServerPtr |
server | ) |
|
|
protected |
Constructor.
Save the server instance pointer and register the Triton request deletion function.
- Parameters
-
◆ ~TrtServerRequest()
nvdsinferserver::TrtServerRequest::~TrtServerRequest |
( |
| ) |
|
Destructor.
Releases the Triton inference request instance.
◆ bufId()
uint64_t nvdsinferserver::TrtServerRequest::bufId |
( |
| ) |
const |
|
inline |
◆ classParams()
const std::map<std::string, TritonClassParams>& nvdsinferserver::TrtServerRequest::classParams |
( |
| ) |
const |
|
inline |
Get the Triton classification parameters list (tensor name : classification parameters).
Definition at line 161 of file infer_trtis_server.h.
◆ id()
uint64_t nvdsinferserver::TrtServerRequest::id |
( |
| ) |
const |
|
inline |
◆ init()
NvDsInferStatus nvdsinferserver::TrtServerRequest::init |
( |
const std::string & |
model, |
|
|
int64_t |
version, |
|
|
SharedBatchArray & |
inputs, |
|
|
const std::vector< std::string > & |
outputs, |
|
|
uint64_t |
reqId, |
|
|
const std::vector< TritonClassParams > & |
clasList |
|
) |
| |
|
protected |
Create a new Triton inference request with the specified inputs and parameters.
- Parameters
-
[in] | model | Model name. |
[in] | version | Model version. |
[in] | inputs | Array of input batch buffers. |
[in] | outputs | List of names of required output tensors. |
[in] | reqId | ID of this request. |
[in] | clasList | Triton classification parameters, if any. |
- Returns
- NVDSINFER_SUCCESS or NVDSINFER_TRITON_ERROR.
◆ model()
const std::string& nvdsinferserver::TrtServerRequest::model |
( |
| ) |
const |
|
inline |
◆ outputs()
const std::vector<std::string>& nvdsinferserver::TrtServerRequest::outputs |
( |
| ) |
const |
|
inline |
◆ ptr()
TRITONSERVER_InferenceRequest* nvdsinferserver::TrtServerRequest::ptr |
( |
| ) |
|
|
inline |
◆ releaseInputs()
Release the ownership of input batch buffer array.
- Returns
- Shared pointer to the input array.
Definition at line 152 of file infer_trtis_server.h.
◆ RequestOnRelease()
static void nvdsinferserver::TrtServerRequest::RequestOnRelease |
( |
TRITONSERVER_InferenceRequest * |
request, |
|
|
const uint32_t |
flags, |
|
|
void * |
userp |
|
) |
| |
|
staticprotected |
The callback function to release the request instance.
- Parameters
-
[in] | request | Pointer to the request. |
[in] | flags | Flags associated with the callback. |
[in] | userp | User data pointer. |
◆ setRequestComplete()
Set the release callback function for the request.
- Parameters
-
[in] | requestCompleteCb | The request release callback function. |
[in] | userPtr | The user data pointer for the callback. |
- Returns
- NVDSINFER_SUCCESS or NVDSINFER_TRITON_ERROR.
◆ setResponseComplete()
Set the allocator and response callback for the request.
- Parameters
-
[in] | allocator | Pointer to the output allocator instance. |
[in] | responseCompleteCb | The response callback function. |
[in] | responseUserPtr | The user data pointer. |
- Returns
- NVDSINFER_SUCCESS or NVDSINFER_TRITON_ERROR.
◆ TrtISServer
The documentation for this class was generated from the following file: