Class InferRequest¶

Defined in File common.h

Class Documentation¶

class InferRequest¶

The base class to describe an inflight inference request.

Public Functions

InferRequest(InferenceServerClient::OnCompleteFn callback = nullptr, const bool verbose = false)¶

virtual ~InferRequest()¶

RequestTimers &Timer()¶

Protected Attributes

InferenceServerClient::OnCompleteFn callback_¶

const bool verbose_¶