Class InferRequest

Class Documentation

class InferRequest

The base class to describe an inflight inference request.

Public Functions

InferRequest(InferenceServerClient::OnCompleteFn callback = nullptr, const bool verbose = false)
virtual ~InferRequest()
RequestTimers &Timer()

Protected Attributes

InferenceServerClient::OnCompleteFn callback_
const bool verbose_