Enum tritonserver_requestflag_enum

Enum Documentation

enum tritonserver_requestflag_enum

TRITONSERVER_InferenceRequest.

Object representing an inference request. The inference request provides the meta-data and input tensor values needed for an inference and returns the inference result meta-data and output tensors. An inference request object can be modified and reused multiple times.Inference request flags. The enum values must be power-of-2 values.

Values:

TRITONSERVER_REQUEST_FLAG_SEQUENCE_START = 1
TRITONSERVER_REQUEST_FLAG_SEQUENCE_END = 2