Class InferContext::Options¶
Defined in File request.h
Nested Relationships¶
This class is a nested type of Class InferContext.
Class Documentation¶
-
class
Options
Run options to be applied to all subsequent Run() invocations.
Public Functions
-
virtual
~Options
() = 0
-
virtual bool
Flag
(InferRequestHeader::Flag flag) const = 0 Get the value of a request flag being used for all subsequent inferences.
Cannot be used with FLAG_NONE.
- Return
The true/false value currently set for the flag. If ‘flag’ is FLAG_NONE then return false.
- Parameters
flag
: The flag to get the value for.
-
virtual void
SetFlag
(InferRequestHeader::Flag flag, bool value) = 0 Set a request flag to be used for all subsequent inferences.
- Parameters
flag
: The flag to set. Cannot be used with FLAG_NONE.value
: The true/false value to set for the flag. If ‘flag’ is FLAG_NONE then do nothing.
-
virtual uint32_t
Flags
() const = 0 Get the value of all request flags being used for all subsequent inferences.
- Return
The bitwise-or of flag values as a single uint32_t value.
-
virtual void
SetFlags
(uint32_t flags) = 0 Set all request flags to be used for all subsequent inferences.
- Parameters
flags
: The bitwise-or of flag values to set.
-
virtual size_t
BatchSize
() const = 0 - Return
The batch size to use for all subsequent inferences.
-
virtual void
SetBatchSize
(size_t batch_size) = 0 Set the batch size to use for all subsequent inferences.
- Parameters
batch_size
: The batch size.
-
virtual