Class InferContext::Options¶
Defined in File request.h
Nested Relationships¶
This class is a nested type of Class InferContext.
Class Documentation¶
-
class
Options Run options to be applied to all subsequent Run() invocations.
Public Functions
-
virtual
~Options() = 0
-
virtual bool
Flag(InferRequestHeader::Flag flag) const = 0 Get the value of a request flag being used for all subsequent inferences.
Cannot be used with FLAG_NONE.
- Return
The true/false value currently set for the flag. If ‘flag’ is FLAG_NONE then return false.
- Parameters
flag: The flag to get the value for.
-
virtual void
SetFlag(InferRequestHeader::Flag flag, bool value) = 0 Set a request flag to be used for all subsequent inferences.
- Parameters
flag: The flag to set. Cannot be used with FLAG_NONE.value: The true/false value to set for the flag. If ‘flag’ is FLAG_NONE then do nothing.
-
virtual uint32_t
Flags() const = 0 Get the value of all request flags being used for all subsequent inferences.
- Return
The bitwise-or of flag values as a single uint32_t value.
-
virtual void
SetFlags(uint32_t flags) = 0 Set all request flags to be used for all subsequent inferences.
- Parameters
flags: The bitwise-or of flag values to set.
-
virtual size_t
BatchSize() const = 0 - Return
The batch size to use for all subsequent inferences.
-
virtual void
SetBatchSize(size_t batch_size) = 0 Set the batch size to use for all subsequent inferences.
- Parameters
batch_size: The batch size.
-
virtual