Function TRITONSERVER_ServerOptionsSetModelControlMode¶
Defined in File tritonserver.h
Function Documentation¶
-
TRITONSERVER_Error *
TRITONSERVER_ServerOptionsSetModelControlMode
(TRITONSERVER_ServerOptions *options, TRITONSERVER_ModelControlMode mode)¶ Set the model control mode in a server options.
For each mode the models will be managed as the following:
TRITONSERVER_MODEL_CONTROL_NONE: the models in model repository will be loaded on startup. After startup any changes to the model repository will be ignored. Calling TRITONSERVER_ServerPollModelRepository will result in an error.
TRITONSERVER_MODEL_CONTROL_POLL: the models in model repository will be loaded on startup. The model repository can be polled periodically using TRITONSERVER_ServerPollModelRepository and the server will load, unload, and updated models according to changes in the model repository.
TRITONSERVER_MODEL_CONTROL_EXPLICIT: the models in model repository will not be loaded on startup. The corresponding model control APIs must be called to load / unload a model in the model repository.
- Return
a TRITONSERVER_Error indicating success or failure.
- Parameters
options
: The server options object.mode
: The mode to use for the model control.