Function TRITONSERVER_ServerOptionsSetModelControlMode

Function Documentation

TRITONSERVER_Error *TRITONSERVER_ServerOptionsSetModelControlMode(TRITONSERVER_ServerOptions *options, TRITONSERVER_ModelControlMode mode)

Set the model control mode in a server options.

For each mode the models will be managed as the following:

TRITONSERVER_MODEL_CONTROL_NONE: the models in model repository will be loaded on startup. After startup any changes to the model repository will be ignored. Calling TRITONSERVER_ServerPollModelRepository will result in an error.

TRITONSERVER_MODEL_CONTROL_POLL: the models in model repository will be loaded on startup. The model repository can be polled periodically using TRITONSERVER_ServerPollModelRepository and the server will load, unload, and updated models according to changes in the model repository.

TRITONSERVER_MODEL_CONTROL_EXPLICIT: the models in model repository will not be loaded on startup. The corresponding model control APIs must be called to load / unload a model in the model repository.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • options: The server options object.

  • mode: The mode to use for the model control.