Function TRITONSERVER_ServerModelStatistics

Function Documentation

TRITONSERVER_Error *TRITONSERVER_ServerModelStatistics(TRITONSERVER_Server *server, const char *model_name, const int64_t model_version, TRITONSERVER_Message **model_stats)

Get the statistics of the model being served as a TRITONSERVER_Message object.

The caller takes ownership of the object and must call TRITONSERVER_MessageDelete to release the object.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • server: The inference server object.

  • model_name: The name of the model to get statistics for. If empty, then statistics for all available models will be returned, and the server will choose a version based on those models’ policies.

  • model_version: The version of the model to get statistics for. If -1 then the server will choose a version based on the model’s policy.

  • model_stats: Returns the model statistics message.