Class ServerStatusGrpcContext

Class Documentation

class ServerStatusGrpcContext

ServerStatusGrpcContext is the GRPC instantiation of ServerStatusContext.

Public Static Functions

static Error Create(std::unique_ptr<ServerStatusContext> *ctx, const std::string &server_url, bool verbose = false)

Create a context that returns information about an inference server and all models on the server using GRPC protocol.

Return

Error object indicating success or failure.

Parameters
  • ctx: Returns a new ServerStatusGrpcContext object.

  • server_url: The inference server name and port.

  • verbose: If true generate verbose output when contacting the inference server.

static Error Create(std::unique_ptr<ServerStatusContext> *ctx, const std::string &server_url, const std::string &model_name, bool verbose = false)

Create a context that returns information about an inference server and one model on the sever using GRPC protocol.

Return

Error object indicating success or failure.

Parameters
  • ctx: Returns a new ServerStatusGrpcContext object.

  • server_url: The inference server name and port.

  • model_name: The name of the model to get status for.

  • verbose: If true generate verbose output when contacting the inference server.