Class ServerStatusContext¶
- Defined in File request.h
Inheritance Relationships¶
Derived Types¶
public nvidia::inferenceserver::client::ServerStatusGrpcContext
(Class ServerStatusGrpcContext)public nvidia::inferenceserver::client::ServerStatusHttpContext
(Class ServerStatusHttpContext)
Class Documentation¶
-
class
ServerStatusContext
¶ A ServerStatusContext object is used to query an inference server for status information, including information about the models available on that server.
Once created a ServerStatusContext object can be used repeatedly to get status from the server. A ServerStatusContext object can use either HTTP protocol or gRPC protocol depending on the Create function (ServerStatusHttpContext::Create or ServerStatusGrpcContext::Create). For example:
std::unique_ptr<ServerStatusContext> ctx; ServerStatusHttpContext::Create(&ctx, "localhost:8000"); ServerStatus status; ctx->GetServerStatus(&status); ... ctx->GetServerStatus(&status); ...
- Note
- ServerStatusContext::Create methods are thread-safe. GetServerStatus() is not thread-safe. For a given ServerStatusContext, calls to GetServerStatus() must be serialized.
Subclassed by nvidia::inferenceserver::client::ServerStatusGrpcContext, nvidia::inferenceserver::client::ServerStatusHttpContext
Public Functions
-
virtual Error
GetServerStatus
(ServerStatus *status) = 0¶ Contact the inference server and get status.
- Return
- Error object indicating success or failure of the request.
- Parameters
status
: Returns the status.
Protected Functions
-
ServerStatusContext
(bool)¶
Protected Attributes
-
const bool
verbose_
¶