Class ModelRepositoryContext¶

Defined in File request.h

Class Documentation¶

class ModelRepositoryContext¶

A ModelRepositoryContext object is used to query an inference server for model repository information, including information about the models within the model repository.

Once created a ModelRepositoryContext object can be used repeatedly to get information from the server. A ModelRepositoryContext object can use either HTTP protocol or GRPC protocol depending on the Create function (ModelRepositoryHttpContext::Create or ModelRepositoryGrpcContext::Create). For example:

std::unique_ptr<ModelRepositoryContext> ctx;
ModelRepositoryHttpContext::Create(&ctx, "localhost:8000");
ModelRepositoryIndex index;
ctx->GetModelRepositoryIndex(&index);
...
ctx->GetModelRepositoryIndex(&index);
...

Note: ModelRepositoryContext::Create methods are thread-safe. GetModelRepositoryIndex() is not thread-safe. For a given ModelRepositoryContext, calls to GetModelRepositoryIndex() must be serialized.

Public Functions

virtual ~ModelRepositoryContext() = 0¶

virtual Error GetModelRepositoryIndex(ModelRepositoryIndex *index) = 0¶

Contact the inference server and get the index of the model repository.

Return

Error object indicating success or failure of the request.

Parameters

index: Returns the index of the model repository.