Class HttpTritonClient

(Latest Version)
class HttpTritonClient : public morpheus::ITritonClient

Public Functions

HttpTritonClient(std::string server_url)

virtual triton::client::Error is_server_live(bool *live) override

Checks if Triton Server is live using HTTP protocal.

virtual triton::client::Error is_server_ready(bool *ready) override

Checks if Triton Server is ready using HTTP protocal.

virtual triton::client::Error is_model_ready(bool *ready, std::string &model_name) override

Checks if the given model is ready using HTTP protocal.

virtual triton::client::Error model_config(std::string *model_config, std::string &model_name) override

Gets the config for the given model using HTTP protocal.

virtual triton::client::Error model_metadata(std::string *model_metadata, std::string &model_name) override

Gets metadata for the given model using HTTP protocal.

virtual triton::client::Error async_infer(triton::client::InferenceServerHttpClient::OnCompleteFn callback, const triton::client::InferOptions &options, const std::vector<TritonInferInput> &inputs, const std::vector<TritonInferRequestedOutput> &outputs) override

Runs Triton Server inference given the model options, inputs, and outputs, using HTTP protocal.

Previous Class HttpServerSourceStage
Next Class IInferenceClient
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.