Class TritonInferenceClient

(Latest Version)
class TritonInferenceClient : public morpheus::IInferenceClient

Public Functions

TritonInferenceClient(std::unique_ptr<ITritonClient> &&client, std::string model_name, bool force_convert_inputs)

virtual std::unique_ptr<IInferenceClientSession> create_session() override

Creates a TritonInferenceClientSession.

Previous Class TensorMemory
Next Class TritonInferenceClientSession
© Copyright 2024, NVIDIA. Last updated on Jul 8, 2024.