Class TritonInferenceClient

class TritonInferenceClient : public morpheus::IInferenceClient

Public Functions

TritonInferenceClient(std::unique_ptr<ITritonClient> &&client, std::string model_name)

virtual std::unique_ptr<IInferenceClientSession> create_session() override

Creates a TritonInferenceClientSession.

Previous Class TensorMemory
Next Class TritonInferenceClientSession
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.