Class IInferenceClient

class IInferenceClient

Subclassed by morpheus::TritonInferenceClient

Public Functions

virtual ~IInferenceClient() = default

virtual std::unique_ptr<IInferenceClientSession> create_session() = 0

Creates an inference session.

Previous Class HttpTritonClient
Next Class IInferenceClientSession
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.