Class IInferenceClientSession

• Defined in File inference_client_stage.hpp

Inheritance Relationships

Derived Type

• public morpheus::TritonInferenceClientSession (Class TritonInferenceClientSession)

Class Documentation

class IInferenceClientSession

Subclassed by morpheus::TritonInferenceClientSession

Public Functions

virtual ~IInferenceClientSession() = default

virtual std::vector<TensorModelMapping> get_input_mappings(

std::vector<TensorModelMapping> input_map_overrides

) = 0

Gets the inference input mappings.

virtual std::vector<TensorModelMapping> get_output_mappings(

std::vector<TensorModelMapping> output_map_overrides

) = 0

Gets the inference output mappings.

virtual mrc::coroutines::Task<TensorMap> infer(

TensorMap &&inputs

) = 0

Invokes a single tensor inference.