Class IInferenceClientSession

(Latest Version)

Derived Type

class IInferenceClientSession

Subclassed by morpheus::TritonInferenceClientSession

Public Functions

virtual ~IInferenceClientSession() = default

virtual std::vector<TensorModelMapping> get_input_mappings(std::vector<TensorModelMapping> input_map_overrides) = 0

Gets the inference input mappings.

virtual std::vector<TensorModelMapping> get_output_mappings(std::vector<TensorModelMapping> output_map_overrides) = 0

Gets the inference output mappings.

virtual mrc::coroutines::Task<TensorMap> infer(TensorMap &&inputs) = 0

Invokes a single tensor inference.

Previous Class IInferenceClient
Next Class InferenceClientStage
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.