Defined in File inference_client_stage.hpp
Derived Type
public morpheus::TritonInferenceClientSession(Class TritonInferenceClientSession)
-
class IInferenceClientSession
Subclassed by morpheus::TritonInferenceClientSession
Public Functions
- virtual ~IInferenceClientSession() = default
- virtual std::vector<TensorModelMapping> get_input_mappings(std::vector<TensorModelMapping> input_map_overrides) = 0
Gets the inference input mappings.
- virtual std::vector<TensorModelMapping> get_output_mappings(std::vector<TensorModelMapping> output_map_overrides) = 0
Gets the inference output mappings.
- virtual mrc::coroutines::Task<TensorMap> infer(TensorMap &&inputs) = 0
Invokes a single tensor inference.