Defined in File inference_client_stage.hpp
-
struct InferenceClientStageInterfaceProxy
Interface proxy, used to insulate python bindings.
Public Static Functions
-
static std::shared_ptr<mrc::segment::Object<InferenceClientStage>> init(mrc::segment::Builder &builder, const std::string &name, std::string model_name, std::string server_url, bool needs_logits, std::map<std::string, std::string> input_mapping, std::map<std::string, std::string> output_mapping)
Create and initialize a InferenceClientStage, and return the result.
- Parameters
builder – : Pipeline context object reference
name – : Name of a stage reference
model_name – : Name of the model specifies which model can handle the inference requests that are sent to Triton inference
server_url – : Triton server URL.
needs_logits – : Determines if logits are required.
inout_mapping – : Dictionary used to map pipeline input/output names to Triton input/output names. Use this if the Morpheus names do not match the model.
- Returns
std::shared_ptr<mrc::segment::Object<InferenceClientStage>>
-
static std::shared_ptr<mrc::segment::Object<InferenceClientStage>> init(mrc::segment::Builder &builder, const std::string &name, std::string model_name, std::string server_url, bool needs_logits, std::map<std::string, std::string> input_mapping, std::map<std::string, std::string> output_mapping)