Struct MultiResponseProbsMessageInterfaceProxy

• Defined in File multi_response_probs.hpp

Base Type

• public morpheus::MultiResponseMessageInterfaceProxy (Struct MultiResponseMessageInterfaceProxy)

struct MultiResponseProbsMessageInterfaceProxy : public morpheus::MultiResponseMessageInterfaceProxy

Interface proxy, used to insulate python bindings.

Public Static Functions

static std::shared_ptr<MultiResponseProbsMessage> init(std::shared_ptr<MessageMeta> meta, TensorIndex mess_offset, TensorIndex mess_count, std::shared_ptr<TensorMemory> memory, TensorIndex offset, TensorIndex count, std::string id_tensor_name, std::string probs_tensor_name)

Create and initialize a MultiResponseProbsMessage object, and return a shared pointer to the result.

Interface proxy, used to insulate python bindings.

Parameters

• meta – Holds a data table, in practice a cudf DataFrame, with the ability to return both Python and C++ representations of the table

• mess_offset – Offset into the metadata batch

• mess_count – Messages count

• memory – Holds the inference response probabilites as a tensor

• offset – Message offset in inference memory instance

• count – Message count in inference memory instance

• id_tensor_name – Name of the tensor that correlates tensor rows to message IDs

• probs_tensor_name – Name of the tensor that holds output probabilities

Returns

std::shared_ptr<MultiResponseProbsMessage>

static pybind11::object probs(MultiResponseProbsMessage &self)

Return the probs (probabilities) output tensor.

Parameters

self –

Throws

pybind11::attribute_error – When no tensor named “probs” exists.

Returns

pybind11::object