Class MultiResponseMessage

• Defined in File multi_response.hpp

Base Type

• public morpheus::DerivedMultiMessage< MultiResponseMessage, MultiTensorMessage > (Template Class DerivedMultiMessage)

class MultiResponseMessage : public morpheus::DerivedMultiMessage<MultiResponseMessage, MultiTensorMessage>

This class is used to get or set the inference output from message containers derived from ResponseMemory.

Public Functions

MultiResponseMessage(const MultiResponseMessage &other) = default

Default copy constructor.

MultiResponseMessage(std::shared_ptr<MessageMeta> meta, std::size_t mess_offset, std::size_t mess_count, std::shared_ptr<ResponseMemory> memory, std::size_t offset, std::size_t count)

Construct a new Multi Response Message object.

Parameters

• meta – Holds a data table, in practice a cudf DataFrame, with the ability to return both Python and C++ representations of the table

• mess_offset – Offset into the metadata batch

• mess_count – Messages count

• memory – Shared pointer of a tensor memory

• offset – Message offset in inference memory instance

• count – Message count in inference memory instance

const TensorObject get_output(const std::string &name) const

Returns the output tensor with the given name. Will halt on a fatal error if the tensor does not exist.

Parameters

name –

Returns

const TensorObject

TensorObject get_output(const std::string &name)

Returns the output tensor with the given name. Will halt on a fatal error if the tensor does not exist.

Parameters

name –

Returns

TensorObject

void set_output(const std::string &name, const TensorObject &value)

Update the value of a given output tensor. The tensor must already exist, otherwise this will halt on a fatal error.

Parameters

• name –

• value –