Class MultiResponseMessage

Base Type

class MultiResponseMessage : public morpheus::DerivedMultiMessage<MultiResponseMessage, MultiTensorMessage>

This class is used to get or set the inference output from message containers derived from ResponseMemory.

Public Functions

MultiResponseMessage(const MultiResponseMessage &other) = default

Default copy constructor.

MultiResponseMessage(std::shared_ptr<MessageMeta> meta, std::size_t mess_offset, std::size_t mess_count, std::shared_ptr<ResponseMemory> memory, std::size_t offset, std::size_t count)

Construct a new Multi Response Message object.

Parameters
  • meta – Holds a data table, in practice a cudf DataFrame, with the ability to return both Python and C++ representations of the table

  • mess_offset – Offset into the metadata batch

  • mess_count – Messages count

  • memory – Shared pointer of a tensor memory

  • offset – Message offset in inference memory instance

  • count – Message count in inference memory instance

const TensorObject get_output(const std::string &name) const

Returns the output tensor with the given name. Will halt on a fatal error if the tensor does not exist.

Parameters

name

Returns

const TensorObject

TensorObject get_output(const std::string &name)

Returns the output tensor with the given name. Will halt on a fatal error if the tensor does not exist.

Parameters

name

Returns

TensorObject

void set_output(const std::string &name, const TensorObject &value)

Update the value of a given output tensor. The tensor must already exist, otherwise this will halt on a fatal error.

Parameters
  • name

  • value

© Copyright 2023, NVIDIA. Last updated on Feb 3, 2023.