morpheus.messages.multi_inference_message

Functions

`get_input`(instance, name)	Getter function used with DataClassProp for getting inference input from message containers derived from InferenceMemory.
`set_input`(instance, name, value)	Setter function used with DataClassProp for setting inference input in message containers derived from InferenceMemory.

Classes

`InferenceMemory`(args, *kwargs)	This is a base container class for data that will be used for inference stages.
`InferenceMemoryAE`(args, *kwargs)	This is a container class for data that needs to be submitted to the inference server for auto encoder usecases.
`InferenceMemoryFIL`(args, *kwargs)	This is a container class for data that needs to be submitted to the inference server for FIL category usecases.
`InferenceMemoryNLP`(args, *kwargs)	This is a container class for data that needs to be submitted to the inference server for NLP category usecases.
`MultiInferenceFILMessage`(args, *kwargs)	A stronger typed version of `MultiInferenceMessage` that is used for FIL workloads.
`MultiInferenceMessage`(args, *kwargs)	This is a container class that holds the TensorMemory container and the metadata of the data contained within it.
`MultiInferenceNLPMessage`(args, *kwargs)	A stronger typed version of `MultiInferenceMessage` that is used for NLP workloads.

get_input(instance, name)[source]

Getter function used with DataClassProp for getting inference input from message containers derived from InferenceMemory.

Parameters

instance<bsp-code-inline code="<a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a>"><a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a></bsp-code-inline>: Message container holding inputs.
namestr: Key used to do lookup in inputs dict of message container.

Returns

Raises

set_input(instance, name, value)[source]

Setter function used with DataClassProp for setting inference input in message containers derived from InferenceMemory.

Parameters

instance<bsp-code-inline code="<a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a>"><a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a></bsp-code-inline>: Message container holding inputs.
namestr: Key used to do lookup in inputs dict of message container.
valuecupy.ndarray: Value to set for input.