morpheus.messages.multi_inference_message

Functions

get_input(instance, name)

Getter function used with DataClassProp for getting inference input from message containers derived from InferenceMemory.

set_input(instance, name, value)

Setter function used with DataClassProp for setting inference input in message containers derived from InferenceMemory.

Classes

InferenceMemory(*args, **kwargs)

This is a base container class for data that will be used for inference stages.

InferenceMemoryAE(*args, **kwargs)

This is a container class for data that needs to be submitted to the inference server for auto encoder usecases.

InferenceMemoryFIL(*args, **kwargs)

This is a container class for data that needs to be submitted to the inference server for FIL category usecases.

InferenceMemoryNLP(*args, **kwargs)

This is a container class for data that needs to be submitted to the inference server for NLP category usecases.

MultiInferenceFILMessage(*args, **kwargs)

A stronger typed version of MultiInferenceMessage that is used for FIL workloads.

MultiInferenceMessage(*args, **kwargs)

This is a container class that holds the TensorMemory container and the metadata of the data contained within it.

MultiInferenceNLPMessage(*args, **kwargs)

A stronger typed version of MultiInferenceMessage that is used for NLP workloads.

get_input(instance, name)[source]

Getter function used with DataClassProp for getting inference input from message containers derived from InferenceMemory.

Parameters
instance<bsp-code-inline code="<a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a>"><a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a></bsp-code-inline>

Message container holding inputs.

namestr

Key used to do lookup in inputs dict of message container.

Returns
cupy.ndarray

Inputs corresponding to name.

Raises
AttributeError

If input name does not exist in message container.

set_input(instance, name, value)[source]

Setter function used with DataClassProp for setting inference input in message containers derived from InferenceMemory.

Parameters
instance<bsp-code-inline code="<a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a>"><a href="morpheus.messages.html#morpheus.messages.InferenceMemory">InferenceMemory</a></bsp-code-inline>

Message container holding inputs.

namestr

Key used to do lookup in inputs dict of message container.

valuecupy.ndarray

Value to set for input.

© Copyright 2023, NVIDIA. Last updated on Feb 3, 2023.