morpheus.messages.multi_inference_message.InferenceMemoryFIL

class InferenceMemoryFIL(*args, **kwargs)[source]

Bases: morpheus.messages.multi_inference_message.InferenceMemory

This is a container class for data that needs to be submitted to the inference server for FIL category usecases.

Parameters
input__0cupy.ndarray

Inference input.

seq_idscupy.ndarray

Ids used to index from an inference input to a message. Necessary since there can be more inference inputs than messages (i.e., if some messages get broken into multiple inference requests).

Attributes
input__0
seq_ids
© Copyright 2023, NVIDIA. Last updated on Feb 3, 2023.