morpheus.messages.memory.inference_memory
Classes
InferenceMemory(*[, count, tensors]) |
This is a base container class for data that will be used for inference stages. |
InferenceMemoryAE(*, count, inputs, seq_ids) |
This is a container class for data that needs to be submitted to the inference server for auto encoder usecases. |
InferenceMemoryFIL(*, count, input__0, seq_ids) |
This is a container class for data that needs to be submitted to the inference server for FIL category usecases. |
InferenceMemoryNLP(*, count, input_ids, ...) |
This is a container class for data that needs to be submitted to the inference server for NLP category usecases. |