morpheus.messages.memory.inference_memory

Classes

InferenceMemory(*[, count, tensors]) This is a base container class for data that will be used for inference stages.
InferenceMemoryAE(*, count, input, seq_ids) This is a container class for data that needs to be submitted to the inference server for auto encoder usecases.
InferenceMemoryFIL(*, count, input__0, seq_ids) This is a container class for data that needs to be submitted to the inference server for FIL category usecases.
InferenceMemoryNLP(*, count, input_ids, ...) This is a container class for data that needs to be submitted to the inference server for NLP category usecases.
Previous morpheus.messages.memory
Next morpheus.messages.memory.inference_memory.InferenceMemory
© Copyright 2023, NVIDIA. Last updated on Feb 2, 2024.