core.inference.engines.abstract_engine

Module Contents

Classes

AbstractEngine

API

class core.inference.engines.abstract_engine.AbstractEngine

Bases: abc.ABC

abstractmethod static generate() → dict

The abstract backend’s generate function.

To define a new backend, implement this and return the outputs as a dictionary.

Returns:

The output dictionary containing keys for input_prompt, generated_text, generated_tokens.

Return type:

dict