aiq.runtime.session#

Attributes#

_T

Classes#

UserManagerBase

AIQSessionManager

The AIQRunner class is used to run a workflow. It handles converting input and output data types and running the

Module Contents#

_T#
class UserManagerBase#
class AIQSessionManager(
workflow: aiq.builder.workflow.Workflow,
max_concurrency: int = 8,
)#

The AIQRunner class is used to run a workflow. It handles converting input and output data types and running the workflow with the specified concurrency.

Parameters#

workflowWorkflow

The workflow to run

max_concurrencyint, optional

The maximum number of simultaneous workflow invocations, by default 8

_workflow: aiq.builder.workflow.Workflow#
_max_concurrency = 8#
_context_state#
_context#
_saved_context#
property config: aiq.data_models.config.AIQConfig#
property workflow: aiq.builder.workflow.Workflow#
property context: aiq.builder.context.AIQContext#
async session(
user_manager=None,
user_input_callback: collections.abc.Callable[[aiq.data_models.interactive.InteractionPrompt], collections.abc.Awaitable[aiq.data_models.interactive.HumanResponse]] = None,
)#
async run(message)#

Start a workflow run