Is this page helpful?

core.inference.data_parallel_inference_coordinator.state#

State machine definitions for the data parallel inference coordinator.

Module Contents#

Classes#

CoordinatorState

State machine for the coordinator.

ControlTransition

A single rule in the control-signal state machine.

Data#

_ALL_STATES

CONTROL_TRANSITIONS

API#

class core.inference.data_parallel_inference_coordinator.state.CoordinatorState(*args, **kwds)#

Bases: enum.Enum

State machine for the coordinator.

Initialization

RUNNING#

‘auto(…)’

PAUSED#

‘auto(…)’

SUSPENDED#

‘auto(…)’

STOPPING#

‘auto(…)’

core.inference.data_parallel_inference_coordinator.state._ALL_STATES#

‘frozenset(…)’

class core.inference.data_parallel_inference_coordinator.state.ControlTransition#

A single rule in the control-signal state machine.

.. attribute:: allowed_from

States the signal may be applied from.

.. attribute:: new_state

State to move to once applied, or None to leave the state unchanged (e.g. a pure broadcast such as SET_GENERATION_EPOCH).

.. attribute:: idempotent_in

States in which the signal is a silent no-op rather than a logged rejection (e.g. a redundant PAUSE while already paused).

allowed_from: frozenset#

None

new_state: core.inference.data_parallel_inference_coordinator.state.CoordinatorState | None#

None

idempotent_in: frozenset#

‘field(…)’

core.inference.data_parallel_inference_coordinator.state.CONTROL_TRANSITIONS#

None