core.inference.headers

Message headers for inference coordinator/engine/client communication.

Headers are grouped into category IntEnum classes by concern. Each category occupies a distinct numeric range so that wire values never collide across categories. Adding a new class of headers means adding a new category enum in its own range and listing it in HEADER_ENUMS; the existing categories are left untouched.

On the wire a header travels as its integer value. decode_header maps an integer back to the originating category member.

Module Contents

Classes

Connection	Client <-> coordinator handshake.
Request	Inference request submission and completion reply.
Control	Runtime control signals broadcast to engines.
Lifecycle	Process lifecycle signals.
Transport	Low-level transport framing.
_Headers	Flat, read-only union over every header category.

Functions

_build_tables	Index every header by wire value and by name, asserting no collisions.
decode_header	Resolve an integer wire value to its category header member.

Data

HEADER_ENUMS
Headers

API

class core.inference.headers.Connection

Bases: enum.IntEnum

Client <-> coordinator handshake.

Initialization

Initialize self. See help(type(self)) for accurate signature.

CONNECT

0

CONNECT_ACK

1

class core.inference.headers.Request

Bases: enum.IntEnum

Inference request submission and completion reply.

Initialization

Initialize self. See help(type(self)) for accurate signature.

SUBMIT_REQUEST

20

ENGINE_REPLY

21

ENGINE_REPLY_PARTIAL

22

ABORT_REQUEST

23

class core.inference.headers.Control

Bases: enum.IntEnum

Runtime control signals broadcast to engines.

Initialization

Initialize self. See help(type(self)) for accurate signature.

PAUSE

40

UNPAUSE

41

SUSPEND

42

RESUME

43

SET_GENERATION_EPOCH

44

STOP

45

START_CUDA_PROFILER

46

STOP_CUDA_PROFILER

47

class core.inference.headers.Lifecycle

Bases: enum.IntEnum

Process lifecycle signals.

Initialization

Initialize self. See help(type(self)) for accurate signature.

DISCONNECT

60

SHUTDOWN

61

class core.inference.headers.Transport

Bases: enum.IntEnum

Low-level transport framing.

Initialization

Initialize self. See help(type(self)) for accurate signature.

TP_BROADCAST

80

core.inference.headers.HEADER_ENUMS

()

exception core.inference.headers.UnknownHeaderError(header)

Bases: Exception

A signal with an unrecognized header was received.

Initialization

Initialize self. See help(type(self)) for accurate signature.

core.inference.headers._build_tables()

Index every header by wire value and by name, asserting no collisions.

core.inference.headers.decode_header(value)

Resolve an integer wire value to its category header member.

Parameters:

value (int) – The integer header value read off the wire.

Returns:

The corresponding category enum member (e.g. Control.PAUSE).

Raises:

UnknownHeaderError – if no header is registered for value.

class core.inference.headers._Headers

Flat, read-only union over every header category.

Lets callers use a single name without caring which category a header lives in: attribute access (Headers.PAUSE) resolves to the underlying category member (Control.PAUSE), and calling it (Headers(value)) decodes a wire value via decode_header. Because both return the canonical category members, equality and dict-key lookups against the categories work unchanged.

__call__(value)

__getattr__(name)

__iter__()

core.inference.headers.Headers

‘_Headers(…)’