Is this page helpful?

`core.inference.disaggregation.handoff_wire_protocol`#

Wire payload construction and validation for prefill/decode handoff.

Module Contents#

Functions#

`strip_registered_nixl_agent_metadata`	Remove NIXL agent blobs already registered with the coordinator.
`_registered_nixl_agents`	Index agent metadata recursively across TP/PP instance registration.
`restore_registered_nixl_agent_metadata`	Restore and validate NIXL agent blobs from engine registration.

Data#

`_NIXL_AGENT_NAME`
`_NIXL_AGENT_METADATA`

API#

core.inference.disaggregation.handoff_wire_protocol._NIXL_AGENT_NAME#: ‘agent_name’

core.inference.disaggregation.handoff_wire_protocol._NIXL_AGENT_METADATA#: ‘agent_metadata_b64’

core.inference.disaggregation.handoff_wire_protocol.strip_registered_nixl_agent_metadata(value: Any) → Any#: Remove NIXL agent blobs already registered with the coordinator.

core.inference.disaggregation.handoff_wire_protocol._registered_nixl_agents( instance_meta: Any, ) → Dict[str, str]#: Index agent metadata recursively across TP/PP instance registration.

core.inference.disaggregation.handoff_wire_protocol.restore_registered_nixl_agent_metadata( value: Any, instance_meta: Any, ) → Any#: Restore and validate NIXL agent blobs from engine registration.