Is this page helpful?

`core.inference.disaggregation.utils`#

Shared helpers for the disaggregation modules.

Module Contents#

Functions#

`intersect`	Overlap of two half-open `[lo, hi)` ranges, or `None` if disjoint.
`transfers_for_src`	Transfers in `plan` originating from `src_rank` (any KV/Mamba reshard transfer – both expose a `src_rank` field).
`transfers_for_dst`	Transfers in `plan` destined for `dst_rank`.

API#

core.inference.disaggregation.utils.intersect( a: Tuple[int, int], b: Tuple[int, int], ) → Optional[Tuple[int, int]]#: Overlap of two half-open [lo, hi) ranges, or None if disjoint.

core.inference.disaggregation.utils.transfers_for_src(plan, src_rank)#: Transfers in plan originating from src_rank (any KV/Mamba reshard transfer – both expose a src_rank field).

core.inference.disaggregation.utils.transfers_for_dst(plan, dst_rank)#: Transfers in plan destined for dst_rank.