core.inference.disaggregation

Subpackages

• core.inference.disaggregation.transfer_backends
  • core.inference.disaggregation.transfer_backends.base
  • core.inference.disaggregation.transfer_backends.nixl
  • core.inference.disaggregation.transfer_backends.nccl

Submodules

• core.inference.disaggregation.inference_state_handoff
• core.inference.disaggregation.handoff_wire_protocol
• core.inference.disaggregation.coordinator_runtime
• core.inference.disaggregation.utils
• core.inference.disaggregation.pending_handoff_imports
• core.inference.disaggregation.decode_admission
• core.inference.disaggregation.coordinator_setup
• core.inference.disaggregation.handoff_ownership
• core.inference.disaggregation.engine
• core.inference.disaggregation.coordinator_scheduler
• core.inference.disaggregation.handoff_completion_tracker
• core.inference.disaggregation.kv_reshard
• core.inference.disaggregation.ssm_reshard