core.inference.disaggregation

Subpackages

• core.inference.disaggregation.transfer_backends
  • core.inference.disaggregation.transfer_backends.nixl
  • core.inference.disaggregation.transfer_backends.nccl
  • core.inference.disaggregation.transfer_backends.base

Submodules

• core.inference.disaggregation.ssm_reshard
• core.inference.disaggregation.pending_handoff_imports
• core.inference.disaggregation.utils
• core.inference.disaggregation.inference_state_handoff
• core.inference.disaggregation.engine
• core.inference.disaggregation.kv_reshard
• core.inference.disaggregation.handoff_completion_tracker
• core.inference.disaggregation.decode_admission