core.inference.disaggregation.transfer_backends

KV transfer backends for disaggregated inference.

Submodules

• core.inference.disaggregation.transfer_backends.nixl
• core.inference.disaggregation.transfer_backends.nccl
• core.inference.disaggregation.transfer_backends.base

Package Contents

Data

__all__

API

core.inference.disaggregation.transfer_backends.__all__

[‘KVTransportBackend’, ‘construct_kv_transfer_backend_class’]