core.inference.data_parallel_inference_coordinator

Data parallel inference coordinator package.

The coordinator class itself lives in coordinator.py; message handlers are in handlers.py and the control-signal state machine in state.py. This module re-exports the public names so existing imports of megatron.core.inference.data_parallel_inference_coordinator keep working.

Submodules

• core.inference.data_parallel_inference_coordinator.state
• core.inference.data_parallel_inference_coordinator.handlers
• core.inference.data_parallel_inference_coordinator.coordinator

Package Contents

Data

__all__

API

core.inference.data_parallel_inference_coordinator.__all__

[‘DataParallelInferenceCoordinator’, ‘CoordinatorState’, ‘ControlTransition’, ‘CONTROL_TRANSITIONS’,…