bridge.training.deepep#

Module Contents#

Functions#

apply_deepep

Apply DeepEP optimizations to the model config.

validate_deepep

Validate DeepEP is supported for the current GPU architecture.

API#

bridge.training.deepep.apply_deepep(
model_config: megatron.core.transformer.TransformerConfig,
) None#

Apply DeepEP optimizations to the model config.

bridge.training.deepep.validate_deepep(
model_config: megatron.core.transformer.TransformerConfig,
) None#

Validate DeepEP is supported for the current GPU architecture.