`bridge.training.utils.config_utils`#

Module Contents#

Classes#

_ConfigContainerBase

Bridge config container that lets composite HF configs construct their children.

Functions#

`create_ddp_config`	Create a finalized Bridge DDP config for external model construction.
`apply_run_config_backward_compat`	Apply backward compatibility transformations to run config.

Data#

logger

API#

bridge.training.utils.config_utils.logger#: ‘getLogger(…)’

class bridge.training.utils.config_utils._ConfigContainerBase#

Bases: megatron.training.config.container.ConfigContainerBase

Bridge config container that lets composite HF configs construct their children.

Nested PreTrainedConfig values are emitted as plain mappings because their parent config owns child construction. Other dataclasses retain MCore’s recursive _target_ serialization.

classmethod _convert_value_to_dict(value: Any) → Any#

classmethod _convert_recipe_config_to_dict( value: megatron.core.quantization.quant_config.RecipeConfig, ) → dict[str, Any]#: Convert an MCore quantization recipe to an instantiable mapping.

classmethod _convert_recipe_matcher_to_dict( matcher: megatron.core.quantization.quant_config.Matcher, ) → dict[str, Any]#: Convert a quantization recipe matcher to an instantiable mapping.

classmethod _convert_pretrained_config_to_dict( value: transformers.PreTrainedConfig, *, include_target: bool, ) → dict[str, Any]#

classmethod _convert_pretrained_config_value_to_dict( value: Any, ) → Any#

bridge.training.utils.config_utils.create_ddp_config( wrap_with_ddp: bool = True, use_distributed_optimizer: bool = True, use_megatron_fsdp: bool = False, overrides: Mapping[str, object] | None = None, finalize: bool = True, ) → object | None#: Create a finalized Bridge DDP config for external model construction.

bridge.training.utils.config_utils.apply_run_config_backward_compat( config_dict: dict[str, Any], ) → dict[str, Any]#

Apply backward compatibility transformations to run config.

This function handles dataclass config fields that should not be passed to the constructor when loading older checkpoints. It automatically detects init=False fields by inspecting the target class.

The entire config is sanitized recursively to handle init=False fields in any part of the configuration hierarchy.

Parameters:: config_dict – The full run configuration dictionary.
Returns:: The config dictionary with backward compatibility fixes applied.

bridge.training.utils.config_utils#