`bridge.training.mlm_compat.arguments`#

Module Contents#

Functions#

`_load_args_from_checkpoint`	Obtain argparse args object from an MLM checkpoint.
`_tokenizer_config_from_args`	Build TokenizerConfig from content of MLM argparse args object.
`_transformer_config_from_args`	Build a variant of TransformerConfig based on contents of the MLM argparse args object.

API#

bridge.training.mlm_compat.arguments._load_args_from_checkpoint(checkpoint_path: str) → argparse.Namespace#: Obtain argparse args object from an MLM checkpoint.

bridge.training.mlm_compat.arguments._tokenizer_config_from_args( args: argparse.Namespace, ) → megatron.bridge.training.config.TokenizerConfig#: Build TokenizerConfig from content of MLM argparse args object.

bridge.training.mlm_compat.arguments._transformer_config_from_args( args: argparse.Namespace, config_class: type[megatron.core.transformer.TransformerConfig] = TransformerConfig, ) → megatron.core.transformer.TransformerConfig#: Build a variant of TransformerConfig based on contents of the MLM argparse args object.