`bridge.recipes.qwen_vl.qwen3_vl`#

Module Contents#

Classes#

Qwen3VLCommonKwargs

Typed options accepted by Qwen3 VL MoE recipe helpers.

Functions#

`qwen3_vl_8b_pretrain_config`	Return a pre-training config for Qwen3-VL 8B Instruct.
`qwen3_vl_30b_a3b_pretrain_config`	Return a pre-training config for Qwen3-VL-30B-A3B-Instruct.
`qwen3_vl_235b_a22b_pretrain_config`	Return a pre-training config for Qwen3-VL-235B-A22B-Instruct.
`qwen3_vl_8b_finetune_config`	Return a fine-tuning config for Qwen3-VL 8B Instruct.
`qwen3_vl_30b_a3b_finetune_config`	Return a fine-tuning config for Qwen3-VL-30B-A3B-Instruct.
`qwen3_vl_235b_a22b_finetune_config`	Return a fine-tuning config for Qwen3-VL-235B-A22B-Instruct.
`_qwen3_vl_common`	Create a pre-training configuration for Qwen3 MoE models using a given HuggingFace path.

API#

class bridge.recipes.qwen_vl.qwen3_vl.Qwen3VLCommonKwargs#

Bases: typing_extensions.TypedDict

Typed options accepted by Qwen3 VL MoE recipe helpers.

Initialization

Initialize self. See help(type(self)) for accurate signature.

hf_path: str#: None

dir: Optional[str]#: None

name: str#: None

data_paths: Optional[List[str]]#: None

data_args_path: Optional[str]#: None

train_data_path: Optional[List[str]]#: None

valid_data_path: Optional[List[str]]#: None

test_data_path: Optional[List[str]]#: None

per_split_data_args_path: Optional[str]#: None

mock: bool#: None

tensor_model_parallel_size: int#: None

pipeline_model_parallel_size: int#: None

pipeline_dtype: Optional[torch.dtype]#: None

virtual_pipeline_model_parallel_size: Optional[int]#: None

context_parallel_size: int#: None

expert_model_parallel_size: Optional[int]#: None

expert_tensor_parallel_size: int#: None

sequence_parallel: bool#: None

use_megatron_fsdp: bool#: None

enable_recompute: bool#: None

account_for_embedding_in_pipeline_split: bool#: None

account_for_loss_in_pipeline_split: bool#: None

train_iters: int#: None

global_batch_size: int#: None

micro_batch_size: int#: None

seq_length: int#: None

lr: float#: None

min_lr: float#: None

lr_warmup_iters: int#: None

lr_decay_iters: Optional[int]#: None

eval_interval: int#: None

save_interval: int#: None

use_null_tokenizer: bool#: None

precision_config: Optional[Union[megatron.bridge.training.mixed_precision.MixedPrecisionConfig, str]]#: None

comm_overlap_config: Optional[megatron.bridge.training.comm_overlap.CommOverlapConfig]#: None

moe_flex_dispatcher_backend: str | None#: None

pretrained_checkpoint: Optional[str]#: None

freeze_language_model: bool#: None

freeze_vision_model: bool#: None

freeze_vision_projection: bool#: None

dataset_type: Optional[str]#: None

image_folder: Optional[str]#: None

tokenizer_model: Optional[str]#: None

peft: Optional[Union[str, megatron.bridge.peft.base.PEFT]]#: None

finetune_lr: float#: None

bridge.recipes.qwen_vl.qwen3_vl.qwen3_vl_8b_pretrain_config(

**user_kwargs: typing_extensions.Unpack[bridge.recipes.qwen_vl.qwen3_vl.Qwen3VLCommonKwargs],

) → megatron.bridge.training.config.ConfigContainer#

Return a pre-training config for Qwen3-VL 8B Instruct.