`bridge.models.qwen3_asr.modeling_qwen3_asr.transformer_config`#

Module Contents#

Classes#

Qwen3ASRTransformerConfig

Configuration for Qwen3-ASR transformer with audio and language components.

API#

class bridge.models.qwen3_asr.modeling_qwen3_asr.transformer_config.Qwen3ASRTransformerConfig#

Bases: megatron.core.transformer.transformer_config.TransformerConfig

Configuration for Qwen3-ASR transformer with audio and language components.

vocab_size: int#: 152064

language_max_sequence_length: int#: 4096

apply_rotary_pos_emb_in_fp32: bool#: False

fp16_lm_cross_entropy: bool#: False

share_embeddings_and_output_weights: bool#: False

rotary_percent: float#: 1.0

rotary_base: float#: 5000000.0

mrope_section: list[int]#: ‘field(…)’

apply_rope_fusion: bool#: False

audio_token_id: int#: 151646

audio_start_token_id: int#: 151647

qk_layernorm: bool#: True