bridge.models.diffusion_gemma.diffusion_gemma_provider#

Module Contents#

Classes#

DiffusionGemmaModelProvider

Model provider for DiffusionGemma block-diffusion checkpoints.

API#

class bridge.models.diffusion_gemma.diffusion_gemma_provider.DiffusionGemmaModelProvider#

Bases: megatron.bridge.models.gemma_vl.gemma4_vl_provider.Gemma4VLModelProvider

Model provider for DiffusionGemma block-diffusion checkpoints.

canvas_length: int#

256

global_image_bidirectional_attention: bool#

True

freeze_self_conditioning: bool#

False

diffusion_loss_variant: str#

‘base-sft’

diffusion_noise_min: float#

0.001

diffusion_noise_max: float#

None

diffusion_weight_clip: float | None#

None

diffusion_self_conditioning_prob: float#

0.0

diffusion_decoder_loss_weight: float#

1.0

diffusion_encoder_loss_weight: float#

1.0

moe_aux_loss_coeff: float#

0.0

provide(
pre_process=None,
post_process=None,
vp_stage=None,
) → megatron.bridge.models.diffusion_gemma.modeling_diffusion_gemma.DiffusionGemmaModel#