core.models.common.vision_module.vision_module#

Megatron Vision Module.

Module Contents#

Classes#

VisionModule

Base vision module that has common helper functions used across CLIP, ViT, etc.

API#

class core.models.common.vision_module.vision_module.VisionModule(
config: megatron.core.transformer.transformer_config.TransformerConfig,
)#

Bases: megatron.core.transformer.module.MegatronModule

Base vision module that has common helper functions used across CLIP, ViT, etc.

Parameters:

config (TransformerConfig) – Input transformer config for the model

Initialization