bridge.models.stepfun.data.flickr8k#
Step3.7 Flickr8k SFT dataset pipeline.
Self-contained inside Megatron-Bridge with no external runtime dependency.
trust_remote_code is never set; the tokenizer is loaded directly from
the local HF snapshot via transformers.AutoTokenizer.from_pretrained.
See :class:Step37Flickr8kSFTDataProvider for the mbridge integration
entry-point.
Submodules#
bridge.models.stepfun.data.flickr8k.multimodal_utilsbridge.models.stepfun.data.flickr8k.packed_dataloaderbridge.models.stepfun.data.flickr8k.providerbridge.models.stepfun.data.flickr8k.packingbridge.models.stepfun.data.flickr8k.samplersbridge.models.stepfun.data.flickr8k.flickr8k_loaderbridge.models.stepfun.data.flickr8k.preprocessbridge.models.stepfun.data.flickr8k.pack_transformbridge.models.stepfun.data.flickr8k.template
Package Contents#
Data#
API#
- bridge.models.stepfun.data.flickr8k.__all__#
[‘IMAGE_ITEM_TYPE’, ‘PATCH_ITEM_TYPE’, ‘ImageForInsert’, ‘build_image_for_insert’, ‘compute_rope_arg…