`bridge.diffusion.data.common.safe_decoder`#

Safe decoding for Bridge diffusion WebDataset fields.

Module Contents#

Classes#

SafeDiffusionSampleDecoder

Energon decoder that never uses WebDataset’s unrestricted pickle handlers.

Functions#

_safe_basic_handler

Decode tensor fields safely and delegate non-executable formats.

Data#

_PICKLE_EXTENSIONS

API#

bridge.diffusion.data.common.safe_decoder._PICKLE_EXTENSIONS#: ‘frozenset(…)’

bridge.diffusion.data.common.safe_decoder._safe_basic_handler(key: str, data: bytes) → Any#: Decode tensor fields safely and delegate non-executable formats.

class bridge.diffusion.data.common.safe_decoder.SafeDiffusionSampleDecoder#

Bases: megatron.energon.flavors.webdataset.sample_decoder.SampleDecoder

Energon decoder that never uses WebDataset’s unrestricted pickle handlers.

Initialization