bridge.data

Public data configuration and builder APIs.

Subpackages

• bridge.data.megatron_mimo
  • bridge.data.megatron_mimo.hf_provider
  • bridge.data.megatron_mimo.reorder_buffer
  • bridge.data.megatron_mimo.loaders
  • bridge.data.megatron_mimo.dataset
  • bridge.data.megatron_mimo.canonical_sampler
  • bridge.data.megatron_mimo.collate
  • bridge.data.megatron_mimo.dp_utils
  • bridge.data.megatron_mimo.base_provider
  • bridge.data.megatron_mimo.mock_provider
  • bridge.data.megatron_mimo.sequence_pack
• bridge.data.energon
  • bridge.data.energon.prepare
  • bridge.data.energon.task_encoder_utils
  • bridge.data.energon.base_energon_datamodule
  • bridge.data.energon.hf_task_encoder
  • bridge.data.energon.metadata
  • bridge.data.energon.nemotron_omni_task_encoder
• bridge.data.collators
  • bridge.data.collators.registry
  • bridge.data.collators.sequence_padding
  • bridge.data.collators.visual
  • bridge.data.collators.sft
  • bridge.data.collators.sequence
• bridge.data.builders
  • bridge.data.builders.dpo
  • bridge.data.builders.energon
  • bridge.data.builders.gpt_sft
  • bridge.data.builders.mock_vlm_sft
  • bridge.data.builders.direct_hf_sft
• bridge.data.sources
  • bridge.data.sources.hf_adapters
  • bridge.data.sources.hf
• bridge.data.packing
  • bridge.data.packing.paths
  • bridge.data.packing.algorithms
  • bridge.data.packing.offline
  • bridge.data.packing.gpt_sft
  • bridge.data.packing.global_batch
  • bridge.data.packing.config
  • bridge.data.packing.parquet
  • bridge.data.packing.in_batch
• bridge.data.datasets
  • bridge.data.datasets.utils
  • bridge.data.datasets.direct_sft
  • bridge.data.datasets.preference_tokenization
  • bridge.data.datasets.fim_dataset
  • bridge.data.datasets.preference
  • bridge.data.datasets.gpt_sft
  • bridge.data.datasets.preference_pair

Submodules

• bridge.data.utils
• bridge.data.loaders
• bridge.data.sft_processing
• bridge.data.batch_utils
• bridge.data.conversation_processing
• bridge.data.vlm_processing
• bridge.data.base
• bridge.data.token_utils
• bridge.data.iterator_utils
• bridge.data.samplers

Package Contents

Data

__all__

API

bridge.data.__all__

[‘DataloaderConfig’, ‘DatasetBuildContext’, ‘DatasetProvider’, ‘ChatSFTPreprocessingConfig’, ‘GPTSFT…