bridge.models.nemotron_vl.data.collate_fn#

Nemotron VL collator implementations.

Module Contents#

Functions#

_nemotron_vl_assistant_mask_boundary_config

Build assistant loss boundaries for the Nemotron VL chat template.

nemotron_nano_v2_vl_collate_fn

Collate function for Nemotron Nano V2 VL model.

Data#

NEMOTRON_VL_ASSISTANT_START

NEMOTRON_VL_ASSISTANT_END

API#

bridge.models.nemotron_vl.data.collate_fn.NEMOTRON_VL_ASSISTANT_START#

ā€˜<SPECIAL_11>Assistant\nā€™

bridge.models.nemotron_vl.data.collate_fn.NEMOTRON_VL_ASSISTANT_END#

ā€˜<SPECIAL_12>ā€™

bridge.models.nemotron_vl.data.collate_fn._nemotron_vl_assistant_mask_boundary_config(
processor: Any,
) → megatron.bridge.data.conversation_processing.AssistantMaskBoundaryConfig#

Build assistant loss boundaries for the Nemotron VL chat template.

bridge.models.nemotron_vl.data.collate_fn.nemotron_nano_v2_vl_collate_fn(
examples: list,
processor,
start_of_response_token=None,
*,
visual_keys: object = None,
min_pixels: int | None = None,
max_pixels: int | None = None,
sequence_length: int | None = None,
pad_to_max_length: bool = False,
pad_to_multiple_of: int = 128,
enable_in_batch_packing: bool = False,
in_batch_packing_pad_to_multiple_of: int = 1,
) → dict[str, torch.Tensor]#

Collate function for Nemotron Nano V2 VL model.