Functions
payload_batcher(builder) |
Batches incoming control message data payload into smaller batches based on the specified configurations. |
- payload_batcher(builder)[source]
Batches incoming control message data payload into smaller batches based on the specified configurations.
- Parameters
- builder
The mrc Builder object used to configure the module.
- Raises
- ValueError
If disable_max_batch_size is True and group_by_columns is empty or None.
Notes
- Configurable Parameters:
max_batch_size (int): The maximum size of each batch (default: 256).
raise_on_failure (bool): Whether to raise an exception if a failure occurs during processing (default: False).
group_by_columns (list): The column names to group by when batching (default: []).
disable_max_batch_size (bool): Whether to disable the max_batch_size and only batch by group (default: False).
timestamp_column_name (str): The name of the timestamp column (default: None).
timestamp_pattern (str): The pattern to parse the timestamp column (default: None).
period (str): The period for grouping by timestamp (default: ‘D’).