morpheus.modules.payload_batcher

Functions

payload_batcher(builder)[source]

Batches incoming control message data payload into smaller batches based on the specified configurations.

Parameters

buildermrc.Builder

The mrc Builder object used to configure the module.

Raises

ValueError

If disable_max_batch_size is True and group_by_columns is empty or None.

Notes

Configurable Parameters:

• max_batch_size (int): The maximum size of each batch (default: 256).

• raise_on_failure (bool): Whether to raise an exception if a failure occurs during processing (default: False).

• group_by_columns (list): The column names to group by when batching (default: []).

• disable_max_batch_size (bool): Whether to disable the max_batch_size and only batch by group (default: False).

• timestamp_column_name (str): The name of the timestamp column (default: None).

• timestamp_pattern (str): The pattern to parse the timestamp column (default: None).

• period (str): The period for grouping by timestamp (default: ‘D’).