This module batches incoming control message data payload into smaller batches based on the specified configurations.
Parameter |
Type |
Description |
Example Value |
Default Value |
---|---|---|---|---|
|
integer |
The maximum size of each batch |
256 |
|
|
boolean |
Whether to raise an exception if a failure occurs during processing |
false |
|
|
list |
The column names to group by when batching |
[“col1”, “col2”] |
|
|
boolean |
Whether to disable the |
false |
|
|
string |
The name of the timestamp column |
None |
|
|
string |
The pattern to parse the timestamp column |
None |
|
|
string |
The period for grouping by timestamp |
H |
|
{
"max_batch_size": 256,
"raise_on_failure": false,
"group_by_columns": [],
"disable_max_batch_size": false,
"timestamp_column_name": null,
"timestamp_pattern": null,
"period": "D"
}