morpheus.modules.payload_batcher

Functions

payload_batcher(builder) Batches incoming control message data payload into smaller batches based on the specified configurations.
payload_batcher(builder)[source]

Batches incoming control message data payload into smaller batches based on the specified configurations.

Parameters
builder

The mrc Builder object used to configure the module.

Raises
ValueError

If disable_max_batch_size is True and group_by_columns is empty or None.

Notes

Configurable Parameters:
  • max_batch_size (int): The maximum size of each batch (default: 256).

  • raise_on_failure (bool): Whether to raise an exception if a failure occurs during processing (default: False).

  • group_by_columns (list): The column names to group by when batching (default: []).

  • disable_max_batch_size (bool): Whether to disable the max_batch_size and only batch by group (default: False).

  • timestamp_column_name (str): The name of the timestamp column (default: None).

  • timestamp_pattern (str): The pattern to parse the timestamp column (default: None).

  • period (str): The period for grouping by timestamp (default: ‘D’).

Previous morpheus.modules.output.write_to_vector_db.AccumulationStats
Next morpheus.modules.preprocess
© Copyright 2024, NVIDIA. Last updated on Apr 11, 2024.