Batch Data Payload Module

NVIDIA Docs Hub NVIDIA Morpheus NVIDIA Morpheus (24.03.02) Batch Data Payload Module

This module batches incoming control message data payload into smaller batches based on the specified configurations.

Configurable Parameters

Parameter	Type	Description	Example Value	Default Value
`max_batch_size`	integer	The maximum size of each batch	256	`256`
`raise_on_failure`	boolean	Whether to raise an exception if a failure occurs during processing	false	`false`
`group_by_columns`	list	The column names to group by when batching	[“col1”, “col2”]	`[]`
`disable_max_batch_size`	boolean	Whether to disable the `max_batch_size` and only batch by group	false	`false`
`timestamp_column_name`	string	The name of the timestamp column	None	`None`
`timestamp_pattern`	string	The pattern to parse the timestamp column	None	`None`
`period`	string	The period for grouping by timestamp	H	`D`

Example JSON Configuration

Copy
Copied!

            
            {
  "max_batch_size": 256,
  "raise_on_failure": false,
  "group_by_columns": [],
  "disable_max_batch_size": false,
  "timestamp_column_name": null,
  "timestamp_pattern": null,
  "period": "D"
}

Previous MLflow Model Writer Module

Next Serialize Module