This module filters columns from a MultiMessage object, emitting a MessageMeta.
Parameter |
Type |
Description |
Example Value |
Default Value |
|---|---|---|---|---|
columns |
list[string] | List of columns to include | [“column1”, “column2”, “column3”] | None |
exclude |
list[string] | List of regex patterns to exclude columns | [“column_to_exclude”] | [r'^ID$', r'^_ts_'] |
fixed_columns |
bool | If true, the columns are fixed and not determined at runtime | true | true |
include |
string | Regex to include columns | “^column” | None |
use_cpp |
bool | If true, use C++ to serialize | true | false |
{
"include": "^column",
"exclude": ["column_to_exclude"],
"fixed_columns": true,
"columns": ["column1", "column2", "column3"],
"use_cpp": true
}