DFP Data Prep Module#

This module function prepares data for either inference or model training.

Configurable Parameters#

Parameter

Type

Description

Example Value

Default Value

schema

dict

Schema configuration

Refer Below

-

timestamp_column_name

string

Name of the timestamp column

"timestamp"

timestamp

schema#

Key

Type

Description

Example Value

Default Value

schema_str

string

Serialized schema string

"cPickle schema string"

-

encoding

string

Encoding used for the schema_str

"latin1"

-

input_message_type

string

Pickled message type

"message type"

-

Example JSON Configuration#

{
  "schema": {
    "schema_str": "cPickle schema string",
    "encoding": "latin1",
    "input_message_type": "message type"
  },
  "timestamp_column_name": "timestamp"
}