mdx.mtmc.stream.data_transformer module

class DataTransformer

Bases: object

Module to transform data

data_transformer = DataTransformer()

transform_notification_messages(messages: List[kafka.consumer.fetcher.ConsumerRecord], calibrator: Calibrator) → Dict[str, Notification]

Transforms Kafka consumer records to notifications

Parameters:

• messages (List) – list of Kafka consumer records

• calibrator (Calibrator) – calibrator used to load sensors

Returns:

map from type to notifications

Return type:

Dict[str,Notification]

map_type_to_notifications = data_transformer.transform_notification_messages(messages, calibrator)

transform_raw_messages_to_behaviors(messages: List[bytes], data_preprocessor: Preprocessor) → List[Behavior]

Transforms raw messages to behavior objects

Parameters:

• messages (List[bytes]) – list of byte messages

• data_preprocessor (Preprocessor) – data preprocessor

Returns:

list of behaviors

Return type:

List[Behavior]

behaviors = data_transformer.transform_raw_messages_to_behaviors(messages, data_preprocessor)

transform_raw_messages_to_protobuf_frames(messages: List[kafka.consumer.fetcher.ConsumerRecord]) → List[Any]

Transforms raw messages to protobuf frame objects

Parameters:

messages (List[KafkaConsumerRecord]) – list of Kafka consumer records

Returns:

list of protobuf frame objects

Return type:

List[Any]

protobuf_frames = data_transformer.transform_raw_messages_to_protobuf_frames(messages)