- class FileToDFController(schema, filter_null, file_type, parser_kwargs, cache_dir, timestamp_column_name)[source]
Bases:
objectController class for converting file objects to Pandas DataFrames with optional preprocessing.
- Parameters
- schema
- filter_null
- file_type
- parser_kwargs
- cache_dir
- timestamp_column_name
A schema defining how to process the data.
Flag to indicate whether to filter out null values.
The type of the file being processed (e.g., CSV, Parquet).
Additional keyword arguments to pass to the file parser.
Directory where cache will be stored.
Name of the timestamp column.
Methods
close()Close the resources used by the controller. convert_to_dataframe(file_object_batch)Convert a batch of file objects to a DataFrame. - close()[source]
Close the resources used by the controller.
- convert_to_dataframe(file_object_batch)[source]
Convert a batch of file objects to a DataFrame.
- Parameters
- file_object_batch
A batch of file objects and batch count.
- Returns
- cudf.DataFrame
The resulting DataFrame.
morpheus.controllers.file_to_df_controller.FileToDFController
Previous
morpheus.controllers.file_to_df_controller
Next
morpheus.controllers.filter_detections_controller