morpheus.io.deserializers

DataFrame deserializers.

Functions

read_file_to_df(file_name, file_type=<FileTypes.Auto: 0>, parser_kwargs=None, filter_nulls=True, filter_null_columns='data', df_type='pandas')[source]

Reads a file into a dataframe and performs any of the necessary cleanup.

Parameters

file_name

File to read.

file_type : morpheus.common.FileTypes

Type of file. Leave as Auto to determine from the extension.

parser_kwargs

Any argument to pass onto the parse, by default {}. Ignored when C++ execution is enabled and df_type="cudf"

filter_nulls

Whether to filter null rows after loading, by default True.

filter_null_columns

Column or columns to filter null values from. Ignored when filter_null is False.

df_type

What type of parser to use. Options are ‘cudf’ and ‘pandas’, by default “pandas”.

Returns

DataFrameType

A parsed DataFrame.