morpheus.io.data_storage.file_system

Functions

row_count_from_file(file_path[, ...])

Compute the number of rows in a Parquet or CSV file using pandas.

Classes

FileSystemStorage(file_path, file_format)

A class to manage storage of data in various file formats.

row_count_from_file(file_path, file_format_hint=None)

Compute the number of rows in a Parquet or CSV file using pandas.

Parameters:

• file_path (str) – The path to the input file.

• file_format_hint (str, optional) – File format. Defaults to None.

Returns:

The number of rows in the file.

Return type:

int