morpheus.io.data_storage.file_system

Functions

<a href="#morpheus.io.data_storage.file_system.row_count_from_file">row_count_from_file</a>(file_path[, ...]) Compute the number of rows in a Parquet or CSV file using pandas.

Classes

<a href="morpheus.io.data_storage.file_system.FileSystemStorage.html#morpheus.io.data_storage.file_system.FileSystemStorage">FileSystemStorage</a>(file_path, file_format) A class to manage storage of data in various file formats.

row_count_from_file(file_path, file_format_hint=None)[source]

Compute the number of rows in a Parquet or CSV file using pandas.

Parameters

file_path (str) – The path to the input file.
file_format_hint (str, optional) – File format. Defaults to None.

Returns

The number of rows in the file.

Return type

int

Previous morpheus.io.data_storage

Next morpheus.io.data_storage.file_system.FileSystemStorage