morpheus.io.data_storage.file_system

Functions

row_count_from_file(file_path[, ...])

Compute the number of rows in a Parquet or CSV file using pandas.

Classes

FileSystemStorage(file_path, file_format)

A class to manage storage of data in various file formats.

row_count_from_file(file_path, file_format_hint=None)[source]

Compute the number of rows in a Parquet or CSV file using pandas.

Parameters:
  • file_path (str) – The path to the input file.

  • file_format_hint (str, optional) – File format. Defaults to None.

Returns:

The number of rows in the file.

Return type:

int

© Copyright 2023, NVIDIA. Last updated on Aug 23, 2023.