utils.split_large_files

Module Contents

Functions

main
parse_args
split_parquet_file_by_size

API

utils.split_large_files.main(args: argparse.ArgumentParser | None = None) → None

utils.split_large_files.parse_args(

args: argparse.ArgumentParser | None = None,

) → argparse.Namespace

utils.split_large_files.split_parquet_file_by_size(

input_file: str,

outdir: str,

target_size_mb: int,

) → None