utils.client_utils#

Module Contents#

Classes#

FSPath

Wrapper that combines filesystem and path for convenient file operations.

Functions#

API#

class utils.client_utils.FSPath(fs: fsspec.AbstractFileSystem, path: str)#

Wrapper that combines filesystem and path for convenient file operations.

Initialization

as_posix() str#
get_bytes_cat_ranges(*, part_size: int = 10 * 1024**2) bytes#

Read object into memory using fsspec’s cat_ranges. Modified from https://github.com/rapidsai/cudf/blob/ba64909422016ba389ab06ed01d7578336c19e8e/python/dask_cudf/dask_cudf/io/json.py#L26-L34

open(mode: str = 'rb', **kwargs) fsspec.spec.AbstractBufferedFile#
utils.client_utils.is_remote_url(url: str) bool#