nemo_curator.utils.client_utils

Module Contents

Name	Description
`FSPath`	Wrapper that combines filesystem and path for convenient file operations.

Name	Description
`is_remote_url`	-

class nemo_curator.utils.client_utils.FSPath(
    fs: fsspec.AbstractFileSystem,
    path: str
)

Wrapper that combines filesystem and path for convenient file operations.

nemo_curator.utils.client_utils.FSPath.__repr__()

nemo_curator.utils.client_utils.FSPath.__str__()

nemo_curator.utils.client_utils.FSPath.as_posix() -> str

nemo_curator.utils.client_utils.FSPath.get_bytes_cat_ranges(
    part_size: int = 10 * 1024 ** 2
) -> bytes

nemo_curator.utils.client_utils.FSPath.open(
    mode: str = 'rb',
    kwargs = {}
) -> fsspec.spec.AbstractBufferedFile

nemo_curator.utils.client_utils.is_remote_url(
    url: str
) -> bool