***

layout: overview
slug: nemo-curator/nemo\_curator/utils/client\_utils
title: nemo\_curator.utils.client\_utils
----------------------------------------

## Module Contents

### Classes

| Name                                                | Description                                                               |
| --------------------------------------------------- | ------------------------------------------------------------------------- |
| [`FSPath`](#nemo_curator-utils-client_utils-FSPath) | Wrapper that combines filesystem and path for convenient file operations. |

### Functions

| Name                                                              | Description |
| ----------------------------------------------------------------- | ----------- |
| [`is_remote_url`](#nemo_curator-utils-client_utils-is_remote_url) | -           |

### API

<Anchor id="nemo_curator-utils-client_utils-FSPath">
  <CodeBlock showLineNumbers={false} wordWrap={true}>
    ```python
    class nemo_curator.utils.client_utils.FSPath(
        fs: fsspec.AbstractFileSystem,
        path: str
    )
    ```
  </CodeBlock>
</Anchor>

<Indent>
  Wrapper that combines filesystem and path for convenient file operations.

  <Anchor id="nemo_curator-utils-client_utils-FSPath-__repr__">
    <CodeBlock showLineNumbers={false} wordWrap={true}>
      ```python
      nemo_curator.utils.client_utils.FSPath.__repr__()
      ```
    </CodeBlock>
  </Anchor>

  <Indent />

  <Anchor id="nemo_curator-utils-client_utils-FSPath-__str__">
    <CodeBlock showLineNumbers={false} wordWrap={true}>
      ```python
      nemo_curator.utils.client_utils.FSPath.__str__()
      ```
    </CodeBlock>
  </Anchor>

  <Indent />

  <Anchor id="nemo_curator-utils-client_utils-FSPath-as_posix">
    <CodeBlock showLineNumbers={false} wordWrap={true}>
      ```python
      nemo_curator.utils.client_utils.FSPath.as_posix() -> str
      ```
    </CodeBlock>
  </Anchor>

  <Indent />

  <Anchor id="nemo_curator-utils-client_utils-FSPath-get_bytes_cat_ranges">
    <CodeBlock showLineNumbers={false} wordWrap={true}>
      ```python
      nemo_curator.utils.client_utils.FSPath.get_bytes_cat_ranges(
          part_size: int = 10 * 1024 ** 2
      ) -> bytes
      ```
    </CodeBlock>
  </Anchor>

  <Indent>
    Read object into memory using fsspec's cat\_ranges.
    Modified from [https://github.com/rapidsai/cudf/blob/ba64909422016ba389ab06ed01d7578336c19e8e/python/dask\_cudf/dask\_cudf/io/json.py#L26-L34](https://github.com/rapidsai/cudf/blob/ba64909422016ba389ab06ed01d7578336c19e8e/python/dask_cudf/dask_cudf/io/json.py#L26-L34)
  </Indent>

  <Anchor id="nemo_curator-utils-client_utils-FSPath-open">
    <CodeBlock showLineNumbers={false} wordWrap={true}>
      ```python
      nemo_curator.utils.client_utils.FSPath.open(
          mode: str = 'rb',
          kwargs = {}
      ) -> fsspec.spec.AbstractBufferedFile
      ```
    </CodeBlock>
  </Anchor>

  <Indent />
</Indent>

<Anchor id="nemo_curator-utils-client_utils-is_remote_url">
  <CodeBlock showLineNumbers={false} wordWrap={true}>
    ```python
    nemo_curator.utils.client_utils.is_remote_url(
        url: str
    ) -> bool
    ```
  </CodeBlock>
</Anchor>

<Indent />