For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
DocumentationAPI Reference
DocumentationAPI Reference
  • API Reference
    • Overview
        • Nemo Curator
          • Backends
          • Config
          • Core
          • Metrics
          • Models
          • Package Info
          • Pipeline
          • Stages
          • Tasks
          • Utils
            • Client Utils
            • Column Utils
            • Decoder Utils
            • File Utils
            • Gpu Utils
            • Grouping
            • Hf Download Utils
            • Merge File Prefixes
            • Nvcodec Utils
            • Operation Utils
            • Performance Utils
            • Prompts
            • Ray Utils
            • Split Large Files
            • Storage Utils
            • Vllm Utils
            • Windowing Utils
            • Writer Utils
    • Pipeline
    • ProcessingStage
    • CompositeStage
    • Resources
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogoNeMo Curator
On this page
  • Module Contents
  • Functions
  • API
API ReferenceFull Library ReferenceNemo CuratorNemo CuratorUtils

nemo_curator.utils.storage_utils

||View as Markdown|
Previous

nemo_curator.utils.split_large_files

Next

nemo_curator.utils.vllm_utils

Module Contents

Functions

NameDescription
_get_local_pathConstruct a full local path from a base path and additional components.
get_full_pathConstruct a full path from a base path and additional components.

API

nemo_curator.utils.storage_utils._get_local_path(
    localpath: pathlib.Path,
    args: str = ()
) -> pathlib.Path

Construct a full local path from a base path and additional components. Args: localpath: The base local path. *args: Additional path components. Returns: The full local path as a Path object.

nemo_curator.utils.storage_utils.get_full_path(
    path: str | pathlib.Path,
    args: str = ()
) -> pathlib.Path

Construct a full path from a base path and additional components. Args: path: The base path. *args: Additional path components. Returns: The full path as a StoragePrefix or Path object.