Python SDKPythonPythonAistorePytorch

aistore.pytorch.map_dataset

View as Markdown

PyTorch Dataset for AIS.

Copyright (c) 2022-2026, NVIDIA CORPORATION. All rights reserved.

Module Contents

Classes

NameDescription
AISMapDatasetA map-style dataset for objects in AIS.

API

class aistore.pytorch.map_dataset.AISMapDataset(
    ais_source_list: typing.Union[aistore.sdk.AISSource, typing.List[aistore.sdk.AISSource]] = [],
    prefix_map: typing.Dict[aistore.sdk.AISSource, typing.Union[str, typing.List[str]]] = {},
    etl_name: str = None
)

Bases: AISBaseMapDataset

A map-style dataset for objects in AIS. If etl_name is provided, that ETL must already exist on the AIStore cluster.

Parameters:

ais_source_list
Union[AISSource, List[AISSource]]Defaults to []

Single or list of AISSource objects to load data

prefix_map
Dict(AISSource, List[str])Defaults to {}

Map of AISSource objects to list of prefixes that only allows

etl_name
strDefaults to None

Optional ETL on the AIS cluster to apply to each object

aistore.pytorch.map_dataset.AISMapDataset.__getitem__(
    index: int
)
aistore.pytorch.map_dataset.AISMapDataset.__len__()