aistore.sdk.batch.extractor.zip_stream_extractor

Module Contents

Classes

Name	Description
`ZipStreamExtractor`	Class for extracting batch .zip streams from AIStore.

Data

logger

API

class aistore.sdk.batch.extractor.zip_stream_extractor.ZipStreamExtractor()

Bases: ArchiveStreamExtractor

Class for extracting batch .zip streams from AIStore.

Integrates with MossReq/MossResp objects to provide proper metadata mapping.

_supported_fmts

= (EXT_ZIP,)

aistore.sdk.batch.extractor.zip_stream_extractor.ZipStreamExtractor.extract(
    response: requests.Response,
    data_stream: typing.Union[io.BytesIO, typing.Any],
    moss_req: aistore.sdk.batch.types.MossReq,
    moss_resp: typing.Optional[aistore.sdk.batch.types.MossResp] = None
) -> typing.Generator[typing.Tuple[aistore.sdk.batch.types.MossOut, bytes], None, None]

Extract from zip archive stream.

Note: ZIP format requires random access, so the entire stream is loaded into memory before extraction begins.

Parameters:

response

Response

HTTP response

data_stream

Union[BytesIO, Any]

Archive data

moss_req

MossReq

Original request

moss_resp

Optional[MossResp]Defaults to None

Response metadata (None for streaming)

aistore.sdk.batch.extractor.zip_stream_extractor.logger = get_logger(__name__)