morpheus.io.data_storage.in_memory.InMemoryStorage

class InMemoryStorage(file_format)

Bases: RecordStorageInterface

A class to manage storage of data in memory.

Attributes:

backing_source

Get the backing source.

num_rows

Get the number of rows in the data.

owner

Get whether this instance is the owner of the data in the buffer.

Methods

delete()	Delete the data in the buffer if this instance is the owner.
load()	Load data from the buffer.
store(data_source[, copy_from_source])	Store data in the buffer.

property backing_source: str

Get the backing source.

Returns:

The name of the backing source.

delete()

Delete the data in the buffer if this instance is the owner.

load()

Load data from the buffer.

Returns:

The loaded data as a pandas DataFrame.

property num_rows: int

Get the number of rows in the data.

Returns:

The number of rows in the data.

property owner: bool

Get whether this instance is the owner of the data in the buffer.

Returns:

True if this instance is the owner of the data in the buffer, False otherwise.

store(data_source, copy_from_source=True)

Store data in the buffer.

Args:

data_source: The data to store. Can be a pandas.DataFrame, cudf.DataFrame, or a file path. copy_from_source: If True, data_source is assumed to be a file path and the data will be copied from this file to the buffer. If False, the buffer will simply be updated to point to data_source (which is assumed to be a file path).