nemo_automodel.components.speculative.streaming.stores

Pluggable feature-store backends for the streaming data plane.

:class:LocalFeatureStore is the in-process reference backend. :class:SharedDirFeatureStore adds cross-process rendezvous on a shared POSIX mount. A future :class:NcclFeatureStore can plug in behind the same :class:~nemo_automodel.components.speculative.streaming.store.FeatureStore contract.

Submodules

• nemo_automodel.components.speculative.streaming.stores.local
• nemo_automodel.components.speculative.streaming.stores.shared_dir

Package Contents

Data

__all__

API

nemo_automodel.components.speculative.streaming.stores.__all__ = ['LocalFeatureStore', 'SharedDirFeatureStore']