Manage Storage#

NeMo microservices use a combination of databases, object storage, and persistent volume to store data.

Storage Types#

Storage Management#
Storage Type	Use	Microservices
Databases	Used to store entity metadata, custom fields, and file locations/references.	NeMo Data Store, NeMo Entity Store, NeMo Evaluator, NeMo Customizer
Object Store	Used to store large datasets and model files.	NeMo Data Store
Persistent Volume	Used to store models locally in the cluster for faster access during customization jobs.	NeMo Data Store, NeMo Customizer, NeMo Operator

Diagram#

graph LR subgraph Storage ["Storage Components"] PG["PostgreSQL DB"] MIL["Milvus DB"] OBJ[("Object Storage (S3/MinIO)")] PVC[("PVC Storage")] end subgraph Services ["NeMo Services"] DS["Data Store"] ES["Entity Store"] EVAL["Evaluator"] CUST["Customizer"] end subgraph Data ["Data Types"] META["Metadata Entity Info References"] FILES["Model Files Datasets"] CACHE["Local Cache Active Models"] end %% Service to Storage Connections DS --> PG DS --> OBJ DS --> PVC ES --> PG EVAL --> PG EVAL --> MIL CUST --> PG CUST --> PVC %% Storage to Data Connections PG --> META OBJ --> FILES PVC --> CACHE %% Style classDef storage fill:#f9f,stroke:#333,stroke-width:2px; classDef service fill:#bbf,stroke:#333,stroke-width:2px; classDef data fill:#bfb,stroke:#333,stroke-width:2px; class PG,MIL,OBJ,PVC storage; class DS,ES,EVAL,CUST service; class META,FILES,CACHE data;

NeMo Storage Architecture and Data Flow#