nv_ingest_api.internal.store package#
Submodules#
nv_ingest_api.internal.store.embed_text_upload module#
- nv_ingest_api.internal.store.embed_text_upload.store_text_embeddings_internal(
- df_store_ledger: DataFrame,
- task_config: BaseModel | Dict[str, Any],
- store_config: EmbeddingStorageSchema,
- execution_trace_log: Dict[str, Any] | None = None,
Stores embeddings by uploading content from a DataFrame to MinIO.
This function prepares the necessary parameters for the upload based on the task configuration, invokes the upload routine, and returns the updated DataFrame.
- Parameters:
df_store_ledger (pd.DataFrame) – DataFrame containing the data whose embeddings need to be stored.
task_config (Union[BaseModel, Dict[str, Any]]) – Task configuration. If it is a Pydantic model, it will be converted to a dictionary.
store_config (Dict[str, Any]) – Configuration parameters for storage (not directly used in the current implementation).
execution_trace_log (Optional[Dict[str, Any]], default=None) – Optional dictionary for trace logging information.
- Returns:
The updated DataFrame after embeddings have been uploaded and metadata updated.
- Return type:
pd.DataFrame
- Raises:
Exception – If any error occurs during the storage process, it is logged and re-raised with additional context.