nemo_automodel.shared.retrieval_ids
nemo_automodel.shared.retrieval_ids
Stable passage identities shared by retrieval text and image collators.
Module Contents
Functions
API
Encode a corpus ID consistently across processes and input modalities.
Parameters:
document_id
Corpus document identifier encoded as UTF-8.
Returns: int
Nonnegative 63-bit integer, preserving the existing text-collator encoding.