core.datasets.retro.config

Exports:

• Embedder: Base class for all Bert embedders.

• RetroBertEmbedders: Container class for in-memory and on-disk embedders.

• RetroPreprocessingConfig: Configuration class for all of Retro preprocessing.

• RetroGPTChunkDatasets: Container class for train, valid, and test datasets.

• RetroTokenizers: Container class for GPT and Bert tokenizers.

Submodules

• core.datasets.retro.config.gpt_chunk_datasets
• core.datasets.retro.config.bert_embedders
• core.datasets.retro.config.config
• core.datasets.retro.config.tokenizers