stages.text.modifiers.fasttext#

Module Contents#

Classes#

FastTextLabelModifier

Abstract base class for text-based document modifiers.

API#

class stages.text.modifiers.fasttext.FastTextLabelModifier(label: str)#

Bases: nemo_curator.stages.text.modifiers.doc_modifier.DocumentModifier

Abstract base class for text-based document modifiers.

Subclasses must implement modify_document to transform input value(s) and return the modified value. This supports both single-input and multi-input usage:

  • Single input: modify_document(value)

  • Multiple inputs: modify_document(**values) where each input field is expanded as a keyword argument (e.g., modify_document(column_1=..., column_2=...)).

Initialization

modify_document(text: str) → str#

Transform the provided value(s) and return the result.