nemo_curator.stages.text.modifiers.string.line_remover

View as Markdown

Module Contents

Classes

NameDescription
LineRemoverRemoves lines from a document if the content of the line matches a given string.

API

class nemo_curator.stages.text.modifiers.string.line_remover.LineRemover(
patterns: list[str]
)

Bases: DocumentModifier

Removes lines from a document if the content of the line matches a given string.

nemo_curator.stages.text.modifiers.string.line_remover.LineRemover.modify_document(
text: str
) -> str