modifiers.newline_normalizer

Module Contents

Classes

NewlineNormalizer

Data

THREE_OR_MORE_NEWLINES_REGEX
THREE_OR_MORE_WINDOWS_NEWLINES_REGEX

API

class modifiers.newline_normalizer.NewlineNormalizer

Bases: nemo_curator.modifiers.DocumentModifier

Initialization

modify_document(text: str) → str

modifiers.newline_normalizer.THREE_OR_MORE_NEWLINES_REGEX

‘compile(…)’

modifiers.newline_normalizer.THREE_OR_MORE_WINDOWS_NEWLINES_REGEX

‘compile(…)’