nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores

View as Markdown

Stage for merging FAITH scores into translation metadata.

Module Contents

Classes

NameDescription
MergeFaithScoresStageMerge FAITH scores into translation_metadata.

Data

__all__

API

class nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage(
name: str = 'MergeFaithScoresStage'
)
Dataclass

Bases: ProcessingStage[DocumentBatch, DocumentBatch]

Merge FAITH scores into translation_metadata.

name
str = 'MergeFaithScoresStage'
nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage._extract_faith_scores(
row: pandas.Series,
available_faith_cols: list[str]
) -> dict[str, typing.Any]
staticmethod

Build the FAITH score payload expected by metadata merging.

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage.inputs() -> tuple[list[str], list[str]]
nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage.outputs() -> tuple[list[str], list[str]]
nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage.process(
batch: nemo_curator.tasks.DocumentBatch
) -> nemo_curator.tasks.DocumentBatch

Merge FAITH scores into the translation_metadata column.

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.__all__ = ['MergeFaithScoresStage']