nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores

Stage for merging FAITH scores into translation metadata.

Module Contents

Classes

Name	Description
`MergeFaithScoresStage`	Merge FAITH scores into `translation_metadata`.

Data

__all__

API

class nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage(
    name: str = 'MergeFaithScoresStage'
)

Dataclass

Bases: ProcessingStage[DocumentBatch, DocumentBatch]

Merge FAITH scores into translation_metadata.

name

str = 'MergeFaithScoresStage'

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage._extract_faith_scores(
    row: pandas.Series,
    available_faith_cols: list[str]
) -> dict[str, typing.Any]

staticmethod

Build the FAITH score payload expected by metadata merging.

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage.inputs() -> tuple[list[str], list[str]]

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage.outputs() -> tuple[list[str], list[str]]

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.MergeFaithScoresStage.process(
    batch: nemo_curator.tasks.DocumentBatch
) -> nemo_curator.tasks.DocumentBatch

Merge FAITH scores into the translation_metadata column.

nemo_curator.stages.text.experimental.translation.stages.merge_faith_scores.__all__ = ['MergeFaithScoresStage']