`nemo_evaluator.core.evaluate`#

Module Contents#

Functions#

`evaluate`	Run an evaluation using configuration objects.
`parse_output`

Data#

API#

nemo_evaluator.core.evaluate.evaluate( eval_cfg: nemo_evaluator.api.api_dataclasses.EvaluationConfig, target_cfg: nemo_evaluator.api.api_dataclasses.EvaluationTarget, ) → nemo_evaluator.api.api_dataclasses.EvaluationResult[source]#

Run an evaluation using configuration objects.

Args: eval_cfg: Evaluation configuration object containing output directory, parameters, and evaluation type target_cfg: Target configuration object containing API endpoint details and adapter configuration

Returns: EvaluationResult: Evaluation results and metadata

nemo_evaluator.core.evaluate.logger#: ‘get_logger(…)’

nemo_evaluator.core.evaluate.parse_output( evaluation: nemo_evaluator.api.api_dataclasses.Evaluation, ) → nemo_evaluator.api.api_dataclasses.EvaluationResult[source]#