`nemo_evaluator.adapters.interceptors.progress_tracking_interceptor`#

Progress tracking interceptor that tracks number of samples processed via webhook.

Module Contents#

Progress tracking via external webhook.

class nemo_evaluator.adapters.interceptors.progress_tracking_interceptor.ProgressTrackingInterceptor(params: Params)#

Progress tracking via external webhook.

Initialization

Initialize the progress tracking interceptor.

Args: params: Configuration parameters

class Params(/, **data: Any)#

Bases: nemo_evaluator.logging.BaseLoggingParams

Configuration parameters for progress tracking interceptor.

Initialization

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

Function that will be called by AdapterServer on the way downstream.

Args: resp: The adapter response to intercept context: Global context containing server-level configuration

Function that will be called by the evaluation system after evaluation completes.

Args: context: Global context containing server-level configuration and evaluation results

Ex.: This is used for report generation, cleanup, metrics collection, etc.