Comparator

Module: polygraphy.tools.args

class ComparatorRunArgs[source]

Comparator Inference: running inference via Comparator.run().

Depends on:

DataLoaderArgs

parse_impl(args)[source]

Parses command-line arguments and populates the following attributes:

warm_up

The number of warm-up runs to perform.

use_subprocess

Whether to run each runner in a subprocess.

save_inputs_path

The path at which to save input data.

save_outputs_path

The path at which to save output data.

class ComparatorCompareArgs(allow_postprocessing: Optional[bool] = None)[source]

Comparator Comparisons: inference output comparisons.

Depends on:

CompareFuncSimpleArgs

CompareFuncIndicesArgs

RunnerSelectArgs

ComparatorPostprocessArgs: if allow_postprocessing == True

Parameters: allow_postprocessing (bool) – Whether to post-processing of outputs before comparison. Defaults to True.

parse_impl(args)[source]

Parses command-line arguments and populates the following attributes:

validate

Whether to run output validation.

load_outputs_paths

Path(s) from which to load outputs.

fail_fast

Whether to fail fast.

compare_func

The name of the comparison function to use.

compare_func_script

Path to a script defining a custom comparison function.

compare_func_name

The name of the function in the script that runs comparison.

add_to_script_impl(script, results_name)[source]

Parameters: results_name (str) – The name of the variable containing results from Comparator.run().
Returns: The name of the variable containing the status of Comparator.compare_accuracy().
Return type: str