Command-line Argument Groups¶
Command-line argument groups bundle arguments and related functionality together into reusable components and are used throughout the Polygraphy command-line toolkit.
Argument groups are used to add new command-line tools to Polygraphy or extend existing tools with new functionality.
Module: polygraphy.tools.args
- Base Interface
- Backends
- ONNX
- Loaders
OnnxInferShapesArgsOnnxSaveArgsOnnxLoadArgsOnnxLoadArgs.parse_impl()OnnxLoadArgs.outputsOnnxLoadArgs.mark_typesOnnxLoadArgs.exclude_outputsOnnxLoadArgs.external_data_dirOnnxLoadArgs.ignore_external_dataOnnxLoadArgs.convert_to_fp16OnnxLoadArgs.upper_boundsOnnxLoadArgs.add_to_script_impl()OnnxLoadArgs.must_use_onnx_loader()OnnxLoadArgs.load_onnx()
OnnxFromTfArgs
- Loaders
- ONNX-Runtime
- Plugin Reference
- TensorFlow
- TensorRT
- Loaders
TrtLoadPluginsArgsTrtOnnxFlagArgsTrtLoadNetworkArgsTrtLoadNetworkArgs.parse_impl()TrtLoadNetworkArgs.outputsTrtLoadNetworkArgs.mark_layer_typesTrtLoadNetworkArgs.exclude_outputsTrtLoadNetworkArgs.layer_precisionsTrtLoadNetworkArgs.decomposable_attentionsTrtLoadNetworkArgs.tensor_datatypesTrtLoadNetworkArgs.tensor_formatsTrtLoadNetworkArgs.postprocess_scriptsTrtLoadNetworkArgs.strongly_typedTrtLoadNetworkArgs.mark_debugTrtLoadNetworkArgs.mark_unfused_tensors_as_debug_tensorsTrtLoadNetworkArgs.load_network()
TrtSaveEngineBytesArgsTrtSaveEngineArgsTrtLoadEngineBytesArgsTrtLoadEngineArgsTrtConfigArgsTrtConfigArgs.parse_impl()TrtConfigArgs.profile_dictsTrtConfigArgs.tf32TrtConfigArgs.fp16TrtConfigArgs.bf16TrtConfigArgs.fp8TrtConfigArgs.int8TrtConfigArgs.precision_constraintsTrtConfigArgs.restrictedTrtConfigArgs.calibration_cacheTrtConfigArgs.calibration_base_classTrtConfigArgs.sparse_weightsTrtConfigArgs.load_timing_cacheTrtConfigArgs.load_tacticsTrtConfigArgs.save_tacticsTrtConfigArgs.tactic_sourcesTrtConfigArgs.trt_config_scriptTrtConfigArgs.trt_config_func_nameTrtConfigArgs.trt_config_postprocess_scriptTrtConfigArgs.trt_config_postprocess_func_nameTrtConfigArgs.use_dlaTrtConfigArgs.allow_gpu_fallbackTrtConfigArgs.memory_pool_limitsTrtConfigArgs.engine_capabilityTrtConfigArgs.direct_ioTrtConfigArgs.preview_featuresTrtConfigArgs.refittableTrtConfigArgs.strip_planTrtConfigArgs.builder_optimization_levelTrtConfigArgs.hardware_compatibility_levelTrtConfigArgs.profiling_verbosityTrtConfigArgs.max_aux_streamsTrtConfigArgs.version_compatibleTrtConfigArgs.exclude_lean_runtimeTrtConfigArgs.quantization_flagsTrtConfigArgs.error_on_timing_cache_missTrtConfigArgs.disable_compilation_cacheTrtConfigArgs.weight_streamingTrtConfigArgs.runtime_platformTrtConfigArgs.tiling_optimization_levelTrtConfigArgs.use_gpuTrtConfigArgs.compute_capabilitiesTrtConfigArgs.create_config()
- Runners
- Loaders
- ONNX
- Comparator
- Comparator
ComparatorRunArgsComparatorCompareArgsComparatorCompareArgs.parse_impl()ComparatorCompareArgs.no_shape_checkComparatorCompareArgs.validateComparatorCompareArgs.load_outputs_pathsComparatorCompareArgs.fail_fastComparatorCompareArgs.compare_funcsComparatorCompareArgs.compare_func_scriptComparatorCompareArgs.compare_func_nameComparatorCompareArgs.add_to_script_impl()
- Comparison Functions
CompareFuncSimpleArgsCompareFuncSimpleArgs.parse_impl()CompareFuncSimpleArgs.rtolCompareFuncSimpleArgs.atolCompareFuncSimpleArgs.check_error_statCompareFuncSimpleArgs.infinities_compare_equalCompareFuncSimpleArgs.save_heatmapsCompareFuncSimpleArgs.show_heatmapsCompareFuncSimpleArgs.save_error_metrics_plotCompareFuncSimpleArgs.show_error_metrics_plotCompareFuncSimpleArgs.error_quantile
CompareFuncIndicesArgsCompareFuncDistanceMetricsArgsCompareFuncQualityMetricsArgsCompareFuncPerceptualMetricsArgs
- Data Loader
DataLoaderArgsDataLoaderArgs.parse_impl()DataLoaderArgs.seedDataLoaderArgs.val_rangeDataLoaderArgs.iterationsDataLoaderArgs.load_inputs_pathsDataLoaderArgs.data_loader_scriptDataLoaderArgs.data_loader_func_nameDataLoaderArgs.data_loader_backend_moduleDataLoaderArgs.add_to_script_impl()DataLoaderArgs.get_data_loader()DataLoaderArgs.is_using_random_data()
- Postprocessing Functions
- Comparator
- Logger
- Model