Index

_

__bool__() (AccuracyResult method) __call__() (BaseCompareFunc method) (BaseLoader method) (BasePostprocessFunc method) (BufferFromEngine method) (BytesFromEngine method) (BytesFromOnnx method) (BytesFromPath method) (ConvertToFp16 method) (CreateConfig method), [1] (CreateNetwork method) (EngineBytesFromNetwork method) (EngineFromBytes method) (EngineFromNetwork method) (EngineFromPath method) (ExtractSubgraph method) (FoldConstants method) (GraphFromCkpt method) (GraphFromFrozen method) (GraphFromKeras method) (GsFromOnnx method) (IndicesCompareFunc method) (InferShapes method) (InvokeFromScript method) (LoadPlugins method) (LoadRuntime method) (MarkDebug method) (ModifyGraphOutputs method) (ModifyNetworkOutputs method) (ModifyOutputs method) (NetworkFromOnnxBytes method) (NetworkFromOnnxPath method) (OnnxFromBytes method) (OnnxFromPath method) (OnnxFromTfGraph method) (OnnxLikeFromNetwork method) (OptimizeGraph method) (PostprocessConfig method) (PostprocessNetwork method) (SaveBytes method) (SaveEngine method) (SaveGraph method) (SaveOnnx method) (SessionFromGraph method) (SessionFromOnnx method) (SetDecomposableAttentions method) (SetLayerPrecisions method) (SetTensorDatatypes method) (SetTensorFormats method) (SetUpperBound method) (SimpleCompareFunc method) (TopKPostprocessFunc method) (UseTfTrt method)

__enter__() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) __exit__() (BaseRunner method) (DeviceArray method) (OnnxrtRunner method) (PluginRefRunner method) (Stream method) (TfRunner method) (TrtRunner method) __getitem__() (DataLoader method) (Profile method)

A

AccuracyResult (class in polygraphy.comparator.struct) AccuracyResults (class in polygraphy.comparator.struct) activate() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) add() (Profile method) (RunResults method) (TacticReplayData method) (TensorMetadata method) add_import() (Script method) add_loader() (Script method) add_parser_args() (BaseArgs method) add_runner() (Script method) add_to_script() (BaseArgs method) (BaseRunnerArgs method) add_to_script_impl() (ComparatorCompareArgs method) (ComparatorPostprocessArgs method) (DataLoaderArgs method) (OnnxInferShapesArgs method) (OnnxLoadArgs method) (OnnxSaveArgs method) (TfLoadArgs method) (TfTrtArgs method) (TrtLoadEngineArgs method) (TrtLoadEngineBytesArgs method) (TrtLoadPluginsArgs method) (TrtSaveEngineBytesArgs method)

add_var() (Script method) Algorithm (class in polygraphy.backend.trt.algorithm_selector) all_tensors_to_one_file (OnnxSaveArgs attribute) allocation_strategy (TrtRunnerArgs attribute) allow_gpu_fallback (TrtConfigArgs attribute) allow_growth (TfConfigArgs attribute) allow_onnxruntime (OnnxInferShapesArgs attribute) allows_abbreviation() (BaseArgs method) append_preimport() (Script method) append_suffix() (Script method) arg_groups (BaseArgs attribute) ArgGroups (class in polygraphy.tools.args.base) ARRAY_SWAP_THRESHOLD_MB (in module polygraphy.config) ASK_BEFORE_INSTALL (in module polygraphy.config) atol (CompareFuncSimpleArgs attribute) AUTOINSTALL_DEPS (in module polygraphy.config) average_results() (AccuracyResult method)

B

BaseArgs (class in polygraphy.tools.args.base) BaseCompareFunc (class in polygraphy.comparator.compare) BaseLoader (class in polygraphy.backend.base.loader) BasePostprocessFunc (class in polygraphy.comparator.postprocess) BaseRunner (class in polygraphy.backend.base.runner) BaseRunnerArgs (class in polygraphy.tools.args.base) bf16 (TrtConfigArgs attribute) buffer_from_engine() (in module polygraphy.backend.trt.loader)

BufferFromEngine (class in polygraphy.backend.trt.loader) build_compare_funcs() (ComparatorCompareArgs method) builder_optimization_level (TrtConfigArgs attribute) bytes_from_engine() (in module polygraphy.backend.trt.loader) bytes_from_onnx() (in module polygraphy.backend.onnx.loader) bytes_from_path() (in module polygraphy.backend.common.loader) BytesFromEngine (class in polygraphy.backend.trt.loader) BytesFromOnnx (class in polygraphy.backend.onnx.loader) BytesFromPath (class in polygraphy.backend.common.loader)

C

calibration_base_class (TrtConfigArgs attribute) calibration_cache (TrtConfigArgs attribute) Calibrator() (in module polygraphy.backend.trt.calibrator) call_impl() (BufferFromEngine method) (BytesFromEngine method) (BytesFromOnnx method) (BytesFromPath method) (ConvertToFp16 method) (CreateConfig method), [1] (CreateNetwork method) (EngineBytesFromNetwork method) (EngineFromBytes method) (EngineFromNetwork method) (EngineFromPath method) (ExtractSubgraph method) (FoldConstants method) (GraphFromCkpt method) (GraphFromFrozen method) (GraphFromKeras method) (GsFromOnnx method) (InferShapes method) (InvokeFromScript method) (LoadPlugins method) (LoadRuntime method) (MarkDebug method) (ModifyGraphOutputs method) (ModifyNetworkOutputs method) (ModifyOutputs method) (NetworkFromOnnxBytes method) (NetworkFromOnnxPath method) (OnnxFromBytes method) (OnnxFromPath method) (OnnxFromTfGraph method) (OnnxLikeFromNetwork method) (OptimizeGraph method) (PostprocessConfig method) (PostprocessNetwork method) (SaveBytes method) (SaveEngine method) (SaveGraph method) (SaveOnnx method) (SessionFromGraph method) (SessionFromOnnx method) (SetDecomposableAttentions method) (SetLayerPrecisions method) (SetTensorDatatypes method) (SetTensorFormats method) (SetUpperBound method) (UseTfTrt method)

check_average (ComparatorCompareArgs attribute) check_error_stat (CompareFuncSimpleArgs attribute) ckpt (TfLoadArgs attribute) Comparator (class in polygraphy.comparator.comparator) ComparatorCompareArgs (class in polygraphy.tools.args.comparator.comparator) ComparatorPostprocessArgs (class in polygraphy.tools.args.comparator.postprocess) ComparatorRunArgs (class in polygraphy.tools.args.comparator.comparator) compare_accuracy() (Comparator static method) compare_func_name (ComparatorCompareArgs attribute) compare_func_script (ComparatorCompareArgs attribute) compare_funcs (ComparatorCompareArgs attribute) CompareFunc (class in polygraphy.comparator.compare) CompareFuncCosineSimilarityArgs (class in polygraphy.tools.args.comparator.compare) CompareFuncIndicesArgs (class in polygraphy.tools.args.comparator.compare) CompareFuncL2Args (class in polygraphy.tools.args.comparator.compare) CompareFuncPerceptualMetricsArgs (class in polygraphy.tools.args.comparator.compare) CompareFuncPsnrArgs (class in polygraphy.tools.args.comparator.compare) CompareFuncSimpleArgs (class in polygraphy.tools.args.comparator.compare) CompareFuncSnrArgs (class in polygraphy.tools.args.comparator.compare) CompareResult (class in polygraphy.comparator.compare) compute_capabilities (TrtConfigArgs attribute) concat() (RunResults static method) convert_to_fp16 (OnnxLoadArgs attribute) convert_to_fp16() (in module polygraphy.backend.onnx.loader) ConvertToFp16 (class in polygraphy.backend.onnx.loader) copy_from() (DeviceArray method) copy_to() (DeviceArray method) (DeviceView method) cosine_similarity_threshold (CompareFuncCosineSimilarityArgs attribute) CosineSimilarityCompareFunc (class in polygraphy.comparator.compare) CosineSimilarityResult (class in polygraphy.comparator.compare) CosineSimilarityThreshold (class in polygraphy.comparator.compare) create_config() (in module polygraphy.backend.tf.loader) (in module polygraphy.backend.trt.config) (TrtConfigArgs method) create_network() (in module polygraphy.backend.trt.loader) CreateConfig (class in polygraphy.backend.tf.loader) (class in polygraphy.backend.trt.config) CreateNetwork (class in polygraphy.backend.trt.loader) CRITICAL (Logger attribute) critical() (Logger method) Cuda (class in polygraphy.cuda.cuda)

D

data_loader_backend_module (DataLoaderArgs attribute) data_loader_func_name (DataLoaderArgs attribute) data_loader_script (DataLoaderArgs attribute) DataLoader (class in polygraphy.comparator.data_loader) DataLoaderArgs (class in polygraphy.tools.args.comparator.data_loader) DataType (class in polygraphy.datatype.datatype) DataTypeConversionException DataTypeEntry (class in polygraphy.datatype.datatype) deactivate() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method)

decomposable_attentions (TrtLoadNetworkArgs attribute) describe() (CompareResult method) (Threshold method) describe_average() (AccuracyResult method) DeviceArray (class in polygraphy.cuda.cuda) DeviceToDevice (MemcpyKind attribute) DeviceToHost (MemcpyKind attribute) DeviceView (class in polygraphy.cuda.cuda) direct_io (TrtConfigArgs attribute) disable_compilation_cache (TrtConfigArgs attribute) do_shape_inference (OnnxInferShapesArgs attribute) dtype (DeviceArray property) (DeviceView property) dynamic_op (TfTrtArgs attribute)

E

EACH (LogMode attribute) engine_bytes_from_network() (in module polygraphy.backend.trt.loader) engine_capability (TrtConfigArgs attribute) engine_from_bytes() (in module polygraphy.backend.trt.loader) engine_from_network() (in module polygraphy.backend.trt.loader) engine_from_path() (in module polygraphy.backend.trt.loader) EngineBytesFromNetwork (class in polygraphy.backend.trt.loader) EngineFromBytes (class in polygraphy.backend.trt.loader) EngineFromNetwork (class in polygraphy.backend.trt.loader) EngineFromPath (class in polygraphy.backend.trt.loader) ERROR (Logger attribute) error() (Logger method)

error_on_timing_cache_miss (TrtConfigArgs attribute) error_quantile (CompareFuncSimpleArgs attribute) exclude_lean_runtime (TrtConfigArgs attribute) exclude_outputs (OnnxLoadArgs attribute) (TrtLoadNetworkArgs attribute) extend() (in module polygraphy.func.func) external_data_dir (OnnxLoadArgs attribute) external_data_path (OnnxSaveArgs attribute) extra_model_info (ModelArgs attribute) EXTRA_VERBOSE (Logger attribute) extra_verbose() (Logger method) extract_subgraph() (in module polygraphy.backend.onnx.loader) ExtractSubgraph (class in polygraphy.backend.onnx.loader)

F

fail_fast (ComparatorCompareArgs attribute) fallback_inference() (OnnxInferShapesArgs method) fill_defaults() (Profile method) FINISH (Logger attribute) finish() (Logger method) flags (TrtOnnxFlagArgs attribute) fold_constants() (in module polygraphy.backend.onnx.loader) FoldConstants (class in polygraphy.backend.onnx.loader) force_fallback (OnnxInferShapesArgs attribute) FormattedArray (class in polygraphy.common.struct) fp16 (TrtConfigArgs attribute) fp8 (TrtConfigArgs attribute)

free() (Cuda method) (DeviceArray method) (Stream method) freeze_graph (TfLoadArgs attribute) from_dtype() (DataType static method) from_feed_dict() (TensorMetadata static method) from_json() (AccuracyResults static method) (FormattedArray static method) (in module polygraphy.json.serde) (RunResults static method) (TacticReplayData static method) from_trt() (Algorithm static method) (TensorInfo static method)

G

G_LOGGER (in module polygraphy.logger.logger) get() (SeverityTrie method) get_data_loader() (DataLoaderArgs method) get_extra_help_text() (BaseRunnerArgs method) get_flags() (TrtOnnxFlagArgs method) get_input_metadata() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) get_logger() (LoggerArgs method)

get_name_opt() (BaseRunnerArgs method) get_trt_logger() (in module polygraphy.backend.trt.util) gpu_memory_fraction (TfConfigArgs attribute) graph_from_ckpt() (in module polygraphy.backend.tf.loader) graph_from_frozen() (in module polygraphy.backend.tf.loader) graph_from_keras() (in module polygraphy.backend.tf.loader) GraphFromCkpt (class in polygraphy.backend.tf.loader) GraphFromFrozen (class in polygraphy.backend.tf.loader) GraphFromKeras (class in polygraphy.backend.tf.loader) group (BaseArgs attribute) gs_from_onnx() (in module polygraphy.backend.onnx.loader) GsFromOnnx (class in polygraphy.backend.onnx.loader)

H

hardware_compatibility_level (TrtConfigArgs attribute)

HostToDevice (MemcpyKind attribute) HostToHost (MemcpyKind attribute)

I

ignore_external_data (OnnxLoadArgs attribute) indent() (Logger method) index_tolerance (CompareFuncIndicesArgs attribute) indices() (CompareFunc static method) IndicesCompareFunc (class in polygraphy.comparator.compare) infer() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) infer_impl() (OnnxrtRunner method) (TrtRunner method) infer_shapes() (in module polygraphy.backend.onnx.loader) (OnnxInferShapesArgs method) inference_time (BaseRunner attribute) (OnnxrtRunner attribute) (PluginRefRunner attribute) (TfRunner attribute) (TrtRunner attribute) InferShapes (class in polygraphy.backend.onnx.loader)

infinities_compare_equal (CompareFuncSimpleArgs attribute) INFO (Logger attribute) info() (Logger method) inline() (in module polygraphy.tools.script) input_shapes (ModelArgs attribute) INSTALL_CMD (in module polygraphy.config) int8 (TrtConfigArgs attribute) INTERNAL_CORRECTNESS_CHECKS (in module polygraphy.config) invoke_from_script() (in module polygraphy.backend.common.loader) InvokeFromScript (class in polygraphy.backend.common.loader) is_active (BaseRunner attribute) (OnnxrtRunner attribute) (PluginRefRunner attribute) (TfRunner attribute) (TrtRunner attribute) is_using_random_data() (DataLoaderArgs method) items() (RunResults method) itemsize (DataTypeEntry attribute) IterationResult (class in polygraphy.comparator.struct) iterations (DataLoaderArgs attribute)

K

keys() (RunResults method)

L

l2_threshold (CompareFuncL2Args attribute) L2CompareFunc (class in polygraphy.comparator.compare) L2Result (class in polygraphy.comparator.compare) L2Threshold (class in polygraphy.comparator.compare) last_inference_time() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) layer_precisions (TrtLoadNetworkArgs attribute) load() (AccuracyResults static method) (FormattedArray static method) (RunResults static method) (TacticReplayData static method) load_engine() (TrtLoadEngineArgs method) load_engine_bytes() (TrtLoadEngineBytesArgs method) load_graph() (TfLoadArgs method) load_inputs_paths (DataLoaderArgs attribute) load_json() (in module polygraphy.json.serde) load_network() (TrtLoadNetworkArgs method)

load_onnx() (OnnxLoadArgs method) load_onnxrt_session() (OnnxrtSessionArgs method) load_outputs_paths (ComparatorCompareArgs attribute) load_plugins() (in module polygraphy.backend.trt.loader) load_runtime (TrtLoadEngineArgs attribute) load_runtime() (in module polygraphy.backend.trt.loader) load_streaming() (RunResults static method) load_tactics (TrtConfigArgs attribute) load_timing_cache (TrtConfigArgs attribute) LoadPlugins (class in polygraphy.backend.trt.loader) LoadRuntime (class in polygraphy.backend.trt.loader) log() (Logger method) log_exception() (Logger method) log_file (Logger property) (LoggerArgs attribute) log_format (LoggerArgs attribute) Logger (class in polygraphy.logger.logger) LoggerArgs (class in polygraphy.tools.args.logger.logger) LogMode (class in polygraphy.logger.logger) lpips_threshold (CompareFuncPerceptualMetricsArgs attribute) LpipsThreshold (class in polygraphy.comparator.compare)

M

make_invocable() (in module polygraphy.tools.script) make_invocable_if_nondefault() (in module polygraphy.tools.script) make_invocable_if_nondefault_kwargs() (in module polygraphy.tools.script) make_postprocess_func() (ComparatorPostprocessArgs method) malloc() (Cuda method) MARK_ALL (in module polygraphy.constants) mark_debug (TrtLoadNetworkArgs attribute) mark_debug() (in module polygraphy.backend.trt.loader) mark_layer_types (TrtLoadNetworkArgs attribute) mark_types (OnnxLoadArgs attribute) mark_unfused_tensors_as_debug_tensors (TrtLoadNetworkArgs attribute) MarkDebug (class in polygraphy.backend.trt.loader) max_aux_streams (TrtConfigArgs attribute) memcpy() (Cuda method) MemcpyKind (class in polygraphy.cuda.cuda) memory_pool_limits (TrtConfigArgs attribute) metric_fields() (CompareResult class method) (Threshold class method) metric_values() (CompareResult method) minimum_segment_size (TfTrtArgs attribute) model_type (ModelArgs attribute) ModelArgs (class in polygraphy.tools.args.model) ModelArgs.ModelType (class in polygraphy.tools.args.model) modify_graph_outputs() (in module polygraphy.backend.tf.loader) modify_network_outputs() (in module polygraphy.backend.trt.loader) modify_outputs() (in module polygraphy.backend.onnx.loader) ModifyGraphOutputs (class in polygraphy.backend.tf.loader) ModifyNetworkOutputs (class in polygraphy.backend.trt.loader) ModifyOutputs (class in polygraphy.backend.onnx.loader) module polygraphy.backend.base.loader polygraphy.backend.base.runner polygraphy.backend.common.loader polygraphy.backend.onnx.loader polygraphy.backend.onnxrt.loader polygraphy.backend.onnxrt.runner polygraphy.backend.pluginref.runner polygraphy.backend.tf.loader polygraphy.backend.tf.runner polygraphy.backend.trt.algorithm_selector polygraphy.backend.trt.calibrator polygraphy.backend.trt.config polygraphy.backend.trt.loader polygraphy.backend.trt.profile polygraphy.backend.trt.runner polygraphy.backend.trt.util polygraphy.common.struct polygraphy.comparator.comparator polygraphy.comparator.compare polygraphy.comparator.data_loader polygraphy.comparator.postprocess polygraphy.comparator.struct polygraphy.config polygraphy.constants polygraphy.cuda.cuda polygraphy.datatype.datatype polygraphy.exception.exception polygraphy.func.func polygraphy.json.serde polygraphy.logger.logger polygraphy.tools.args.backend.onnx.loader polygraphy.tools.args.backend.onnxrt.loader polygraphy.tools.args.backend.onnxrt.runner polygraphy.tools.args.backend.pluginref.runner polygraphy.tools.args.backend.tf.config polygraphy.tools.args.backend.tf.loader polygraphy.tools.args.backend.tf.runner polygraphy.tools.args.backend.trt.config polygraphy.tools.args.backend.trt.loader polygraphy.tools.args.backend.trt.runner polygraphy.tools.args.base polygraphy.tools.args.comparator.comparator polygraphy.tools.args.comparator.compare polygraphy.tools.args.comparator.data_loader polygraphy.tools.args.comparator.postprocess polygraphy.tools.args.logger.logger polygraphy.tools.args.model polygraphy.tools.script

module_path() (Logger method) module_severity (Logger property) must_use_onnx_loader() (OnnxLoadArgs method)

N

name (DataTypeEntry attribute) nbytes (DeviceArray property) (DeviceView property) network_from_onnx_bytes() (in module polygraphy.backend.trt.loader) network_from_onnx_path() (in module polygraphy.backend.trt.loader)

NetworkFromOnnxBytes (class in polygraphy.backend.trt.loader) NetworkFromOnnxPath (class in polygraphy.backend.trt.loader) no_shape_check (ComparatorCompareArgs attribute) numpy() (DataTypeEntry method) (DeviceArray method) (DeviceView method)

O

ONCE (LogMode attribute) onnx() (DataTypeEntry method) onnx_from_bytes() (in module polygraphy.backend.onnx.loader) onnx_from_path() (in module polygraphy.backend.onnx.loader) onnx_from_tf_graph() (in module polygraphy.backend.onnx.loader) onnx_like_from_network() (in module polygraphy.backend.trt.loader) OnnxFromBytes (class in polygraphy.backend.onnx.loader) OnnxFromPath (class in polygraphy.backend.onnx.loader) OnnxFromTfArgs (class in polygraphy.tools.args.backend.onnx.loader) OnnxFromTfGraph (class in polygraphy.backend.onnx.loader) OnnxInferShapesArgs (class in polygraphy.tools.args.backend.onnx.loader) OnnxLikeFromNetwork (class in polygraphy.backend.trt.loader) OnnxLoadArgs (class in polygraphy.tools.args.backend.onnx.loader) OnnxrtRunner (class in polygraphy.backend.onnxrt.runner)

OnnxrtRunnerArgs (class in polygraphy.tools.args.backend.onnxrt.runner) OnnxrtSessionArgs (class in polygraphy.tools.args.backend.onnxrt.loader) onnxruntime() (DataTypeEntry method) OnnxSaveArgs (class in polygraphy.tools.args.backend.onnx.loader) opset (OnnxFromTfArgs attribute) optimization_profile (TrtRunnerArgs attribute) optimize_graph() (in module polygraphy.backend.tf.loader) OptimizeGraph (class in polygraphy.backend.tf.loader) output_names() (AccuracyResult method) (AccuracyResults method) OutputCompareResult (class in polygraphy.comparator.compare) outputs (OnnxLoadArgs attribute) (TfLoadArgs attribute) (TrtLoadNetworkArgs attribute)

P

parse() (BaseArgs method) parse_impl() (ComparatorCompareArgs method) (ComparatorPostprocessArgs method) (ComparatorRunArgs method) (CompareFuncCosineSimilarityArgs method) (CompareFuncIndicesArgs method) (CompareFuncL2Args method) (CompareFuncPerceptualMetricsArgs method) (CompareFuncPsnrArgs method) (CompareFuncSimpleArgs method) (CompareFuncSnrArgs method) (DataLoaderArgs method) (LoggerArgs method) (ModelArgs method) (OnnxFromTfArgs method) (OnnxInferShapesArgs method) (OnnxLoadArgs method) (OnnxrtSessionArgs method) (OnnxSaveArgs method) (TfConfigArgs method) (TfLoadArgs method) (TfRunnerArgs method) (TfTrtArgs method) (TrtConfigArgs method) (TrtLoadEngineArgs method) (TrtLoadEngineBytesArgs method) (TrtLoadNetworkArgs method) (TrtLoadPluginsArgs method) (TrtOnnxFlagArgs method) (TrtRunnerArgs method) (TrtSaveEngineBytesArgs method) passed() (LpipsThreshold method) (SimpleThreshold method) (Threshold method) path (ModelArgs attribute) (OnnxSaveArgs attribute) (TrtSaveEngineBytesArgs attribute) percentage() (AccuracyResult method) perceptual_metrics() (CompareFunc static method) PerceptualMetricsCompareFunc (class in polygraphy.comparator.compare) PerceptualMetricsResult (class in polygraphy.comparator.compare) PluginRefRunner (class in polygraphy.backend.pluginref.runner) PluginRefRunnerArgs (class in polygraphy.tools.args.backend.pluginref.runner) plugins (TrtLoadPluginsArgs attribute) polygraphy.backend.base.loader module polygraphy.backend.base.runner module polygraphy.backend.common.loader module polygraphy.backend.onnx.loader module polygraphy.backend.onnxrt.loader module polygraphy.backend.onnxrt.runner module polygraphy.backend.pluginref.runner module polygraphy.backend.tf.loader module polygraphy.backend.tf.runner module polygraphy.backend.trt.algorithm_selector module polygraphy.backend.trt.calibrator module polygraphy.backend.trt.config module polygraphy.backend.trt.loader module polygraphy.backend.trt.profile module polygraphy.backend.trt.runner module polygraphy.backend.trt.util module polygraphy.common.struct module polygraphy.comparator.comparator module polygraphy.comparator.compare module

polygraphy.comparator.data_loader module polygraphy.comparator.postprocess module polygraphy.comparator.struct module polygraphy.config module polygraphy.constants module polygraphy.cuda.cuda module polygraphy.datatype.datatype module polygraphy.exception.exception module polygraphy.func.func module polygraphy.json.serde module polygraphy.logger.logger module polygraphy.tools.args.backend.onnx.loader module polygraphy.tools.args.backend.onnxrt.loader module polygraphy.tools.args.backend.onnxrt.runner module polygraphy.tools.args.backend.pluginref.runner module polygraphy.tools.args.backend.tf.config module polygraphy.tools.args.backend.tf.loader module polygraphy.tools.args.backend.tf.runner module polygraphy.tools.args.backend.trt.config module polygraphy.tools.args.backend.trt.loader module polygraphy.tools.args.backend.trt.runner module polygraphy.tools.args.base module polygraphy.tools.args.comparator.comparator module polygraphy.tools.args.comparator.compare module polygraphy.tools.args.comparator.data_loader module polygraphy.tools.args.comparator.postprocess module polygraphy.tools.args.logger.logger module polygraphy.tools.args.model module polygraphy.tools.script module PolygraphyException PolygraphyInternalException postprocess (ComparatorPostprocessArgs attribute) postprocess() (Comparator static method) postprocess_config() (in module polygraphy.backend.trt.config) postprocess_func_name (ComparatorPostprocessArgs attribute) postprocess_func_script (ComparatorPostprocessArgs attribute) postprocess_network() (in module polygraphy.backend.trt.loader) postprocess_scripts (TrtLoadNetworkArgs attribute) PostprocessConfig (class in polygraphy.backend.trt.config) PostprocessFunc (class in polygraphy.comparator.postprocess) PostprocessNetwork (class in polygraphy.backend.trt.loader) precision_constraints (TrtConfigArgs attribute) preview_features (TrtConfigArgs attribute) Profile (class in polygraphy.backend.trt.profile) profile_dicts (TrtConfigArgs attribute) profiling_verbosity (TrtConfigArgs attribute) providers (OnnxrtSessionArgs attribute) psnr_threshold (CompareFuncPsnrArgs attribute) PsnrCompareFunc (class in polygraphy.comparator.compare) PsnrResult (class in polygraphy.comparator.compare) PsnrThreshold (class in polygraphy.comparator.compare) ptr (DeviceArray attribute) (DeviceView attribute) (Stream attribute)

Q

quantization_flags (TrtConfigArgs attribute)

R

raw() (DeviceArray static method) reevaluate() (AccuracyResult method) (AccuracyResults method) refittable (TrtConfigArgs attribute) register() (BaseArgs method) register_callback() (Logger method)

resize() (DeviceArray method) restricted (TrtConfigArgs attribute) rtol (CompareFuncSimpleArgs attribute) run() (Comparator static method) RunResults (class in polygraphy.comparator.struct) runtime_platform (TrtConfigArgs attribute)

S

safe() (in module polygraphy.tools.script) save() (AccuracyResults method) (FormattedArray method) (RunResults method) (Script method) (TacticReplayData method) save_accuracy_results_path (ComparatorCompareArgs attribute) save_bytes() (in module polygraphy.backend.common.loader) save_engine() (in module polygraphy.backend.trt.loader) save_engine_bytes() (TrtSaveEngineBytesArgs method) save_error_metrics_plot (CompareFuncSimpleArgs attribute) save_frozen_graph_path (TfLoadArgs attribute) save_graph() (in module polygraphy.backend.tf.loader) save_heatmaps (CompareFuncSimpleArgs attribute) save_inputs_path (ComparatorRunArgs attribute) save_json() (in module polygraphy.json.serde) save_onnx() (in module polygraphy.backend.onnx.loader) (OnnxSaveArgs method) save_outputs_path (ComparatorRunArgs attribute) save_tactics (TrtConfigArgs attribute) save_tensorboard_path (TfLoadArgs attribute) save_timing_cache (TrtLoadEngineBytesArgs attribute) SaveBytes (class in polygraphy.backend.common.loader) SaveEngine (class in polygraphy.backend.trt.loader) SaveGraph (class in polygraphy.backend.tf.loader) SaveOnnx (class in polygraphy.backend.onnx.loader) Script (class in polygraphy.tools.script) Script.String (class in polygraphy.tools.script) seed (DataLoaderArgs attribute) session_from_graph() (in module polygraphy.backend.tf.loader) session_from_onnx() (in module polygraphy.backend.onnxrt.loader) SessionFromGraph (class in polygraphy.backend.tf.loader) SessionFromOnnx (class in polygraphy.backend.onnxrt.loader) set_data_loader() (Script method) set_debug_listener() (TrtRunner method) set_decomposable_attentions() (in module polygraphy.backend.trt.loader) set_layer_precisions() (in module polygraphy.backend.trt.loader) set_profile() (TrtRunner method)

set_tensor_datatypes() (in module polygraphy.backend.trt.loader) set_tensor_formats() (in module polygraphy.backend.trt.loader) set_thresholds() (CompareResult method) (OutputCompareResult method) set_upper_bound() (in module polygraphy.backend.onnx.loader) SetDecomposableAttentions (class in polygraphy.backend.trt.loader) SetLayerPrecisions (class in polygraphy.backend.trt.loader) SetTensorDatatypes (class in polygraphy.backend.trt.loader) SetTensorFormats (class in polygraphy.backend.trt.loader) SetUpperBound (class in polygraphy.backend.onnx.loader) SeverityTrie (class in polygraphy.logger.logger) shape (DeviceArray attribute) (DeviceView attribute) ShapeTuple (class in polygraphy.backend.trt.profile) show_error_metrics_plot (CompareFuncSimpleArgs attribute) show_heatmaps (CompareFuncSimpleArgs attribute) silent (LoggerArgs attribute) simple() (CompareFunc static method) SimpleCompareFunc (class in polygraphy.comparator.compare) SimpleThreshold (class in polygraphy.comparator.compare) size_threshold (OnnxSaveArgs attribute) snr_threshold (CompareFuncSnrArgs attribute) SnrCompareFunc (class in polygraphy.comparator.compare) SnrResult (class in polygraphy.comparator.compare) SnrThreshold (class in polygraphy.comparator.compare) sparse_weights (TrtConfigArgs attribute) split() (RunResults method) START (Logger attribute) start() (Logger method) stats() (AccuracyResult method) Stream (class in polygraphy.cuda.cuda) streaming (ComparatorCompareArgs attribute) StreamingDataLoader (class in polygraphy.comparator.data_loader) strip_plan (TrtConfigArgs attribute) strongly_typed (TrtLoadNetworkArgs attribute) SUPER_VERBOSE (Logger attribute) super_verbose() (Logger method) synchronize() (Stream method)

T

tactic_sources (TrtConfigArgs attribute) TacticRecorder() (in module polygraphy.backend.trt.algorithm_selector) TacticReplayData (class in polygraphy.backend.trt.algorithm_selector) TacticReplayer() (in module polygraphy.backend.trt.algorithm_selector) tensor_datatypes (TrtLoadNetworkArgs attribute) tensor_formats (TrtLoadNetworkArgs attribute) TensorInfo (class in polygraphy.backend.trt.algorithm_selector) TensorMetadata (class in polygraphy.common.struct) tensorrt() (DataTypeEntry method) tf32 (TrtConfigArgs attribute) TfConfigArgs (class in polygraphy.tools.args.backend.tf.config) TfLoadArgs (class in polygraphy.tools.args.backend.tf.loader) TfRunner (class in polygraphy.backend.tf.runner) TfRunnerArgs (class in polygraphy.tools.args.backend.tf.runner) TfTrtArgs (class in polygraphy.tools.args.backend.tf.loader) Threshold (class in polygraphy.comparator.compare) thresholds_for() (BaseCompareFunc method) (SimpleCompareFunc method) tiling_optimization_level (TrtConfigArgs attribute) timeline_path (TfRunnerArgs attribute) to_dtype() (DataType static method) to_json() (AccuracyResults method) (FormattedArray method) (in module polygraphy.json.serde) (RunResults method) (TacticReplayData method)

to_trt() (Profile method) top_k() (PostprocessFunc static method) TopKPostprocessFunc (class in polygraphy.comparator.postprocess) torch() (DataTypeEntry method) trt_config_func_name (TrtConfigArgs attribute) trt_config_postprocess_func_name (TrtConfigArgs attribute) trt_config_postprocess_script (TrtConfigArgs attribute) trt_config_script (TrtConfigArgs attribute) TrtConfigArgs (class in polygraphy.tools.args.backend.trt.config) TrtLoadEngineArgs (class in polygraphy.tools.args.backend.trt.loader) TrtLoadEngineBytesArgs (class in polygraphy.tools.args.backend.trt.loader) TrtLoadNetworkArgs (class in polygraphy.tools.args.backend.trt.loader) TrtLoadPluginsArgs (class in polygraphy.tools.args.backend.trt.loader) TrtOnnxFlagArgs (class in polygraphy.tools.args.backend.trt.loader) TrtRunner (class in polygraphy.backend.trt.runner) TrtRunnerArgs (class in polygraphy.tools.args.backend.trt.runner) TrtSaveEngineArgs (class in polygraphy.tools.args.backend.trt.loader) TrtSaveEngineBytesArgs (class in polygraphy.tools.args.backend.trt.loader)

U

ULTRA_VERBOSE (Logger attribute) ultra_verbose() (Logger method) unwrap() (Script.String method) update() (RunResults method) upper_bounds (OnnxLoadArgs attribute) use_dla (TrtConfigArgs attribute)

use_gpu (TrtConfigArgs attribute) use_subprocess (ComparatorRunArgs attribute) USE_TENSORRT_RTX (in module polygraphy.config) use_tf_trt() (in module polygraphy.backend.tf.loader) use_tftrt (TfTrtArgs attribute) UseTfTrt (class in polygraphy.backend.tf.loader)

V

val_range (DataLoaderArgs attribute) validate (ComparatorCompareArgs attribute) validate() (Comparator static method) values() (RunResults method) VERBOSE (Logger attribute)

verbose() (Logger method) verbosity (LoggerArgs attribute) verbosity() (Logger method) version_compatible (TrtConfigArgs attribute) view() (DeviceArray method)

W

warm_up (ComparatorRunArgs attribute) WARNING (Logger attribute) warning() (Logger method)

weight_streaming (TrtConfigArgs attribute) weight_streaming_budget (TrtRunnerArgs attribute) weight_streaming_percent (TrtRunnerArgs attribute) wrapper() (in module polygraphy.cuda.cuda)

X

xla (TfConfigArgs attribute)