Index

_

__bool__() (AccuracyResult method) (OutputCompareResult method) __call__() (BaseLoader method) (BytesFromEngine method) (BytesFromOnnx method) (BytesFromPath method) (ConvertToFp16 method) (CreateConfig method), [1] (CreateNetwork method) (EngineBytesFromNetwork method) (EngineFromBytes method) (EngineFromNetwork method) (ExtractSubgraph method) (FoldConstants method) (GraphFromCkpt method) (GraphFromFrozen method) (GraphFromKeras method) (GsFromOnnx method) (InferShapes method) (InvokeFromScript method) (LoadPlugins method) (ModifyGraphOutputs method) (ModifyNetworkOutputs method) (ModifyOutputs method) (NetworkFromOnnxBytes method) (NetworkFromOnnxPath method) (OnnxFromBytes method) (OnnxFromPath method) (OnnxFromTfGraph method) (OnnxLikeFromNetwork method) (OptimizeGraph method) (SaveBytes method) (SaveEngine method) (SaveGraph method) (SaveOnnx method) (SessionFromGraph method) (SessionFromOnnx method) (UseTfTrt method)

__enter__() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) __exit__() (BaseRunner method) (DeviceArray method) (OnnxrtRunner method) (PluginRefRunner method) (Stream method) (TfRunner method) (TrtRunner method) __getitem__() (DataLoader method) (Profile method)

A

AccuracyResult (class in polygraphy.comparator.struct) activate() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) add() (Profile method) (RunResults method) (TacticReplayData method) (TensorMetadata method) add_import() (Script method) add_loader() (Script method) add_parser_args() (BaseArgs method) add_runner() (Script method) add_to_script() (BaseArgs method) (BaseRunnerArgs method) add_to_script_impl() (ComparatorCompareArgs method) (ComparatorPostprocessArgs method) (DataLoaderArgs method) (OnnxInferShapesArgs method) (OnnxLoadArgs method) (OnnxSaveArgs method) (TfLoadArgs method) (TfTrtArgs method) (TrtLoadEngineArgs method) (TrtLoadPluginsArgs method) (TrtSaveEngineArgs method)

Algorithm (class in polygraphy.backend.trt.algorithm_selector) all_tensors_to_one_file (OnnxSaveArgs attribute) allow_gpu_fallback (TrtConfigArgs attribute) allow_growth (TfConfigArgs attribute) allows_abbreviation() (BaseArgs method) append_preimport() (Script method) append_suffix() (Script method) arg_groups (BaseArgs attribute) ArgGroups (class in polygraphy.tools.args.base) ARRAY_SWAP_THRESHOLD_MB (in module polygraphy.config) ASK_BEFORE_INSTALL (in module polygraphy.config) atol (CompareFuncSimpleArgs attribute) autoinstall() (in module polygraphy.mod.importer) AUTOINSTALL_DEPS (in module polygraphy.config)

B

BaseArgs (class in polygraphy.tools.args.base) BaseLoader (class in polygraphy.backend.base.loader) BaseRunner (class in polygraphy.backend.base.runner) BaseRunnerArgs (class in polygraphy.tools.args.base) bytes_from_engine() (in module polygraphy.backend.trt.loader)

bytes_from_onnx() (in module polygraphy.backend.onnx.loader) bytes_from_path() (in module polygraphy.backend.common.loader) BytesFromEngine (class in polygraphy.backend.trt.loader) BytesFromOnnx (class in polygraphy.backend.onnx.loader) BytesFromPath (class in polygraphy.backend.common.loader)

C

calibration_base_class (TrtConfigArgs attribute) calibration_cache (TrtConfigArgs attribute) Calibrator() (in module polygraphy.backend.trt.calibrator) call_impl() (BaseLoader method) (BytesFromEngine method) (BytesFromOnnx method) (BytesFromPath method) (ConvertToFp16 method) (CreateConfig method), [1] (CreateNetwork method) (EngineBytesFromNetwork method) (EngineFromBytes method) (EngineFromNetwork method) (ExtractSubgraph method) (FoldConstants method) (GraphFromCkpt method) (GraphFromFrozen method) (GraphFromKeras method) (GsFromOnnx method) (InferShapes method) (InvokeFromScript method) (LoadPlugins method) (ModifyGraphOutputs method) (ModifyNetworkOutputs method) (ModifyOutputs method) (NetworkFromOnnxBytes method) (NetworkFromOnnxPath method) (OnnxFromBytes method) (OnnxFromPath method) (OnnxFromTfGraph method) (OnnxLikeFromNetwork method) (OptimizeGraph method) (SaveBytes method) (SaveEngine method) (SaveGraph method) (SaveOnnx method) (SessionFromGraph method) (SessionFromOnnx method) (UseTfTrt method)

check_error_stat (CompareFuncSimpleArgs attribute) ckpt (TfLoadArgs attribute) Comparator (class in polygraphy.comparator.comparator) ComparatorCompareArgs (class in polygraphy.tools.args.comparator.comparator) ComparatorPostprocessArgs (class in polygraphy.tools.args.comparator.postprocess) ComparatorRunArgs (class in polygraphy.tools.args.comparator.comparator) compare_accuracy() (Comparator static method) compare_func (ComparatorCompareArgs attribute) compare_func_name (ComparatorCompareArgs attribute) compare_func_script (ComparatorCompareArgs attribute) CompareFunc (class in polygraphy.comparator.compare) CompareFuncIndicesArgs (class in polygraphy.tools.args.comparator.compare) CompareFuncSimpleArgs (class in polygraphy.tools.args.comparator.compare) convert_to_fp16() (in module polygraphy.backend.onnx.loader) ConvertToFp16 (class in polygraphy.backend.onnx.loader) copy_from() (DeviceArray method) copy_to() (DeviceArray method) (DeviceView method) create_config() (in module polygraphy.backend.tf.loader) (in module polygraphy.backend.trt.loader) (TrtConfigArgs method) create_network() (in module polygraphy.backend.trt.loader) CreateConfig (class in polygraphy.backend.tf.loader) (class in polygraphy.backend.trt.loader) CreateNetwork (class in polygraphy.backend.trt.loader) Cuda (class in polygraphy.cuda.cuda)

D

data_loader_func_name (DataLoaderArgs attribute) data_loader_script (DataLoaderArgs attribute) DataLoader (class in polygraphy.comparator.data_loader) DataLoaderArgs (class in polygraphy.tools.args.comparator.data_loader) deactivate() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method)

DeviceArray (class in polygraphy.cuda.cuda) DeviceToDevice (MemcpyKind attribute) DeviceToHost (MemcpyKind attribute) DeviceView (class in polygraphy.cuda.cuda) do_shape_inference (OnnxInferShapesArgs attribute) dtype() (DeviceView property) dynamic_op (TfTrtArgs attribute)

E

engine_bytes_from_network() (in module polygraphy.backend.trt.loader) engine_from_bytes() (in module polygraphy.backend.trt.loader) engine_from_network() (in module polygraphy.backend.trt.loader) EngineBytesFromNetwork (class in polygraphy.backend.trt.loader) EngineFromBytes (class in polygraphy.backend.trt.loader) EngineFromNetwork (class in polygraphy.backend.trt.loader)

exclude_outputs (OnnxLoadArgs attribute) (TrtLoadNetworkArgs attribute) extend() (in module polygraphy.func.func) external_data_dir (OnnxLoadArgs attribute) external_data_path (OnnxSaveArgs attribute) extract_subgraph() (in module polygraphy.backend.onnx.loader) ExtractSubgraph (class in polygraphy.backend.onnx.loader)

F

fail_fast (ComparatorCompareArgs attribute) fallback_inference() (OnnxInferShapesArgs method) fill_defaults() (Profile method) fold_constants() (in module polygraphy.backend.onnx.loader) FoldConstants (class in polygraphy.backend.onnx.loader) force_fallback (OnnxInferShapesArgs attribute) fp16 (TrtConfigArgs attribute) free() (Cuda method) (DeviceArray method) (Stream method)

freeze_graph (TfLoadArgs attribute) from_feed_dict() (TensorMetadata static method) from_json() (in module polygraphy.json.serde) (RunResults static method) (TacticReplayData static method) from_trt() (Algorithm static method)

G

get_data_loader() (DataLoaderArgs method) get_extra_help_text() (BaseRunnerArgs method) get_input_metadata() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) get_logger() (LoggerArgs method) get_name_opt() (BaseRunnerArgs method) get_trt_logger() (in module polygraphy.backend.trt.util)

gpu_memory_fraction (TfConfigArgs attribute) graph_from_ckpt() (in module polygraphy.backend.tf.loader) graph_from_frozen() (in module polygraphy.backend.tf.loader) graph_from_keras() (in module polygraphy.backend.tf.loader) GraphFromCkpt (class in polygraphy.backend.tf.loader) GraphFromFrozen (class in polygraphy.backend.tf.loader) GraphFromKeras (class in polygraphy.backend.tf.loader) group (BaseArgs attribute) gs_from_onnx() (in module polygraphy.backend.onnx.loader) GsFromOnnx (class in polygraphy.backend.onnx.loader)

H

has_mod() (in module polygraphy.mod.importer)

HostToDevice (MemcpyKind attribute) HostToHost (MemcpyKind attribute)

I

import_from_script() (in module polygraphy.mod.importer) index_tolerance (CompareFuncIndicesArgs attribute) indices() (CompareFunc static method) infer() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) infer_impl() (TrtRunner method) infer_shapes() (in module polygraphy.backend.onnx.loader) inference_time (BaseRunner attribute) (OnnxrtRunner attribute) (PluginRefRunner attribute) (TfRunner attribute) (TrtRunner attribute)

InferShapes (class in polygraphy.backend.onnx.loader) inline() (in module polygraphy.tools.script) input_shapes (ModelArgs attribute) INSTALL_CMD (in module polygraphy.config) int8 (TrtConfigArgs attribute) INTERNAL_CORRECTNESS_CHECKS (in module polygraphy.config) invoke_from_script() (in module polygraphy.backend.common.loader) InvokeFromScript (class in polygraphy.backend.common.loader) is_active (BaseRunner attribute) is_using_random_data() (DataLoaderArgs method) items() (RunResults method) IterationResult (class in polygraphy.comparator.struct) iterations (DataLoaderArgs attribute)

K

keys() (RunResults method)

L

last_inference_time() (BaseRunner method) (OnnxrtRunner method) (PluginRefRunner method) (TfRunner method) (TrtRunner method) LATEST_VERSION (in module polygraphy.mod.importer) lazy_import() (in module polygraphy.mod.importer) load() (RunResults static method) (TacticReplayData static method) load_engine() (TrtLoadEngineArgs method) load_graph() (TfLoadArgs method) load_inputs_paths (DataLoaderArgs attribute)

load_json() (in module polygraphy.json.serde) load_network() (TrtLoadNetworkArgs method) load_onnx() (OnnxLoadArgs method) load_onnxrt_session() (OnnxrtSessionArgs method) load_outputs_paths (ComparatorCompareArgs attribute) load_plugins() (in module polygraphy.backend.trt.loader) load_tactics (TrtConfigArgs attribute) load_timing_cache (TrtConfigArgs attribute) LoadPlugins (class in polygraphy.backend.trt.loader) log_file (LoggerArgs attribute) log_format (LoggerArgs attribute) LoggerArgs (class in polygraphy.tools.args.logger.logger)

M

make_invocable() (in module polygraphy.tools.script) make_invocable_if_nondefault() (in module polygraphy.tools.script) malloc() (Cuda method) MARK_ALL (in module polygraphy.constants) memcpy() (Cuda method) MemcpyKind (class in polygraphy.cuda.cuda) memory_pool_limits (TrtConfigArgs attribute) minimum_segment_size (TfTrtArgs attribute) model_type (ModelArgs attribute)

ModelArgs (class in polygraphy.tools.args.model) ModelArgs.ModelType (class in polygraphy.tools.args.model) modify_graph_outputs() (in module polygraphy.backend.tf.loader) modify_network_outputs() (in module polygraphy.backend.trt.loader) modify_outputs() (in module polygraphy.backend.onnx.loader) ModifyGraphOutputs (class in polygraphy.backend.tf.loader) ModifyNetworkOutputs (class in polygraphy.backend.trt.loader) ModifyOutputs (class in polygraphy.backend.onnx.loader) must_use_onnx_loader() (OnnxLoadArgs method)

N

nbytes() (DeviceArray property) (DeviceView property) network_from_onnx_bytes() (in module polygraphy.backend.trt.loader) network_from_onnx_path() (in module polygraphy.backend.trt.loader)

NetworkFromOnnxBytes (class in polygraphy.backend.trt.loader) NetworkFromOnnxPath (class in polygraphy.backend.trt.loader) no_shape_check (CompareFuncSimpleArgs attribute) numpy() (DeviceArray method) (DeviceView method)

O

onnx_from_bytes() (in module polygraphy.backend.onnx.loader) onnx_from_path() (in module polygraphy.backend.onnx.loader) onnx_from_tf_graph() (in module polygraphy.backend.onnx.loader) onnx_like_from_network() (in module polygraphy.backend.trt.loader) OnnxFromBytes (class in polygraphy.backend.onnx.loader) OnnxFromPath (class in polygraphy.backend.onnx.loader) OnnxFromTfArgs (class in polygraphy.tools.args.backend.onnx.loader) OnnxFromTfGraph (class in polygraphy.backend.onnx.loader) OnnxInferShapesArgs (class in polygraphy.tools.args.backend.onnx.loader) OnnxLikeFromNetwork (class in polygraphy.backend.trt.loader) OnnxLoadArgs (class in polygraphy.tools.args.backend.onnx.loader)

OnnxrtRunner (class in polygraphy.backend.onnxrt.runner) OnnxrtRunnerArgs (class in polygraphy.tools.args.backend.onnxrt.runner) OnnxrtSessionArgs (class in polygraphy.tools.args.backend.onnxrt.loader) OnnxSaveArgs (class in polygraphy.tools.args.backend.onnx.loader) opset (OnnxFromTfArgs attribute) optimization_profile (TrtRunnerArgs attribute) optimize_graph() (in module polygraphy.backend.tf.loader) OptimizeGraph (class in polygraphy.backend.tf.loader) OutputCompareResult (class in polygraphy.comparator.compare) outputs (OnnxLoadArgs attribute) (TfLoadArgs attribute) (TrtLoadNetworkArgs attribute)

P

parse() (BaseArgs method) parse_impl() (ComparatorCompareArgs method) (ComparatorPostprocessArgs method) (ComparatorRunArgs method) (CompareFuncIndicesArgs method) (CompareFuncSimpleArgs method) (DataLoaderArgs method) (LoggerArgs method) (ModelArgs method) (OnnxFromTfArgs method) (OnnxInferShapesArgs method) (OnnxLoadArgs method) (OnnxrtSessionArgs method) (OnnxSaveArgs method) (TfConfigArgs method) (TfLoadArgs method) (TfRunnerArgs method) (TfTrtArgs method) (TrtConfigArgs method) (TrtLoadEngineArgs method) (TrtLoadNetworkArgs method) (TrtLoadPluginsArgs method) (TrtRunnerArgs method) (TrtSaveEngineArgs method) path (ModelArgs attribute) (OnnxSaveArgs attribute) (TrtSaveEngineArgs attribute) percentage() (AccuracyResult method) PluginRefRunner (class in polygraphy.backend.pluginref.runner) PluginRefRunnerArgs (class in polygraphy.tools.args.backend.pluginref.runner) plugins (TrtLoadPluginsArgs attribute) polygraphy.backend.base.loader (module) polygraphy.backend.base.runner (module) polygraphy.backend.common.loader (module) polygraphy.backend.onnx.loader (module) polygraphy.backend.onnxrt.loader (module) polygraphy.backend.onnxrt.runner (module) polygraphy.backend.pluginref.runner (module) polygraphy.backend.tf.loader (module) polygraphy.backend.tf.runner (module) polygraphy.backend.trt.algorithm_selector (module) polygraphy.backend.trt.calibrator (module) polygraphy.backend.trt.loader (module) polygraphy.backend.trt.profile (module)

polygraphy.backend.trt.runner (module) polygraphy.backend.trt.util (module) polygraphy.common.struct (module) polygraphy.comparator.comparator (module) polygraphy.comparator.compare (module) polygraphy.comparator.data_loader (module) polygraphy.comparator.postprocess (module) polygraphy.comparator.struct (module) polygraphy.config (module) polygraphy.constants (module) polygraphy.cuda.cuda (module) polygraphy.exception.exception (module) polygraphy.func.func (module) polygraphy.json.serde (module) polygraphy.mod.importer (module) polygraphy.tools.args.backend.onnx.loader (module) polygraphy.tools.args.backend.onnxrt.loader (module) polygraphy.tools.args.backend.onnxrt.runner (module) polygraphy.tools.args.backend.pluginref.runner (module) polygraphy.tools.args.backend.tf.config (module) polygraphy.tools.args.backend.tf.loader (module) polygraphy.tools.args.backend.tf.runner (module) polygraphy.tools.args.backend.trt.config (module) polygraphy.tools.args.backend.trt.loader (module) polygraphy.tools.args.backend.trt.runner (module) polygraphy.tools.args.base (module) polygraphy.tools.args.comparator.comparator (module) polygraphy.tools.args.comparator.compare (module) polygraphy.tools.args.comparator.data_loader (module) polygraphy.tools.args.comparator.postprocess (module) polygraphy.tools.args.logger.logger (module) polygraphy.tools.args.model (module) polygraphy.tools.script (module) PolygraphyException PolygraphyInternalException postprocess (ComparatorPostprocessArgs attribute) postprocess() (Comparator static method) PostprocessFunc (class in polygraphy.comparator.postprocess) precision_constraints (TrtConfigArgs attribute) Profile (class in polygraphy.backend.trt.profile) profile_dicts (TrtConfigArgs attribute) providers (OnnxrtSessionArgs attribute) ptr (DeviceView attribute) (Stream attribute)

R

register() (BaseArgs method) resize() (DeviceArray method) restricted (TrtConfigArgs attribute)

rtol (CompareFuncSimpleArgs attribute) run() (Comparator static method) RunResults (class in polygraphy.comparator.struct)

S

safe() (in module polygraphy.tools.script) save() (RunResults method) (Script method) (TacticReplayData method) save_bytes() (in module polygraphy.backend.common.loader) save_engine() (in module polygraphy.backend.trt.loader) (TrtSaveEngineArgs method) save_frozen_graph_path (TfLoadArgs attribute) save_graph() (in module polygraphy.backend.tf.loader) save_inputs_path (ComparatorRunArgs attribute) save_json() (in module polygraphy.json.serde) save_onnx() (in module polygraphy.backend.onnx.loader) (OnnxSaveArgs method) save_outputs_path (ComparatorRunArgs attribute) save_tactics (TrtConfigArgs attribute) save_tensorboard_path (TfLoadArgs attribute) save_timing_cache (TrtLoadEngineArgs attribute) SaveBytes (class in polygraphy.backend.common.loader) SaveEngine (class in polygraphy.backend.trt.loader) SaveGraph (class in polygraphy.backend.tf.loader)

SaveOnnx (class in polygraphy.backend.onnx.loader) Script (class in polygraphy.tools.script) Script.String (class in polygraphy.tools.script) seed (DataLoaderArgs attribute) session_from_graph() (in module polygraphy.backend.tf.loader) session_from_onnx() (in module polygraphy.backend.onnxrt.loader) SessionFromGraph (class in polygraphy.backend.tf.loader) SessionFromOnnx (class in polygraphy.backend.onnxrt.loader) set_data_loader() (Script method) set_profile() (TrtRunner method) severity_level (LoggerArgs attribute) shape (DeviceView attribute) ShapeTuple (class in polygraphy.backend.trt.profile) silent (LoggerArgs attribute) simple() (CompareFunc static method) size_threshold (OnnxSaveArgs attribute) sparse_weights (TrtConfigArgs attribute) stats() (AccuracyResult method) Stream (class in polygraphy.cuda.cuda) synchronize() (Stream method)

T

tactic_sources (TrtConfigArgs attribute) TacticRecorder() (in module polygraphy.backend.trt.algorithm_selector) TacticReplayData (class in polygraphy.backend.trt.algorithm_selector) TacticReplayer() (in module polygraphy.backend.trt.algorithm_selector) TensorMetadata (class in polygraphy.common.struct) tf32 (TrtConfigArgs attribute) TfConfigArgs (class in polygraphy.tools.args.backend.tf.config) TfLoadArgs (class in polygraphy.tools.args.backend.tf.loader) TfRunner (class in polygraphy.backend.tf.runner) TfRunnerArgs (class in polygraphy.tools.args.backend.tf.runner) TfTrtArgs (class in polygraphy.tools.args.backend.tf.loader) timeline_path (TfRunnerArgs attribute) to_json() (in module polygraphy.json.serde) (RunResults method) (TacticReplayData method)

to_trt() (Profile method) top_k() (PostprocessFunc static method) trt_config_func_name (TrtConfigArgs attribute) trt_config_script (TrtConfigArgs attribute) trt_network_func_name (TrtLoadNetworkArgs attribute) TrtConfigArgs (class in polygraphy.tools.args.backend.trt.config) TrtLoadEngineArgs (class in polygraphy.tools.args.backend.trt.loader) TrtLoadNetworkArgs (class in polygraphy.tools.args.backend.trt.loader) TrtLoadPluginsArgs (class in polygraphy.tools.args.backend.trt.loader) TrtRunner (class in polygraphy.backend.trt.runner) TrtRunnerArgs (class in polygraphy.tools.args.backend.trt.runner) TrtSaveEngineArgs (class in polygraphy.tools.args.backend.trt.loader)

U

unwrap() (Script.String method) update() (RunResults method) use_dla (TrtConfigArgs attribute)

use_subprocess (ComparatorRunArgs attribute) use_tf_trt() (in module polygraphy.backend.tf.loader) use_tftrt (TfTrtArgs attribute) UseTfTrt (class in polygraphy.backend.tf.loader)

V

val_range (DataLoaderArgs attribute) validate (ComparatorCompareArgs attribute)

validate() (Comparator static method) values() (RunResults method) view() (DeviceArray method)

W

warm_up (ComparatorRunArgs attribute)

wrapper() (in module polygraphy.cuda.cuda)

X

xla (TfConfigArgs attribute)