TensorRT Python API

Overview

• Getting Started with TensorRT
  • Installation
  • Samples
  • Operator Documentation
  • Installing cuda-python
• Core Concepts
  • TensorRT Workflow
  • Classes Overview
    • Logger
    • Parsers
    • Network
    • Builder
    • Engine and Context
• Writing custom operators with TensorRT Python plugins
  • Composition of a plugin
  • Example: Circular padding plugin
    • Providing an Ahead-of-Time (AOT) implementation
    • Picking the most performant plugin configuration: Autotuning
    • Adding the plugin to a TensorRT network
      • Adding the plugin using TRT Python APIs
      • Loading an ONNX model with the custom operator
  • Advanced usage
    • Example: Operators with data-dependent output shapes - Non-zero
    • Example: Implementing in-place custom ops with I/O aliasing
    • Example: Plugins with multiple backends: Using custom tactics
  • FAQ
  • Limitations
  • Additional resources

TensorRT Python API Reference

• Foundational Types
  • DataType
    • DataType
    • nptype()
  • Weights
    • WeightsRole
    • Weights
      • Weights.numpy()
  • Dims
    • Volume
      • volume()
    • Dims
      • Dims
    • Dims2
      • Dims2
    • DimsHW
      • DimsHW
    • Dims3
      • Dims3
    • Dims4
      • Dims4
  • IHostMemory
    • IHostMemory
      • IHostMemory.__del__()
      • IHostMemory.__exit__()
      • IHostMemory.__init__()
• Core
  • Logger
    • ILogger
      • ILogger.Severity
        • ILogger.Severity.name
      • ILogger.log()
    • Logger
      • Logger.log()
  • Profiler
    • IProfiler
      • IProfiler.report_layer_time()
    • Profiler
      • Profiler.report_layer_time()
  • IOptimizationProfile
    • IOptimizationProfile
      • IOptimizationProfile.get_shape()
      • IOptimizationProfile.get_shape_input()
      • IOptimizationProfile.set_shape()
      • IOptimizationProfile.set_shape_input()
  • IBuilderConfig
    • QuantizationFlag
    • DeviceType
    • ProfilingVerbosity
    • TacticSource
    • EngineCapability
    • BuilderFlag
    • PreviewFeature
    • MemoryPoolType
    • HardwareCompatibilityLevel
    • TilingOptimizationLevel
    • IBuilderConfig
      • IBuilderConfig.__del__()
      • IBuilderConfig.__exit__()
      • IBuilderConfig.__init__()
      • IBuilderConfig.add_optimization_profile()
      • IBuilderConfig.can_run_on_DLA()
      • IBuilderConfig.clear_flag()
      • IBuilderConfig.clear_quantization_flag()
      • IBuilderConfig.create_timing_cache()
      • IBuilderConfig.get_calibration_profile()
      • IBuilderConfig.get_device_type()
      • IBuilderConfig.get_flag()
      • IBuilderConfig.get_memory_pool_limit()
      • IBuilderConfig.get_preview_feature()
      • IBuilderConfig.get_quantization_flag()
      • IBuilderConfig.get_tactic_sources()
      • IBuilderConfig.get_timing_cache()
      • IBuilderConfig.is_device_type_set()
      • IBuilderConfig.reset()
      • IBuilderConfig.reset_device_type()
      • IBuilderConfig.set_calibration_profile()
      • IBuilderConfig.set_device_type()
      • IBuilderConfig.set_flag()
      • IBuilderConfig.set_memory_pool_limit()
      • IBuilderConfig.set_preview_feature()
      • IBuilderConfig.set_quantization_flag()
      • IBuilderConfig.set_tactic_sources()
      • IBuilderConfig.set_timing_cache()
  • Builder
    • NetworkDefinitionCreationFlag
      • NetworkDefinitionCreationFlag
    • Builder
      • Builder
        • Builder.__del__()
        • Builder.__exit__()
        • Builder.__init__()
        • Builder.build_engine_with_config()
        • Builder.build_serialized_network()
        • Builder.build_serialized_network_to_stream()
        • Builder.create_builder_config()
        • Builder.create_network()
        • Builder.create_optimization_profile()
        • Builder.get_plugin_registry()
        • Builder.is_network_supported()
        • Builder.reset()
  • ProgressMonitor
    • IProgressMonitor
      • IProgressMonitor.phase_finish()
      • IProgressMonitor.phase_start()
      • IProgressMonitor.step_complete()
  • Debug Listener
    • IDebugListener
      • IDebugListener
        • IDebugListener.__init__()
        • IDebugListener.process_debug_tensor()
  • ICudaEngine
    • TensorIOMode
    • ICudaEngine
      • ICudaEngine.__del__()
      • ICudaEngine.__exit__()
      • ICudaEngine.__getitem__()
      • ICudaEngine.__init__()
      • ICudaEngine.create_engine_inspector()
      • ICudaEngine.create_execution_context()
      • ICudaEngine.create_execution_context_without_device_memory()
      • ICudaEngine.create_runtime_config()
      • ICudaEngine.create_serialization_config()
      • ICudaEngine.get_aliased_input_tensor()
      • ICudaEngine.get_device_memory_size_for_profile()
      • ICudaEngine.get_device_memory_size_for_profile_v2()
      • ICudaEngine.get_engine_stat()
      • ICudaEngine.get_tensor_bytes_per_component()
      • ICudaEngine.get_tensor_components_per_element()
      • ICudaEngine.get_tensor_dtype()
      • ICudaEngine.get_tensor_format()
      • ICudaEngine.get_tensor_format_desc()
      • ICudaEngine.get_tensor_location()
      • ICudaEngine.get_tensor_mode()
      • ICudaEngine.get_tensor_name()
      • ICudaEngine.get_tensor_profile_shape()
      • ICudaEngine.get_tensor_profile_values()
      • ICudaEngine.get_tensor_shape()
      • ICudaEngine.get_tensor_vectorized_dim()
      • ICudaEngine.get_weight_streaming_automatic_budget()
      • ICudaEngine.is_debug_tensor()
      • ICudaEngine.is_shape_inference_io()
      • ICudaEngine.serialize()
      • ICudaEngine.serialize_with_config()
  • IExecutionContext
    • IOutputAllocator
      • IOutputAllocator.__init__()
    • IExecutionContext
      • IExecutionContext.__del__()
      • IExecutionContext.__exit__()
      • IExecutionContext.__init__()
      • IExecutionContext.execute_async_v3()
      • IExecutionContext.execute_v2()
      • IExecutionContext.get_debug_listener()
      • IExecutionContext.get_debug_state()
      • IExecutionContext.get_input_consumed_event()
      • IExecutionContext.get_max_output_size()
      • IExecutionContext.get_output_allocator()
      • IExecutionContext.get_runtime_config()
      • IExecutionContext.get_tensor_address()
      • IExecutionContext.get_tensor_shape()
      • IExecutionContext.get_tensor_strides()
      • IExecutionContext.infer_shapes()
      • IExecutionContext.report_to_profiler()
      • IExecutionContext.set_all_tensors_debug_state()
      • IExecutionContext.set_aux_streams()
      • IExecutionContext.set_debug_listener()
      • IExecutionContext.set_device_memory()
      • IExecutionContext.set_input_consumed_event()
      • IExecutionContext.set_input_shape()
      • IExecutionContext.set_optimization_profile_async()
      • IExecutionContext.set_output_allocator()
      • IExecutionContext.set_tensor_address()
      • IExecutionContext.set_tensor_debug_state()
      • IExecutionContext.update_device_memory_size_for_shapes()
  • Runtime
    • TempfileControlFlag
    • Runtime
      • Runtime.__del__()
      • Runtime.__exit__()
      • Runtime.__init__()
      • Runtime.deserialize_cuda_engine()
      • Runtime.get_plugin_registry()
      • Runtime.load_runtime()
  • IRuntimeConfig
    • ExecutionContextAllocationStrategy
    • IRuntimeConfig
      • IRuntimeConfig.__init__()
      • IRuntimeConfig.get_execution_context_allocation_strategy()
      • IRuntimeConfig.set_execution_context_allocation_strategy()
  • Refitter
    • Refitter
      • Refitter.__del__()
      • Refitter.__init__()
      • Refitter.get_all()
      • Refitter.get_all_weights()
      • Refitter.get_dynamic_range()
      • Refitter.get_missing()
      • Refitter.get_missing_weights()
      • Refitter.get_named_weights()
      • Refitter.get_tensors_with_dynamic_range()
      • Refitter.get_weights_location()
      • Refitter.get_weights_prototype()
      • Refitter.refit_cuda_engine()
      • Refitter.refit_cuda_engine_async()
      • Refitter.set_dynamic_range()
      • Refitter.set_named_weights()
      • Refitter.set_weights()
      • Refitter.unset_named_weights()
  • IErrorRecorder
    • ErrorCodeTRT
    • IErrorRecorder
      • IErrorRecorder.clear()
      • IErrorRecorder.get_error_code()
      • IErrorRecorder.get_error_desc()
      • IErrorRecorder.has_overflowed()
      • IErrorRecorder.num_errors()
      • IErrorRecorder.report_error()
  • ITimingCache
    • ITimingCache
      • ITimingCache.combine()
      • ITimingCache.query()
      • ITimingCache.queryKeys()
      • ITimingCache.reset()
      • ITimingCache.serialize()
      • ITimingCache.update()
  • GPU Allocator
    • AllocatorFlag
      • AllocatorFlag
    • IGpuAllocator
      • IGpuAllocator
        • IGpuAllocator.__init__()
        • IGpuAllocator.allocate()
        • IGpuAllocator.allocate_async()
        • IGpuAllocator.deallocate()
        • IGpuAllocator.deallocate_async()
        • IGpuAllocator.reallocate()
  • EngineInspector
    • EngineInspector
      • EngineInspector.__init__()
      • EngineInspector.get_engine_information()
      • EngineInspector.get_layer_information()
  • ISerializationConfig
    • SerializationFlag
    • ISerializationConfig
      • ISerializationConfig.__init__()
      • ISerializationConfig.clear_flag()
      • ISerializationConfig.get_flag()
      • ISerializationConfig.set_flag()
• Network
  • INetworkDefinition
    • INetworkDefinition
      • INetworkDefinition.__del__()
      • INetworkDefinition.__exit__()
      • INetworkDefinition.__getitem__()
      • INetworkDefinition.__init__()
      • INetworkDefinition.__len__()
      • INetworkDefinition.add_activation()
      • INetworkDefinition.add_assertion()
      • INetworkDefinition.add_attention()
      • INetworkDefinition.add_cast()
      • INetworkDefinition.add_concatenation()
      • INetworkDefinition.add_constant()
      • INetworkDefinition.add_convolution_nd()
      • INetworkDefinition.add_cumulative()
      • INetworkDefinition.add_deconvolution_nd()
      • INetworkDefinition.add_dequantize()
      • INetworkDefinition.add_dynamic_quantize()
      • INetworkDefinition.add_dynamic_quantize_v2()
      • INetworkDefinition.add_einsum()
      • INetworkDefinition.add_elementwise()
      • INetworkDefinition.add_fill()
      • INetworkDefinition.add_gather()
      • INetworkDefinition.add_gather_v2()
      • INetworkDefinition.add_grid_sample()
      • INetworkDefinition.add_identity()
      • INetworkDefinition.add_if_conditional()
      • INetworkDefinition.add_input()
      • INetworkDefinition.add_kv_cache_update()
      • INetworkDefinition.add_loop()
      • INetworkDefinition.add_lrn()
      • INetworkDefinition.add_matrix_multiply()
      • INetworkDefinition.add_nms()
      • INetworkDefinition.add_non_zero()
      • INetworkDefinition.add_normalization()
      • INetworkDefinition.add_normalization_v2()
      • INetworkDefinition.add_one_hot()
      • INetworkDefinition.add_padding_nd()
      • INetworkDefinition.add_parametric_relu()
      • INetworkDefinition.add_plugin()
      • INetworkDefinition.add_plugin_v2()
      • INetworkDefinition.add_plugin_v3()
      • INetworkDefinition.add_pooling_nd()
      • INetworkDefinition.add_quantize()
      • INetworkDefinition.add_ragged_softmax()
      • INetworkDefinition.add_reduce()
      • INetworkDefinition.add_resize()
      • INetworkDefinition.add_reverse_sequence()
      • INetworkDefinition.add_rotary_embedding()
      • INetworkDefinition.add_scale()
      • INetworkDefinition.add_scale_nd()
      • INetworkDefinition.add_scatter()
      • INetworkDefinition.add_select()
      • INetworkDefinition.add_shape()
      • INetworkDefinition.add_shuffle()
      • INetworkDefinition.add_slice()
      • INetworkDefinition.add_softmax()
      • INetworkDefinition.add_squeeze()
      • INetworkDefinition.add_topk()
      • INetworkDefinition.add_unary()
      • INetworkDefinition.add_unsqueeze()
      • INetworkDefinition.are_weights_marked_refittable()
      • INetworkDefinition.builder
      • INetworkDefinition.get_flag()
      • INetworkDefinition.get_input()
      • INetworkDefinition.get_layer()
      • INetworkDefinition.get_output()
      • INetworkDefinition.is_debug_tensor()
      • INetworkDefinition.mark_debug()
      • INetworkDefinition.mark_output()
      • INetworkDefinition.mark_output_for_shapes()
      • INetworkDefinition.mark_unfused_tensors_as_debug_tensors()
      • INetworkDefinition.mark_weights_refittable()
      • INetworkDefinition.remove_tensor()
      • INetworkDefinition.set_weights_name()
      • INetworkDefinition.unmark_debug()
      • INetworkDefinition.unmark_output()
      • INetworkDefinition.unmark_output_for_shapes()
      • INetworkDefinition.unmark_unfused_tensors_as_debug_tensors()
      • INetworkDefinition.unmark_weights_refittable()
  • Layer Base Classes
    • ITensor
      • TensorLocation
      • TensorFormat
      • ITensor
        • ITensor.get_dimension_name()
        • ITensor.reset_dynamic_range()
        • ITensor.set_dimension_name()
        • ITensor.set_dynamic_range()
    • ILayer
      • LayerType
      • ILayer
        • ILayer.get_input()
        • ILayer.get_output()
        • ILayer.get_output_type()
        • ILayer.output_type_is_set()
        • ILayer.reset_output_type()
        • ILayer.reset_precision()
        • ILayer.set_input()
        • ILayer.set_output_type()
  • Layers
    • PaddingMode
      • PaddingMode
    • ICastLayer
      • ICastLayer
    • IConvolutionLayer
      • IConvolutionLayer
    • IGridSampleLayer
      • InterpolationMode
      • SampleMode
      • IGridSampleLayer
    • IActivationLayer
      • ActivationType
      • IActivationLayer
    • IPoolingLayer
      • PoolingType
      • IPoolingLayer
    • ILRNLayer
      • ILRNLayer
    • IScaleLayer
      • ScaleMode
      • IScaleLayer
    • ISoftMaxLayer
      • ISoftMaxLayer
    • IConcatenationLayer
      • IConcatenationLayer
    • IDeconvolutionLayer
      • IDeconvolutionLayer
    • IElementWiseLayer
      • ElementWiseOperation
      • IElementWiseLayer
    • IGatherLayer
      • IGatherLayer
    • IPluginV2Layer
      • IPluginV2Layer
    • IPluginV3Layer
      • IPluginV3Layer
    • IUnaryLayer
      • UnaryOperation
      • IUnaryLayer
    • IReduceLayer
      • ReduceOperation
      • IReduceLayer
    • IPaddingLayer
      • IPaddingLayer
    • IParametricReLULayer
      • IParametricReLULayer
    • ISelectLayer
      • ISelectLayer
    • IShuffleLayer
      • Permutation
      • IShuffleLayer
        • IShuffleLayer.set_input()
    • ISliceLayer
      • ISliceLayer
        • ISliceLayer.set_input()
    • IShapeLayer
      • IShapeLayer
    • ITopKLayer
      • TopKOperation
      • ITopKLayer
        • ITopKLayer.set_input()
    • IMatrixMultiplyLayer
      • MatrixOperation
      • IMatrixMultiplyLayer
    • IRaggedSoftMaxLayer
      • IRaggedSoftMaxLayer
    • IIdentityLayer
      • IIdentityLayer
    • IConstantLayer
      • IConstantLayer
    • IResizeLayer
      • IResizeLayer
        • IResizeLayer.set_input()
    • ILoop
      • ILoop
        • ILoop.add_iterator()
        • ILoop.add_loop_output()
        • ILoop.add_recurrence()
        • ILoop.add_trip_limit()
      • ILoopBoundaryLayer
        • ILoopBoundaryLayer
        • ITripLimitLayer
        • IRecurrenceLayer
        • IIteratorLayer
        • ILoopOutputLayer
    • IFillLayer
      • FillOperation
      • IFillLayer
        • IFillLayer.is_alpha_beta_int64()
        • IFillLayer.set_input()
    • IQuantizeLayer
      • IQuantizeLayer
    • IDequantizeLayer
      • IDequantizeLayer
    • IDynamicQuantizeLayer
      • IDynamicQuantizeLayer
    • IScatterLayer
      • IScatterLayer
    • IIfConditional
      • IIfConditional
        • IIfConditional.add_input()
        • IIfConditional.add_output()
        • IIfConditional.set_condition()
    • IConditionLayer
      • IConditionLayer
    • IIfConditionalOutputLayer
      • IIfConditionalOutputLayer
    • IIfConditionalInputLayer
      • IIfConditionalInputLayer
    • IEinsumLayer
      • IEinsumLayer
    • IAssertionLayer
      • IAssertionLayer
    • IOneHotLayer
      • IOneHotLayer
    • INonZeroLayer
      • INonZeroLayer
    • INMSLayer
      • INMSLayer
        • INMSLayer.set_input()
    • IReverseSequenceLayer
      • IReverseSequenceLayer
    • INormalizationLayer
      • INormalizationLayer
    • ISqueezeLayer
      • ISqueezeLayer
        • ISqueezeLayer.set_input()
    • IUnsqueezeLayer
      • IUnsqueezeLayer
        • IUnsqueezeLayer.set_input()
    • ICumulativeLayer
      • ICumulativeLayer
    • IAttention
      • IAttention
        • IAttention.get_input()
        • IAttention.get_output()
        • IAttention.set_input()
    • IRotaryEmbeddingLayer
      • IRotaryEmbeddingLayer
        • IRotaryEmbeddingLayer.set_input()
    • IKVCacheUpdateLayer
      • IKVCacheUpdateLayer
        • IKVCacheUpdateLayer.set_input()
• Plugin
  • IPluginCreator
    • PluginFieldType
    • PluginField
    • PluginFieldCollection
      • PluginFieldCollection.append()
      • PluginFieldCollection.clear()
      • PluginFieldCollection.extend()
      • PluginFieldCollection.insert()
      • PluginFieldCollection.pop()
    • IPluginCreatorInterface
    • IPluginCreatorV3One
      • IPluginCreatorV3One.create_plugin()
    • IPluginCreator
      • IPluginCreator.create_plugin()
      • IPluginCreator.deserialize_plugin()
  • IPluginRegistry
    • IPluginRegistry
      • IPluginRegistry.acquire_plugin_resource()
      • IPluginRegistry.deregister_creator()
      • IPluginRegistry.deregister_library()
      • IPluginRegistry.get_creator()
      • IPluginRegistry.get_plugin_creator()
      • IPluginRegistry.load_library()
      • IPluginRegistry.register_creator()
      • IPluginRegistry.release_plugin_resource()
    • IPluginResource
      • IPluginResource.clone()
      • IPluginResource.release()
    • get_plugin_registry()
    • init_libnvinfer_plugins()
    • get_builder_plugin_registry()
  • IPluginV2DynamicExt
    • IPluginV2DynamicExt
      • IPluginV2DynamicExt.clone()
      • IPluginV2DynamicExt.configure_plugin()
      • IPluginV2DynamicExt.destroy()
      • IPluginV2DynamicExt.enqueue()
      • IPluginV2DynamicExt.get_output_datatype()
      • IPluginV2DynamicExt.get_output_dimensions()
      • IPluginV2DynamicExt.get_serialization_size()
      • IPluginV2DynamicExt.get_workspace_size()
      • IPluginV2DynamicExt.initialize()
      • IPluginV2DynamicExt.serialize()
      • IPluginV2DynamicExt.supports_format_combination()
      • IPluginV2DynamicExt.terminate()
  • IPluginV3
    • IPluginV3
      • IPluginV3.clone()
      • IPluginV3.destroy()
      • IPluginV3.get_capability_interface()
    • IPluginCapability
    • IPluginV3OneCore
    • IPluginV3OneBuild
      • IPluginV3OneBuild.configure_plugin()
      • IPluginV3OneBuild.get_output_data_types()
      • IPluginV3OneBuild.get_output_shapes()
      • IPluginV3OneBuild.get_valid_tactics()
      • IPluginV3OneBuild.get_workspace_size()
      • IPluginV3OneBuild.supports_format_combination()
    • IPluginV3OneRuntime
      • IPluginV3OneRuntime.attach_to_context()
      • IPluginV3OneRuntime.enqueue()
      • IPluginV3OneRuntime.get_fields_to_serialize()
      • IPluginV3OneRuntime.on_shape_change()
      • IPluginV3OneRuntime.set_tactic()
    • IPluginResourceContext
    • PluginTensorDesc
    • DynamicPluginTensorDesc
    • IDimensionExpr
      • IDimensionExpr.get_constant_value()
      • IDimensionExpr.is_constant()
      • IDimensionExpr.is_size_tensor()
    • DimsExprs
    • IExprBuilder
      • IExprBuilder.constant()
      • IExprBuilder.declare_size_tensor()
      • IExprBuilder.operation()
    • DimensionOperation
      • DimensionOperation.name
    • PluginCapabilityType
      • PluginCapabilityType.name
    • TensorRTPhase
      • TensorRTPhase.name
• tensorrt.plugin
  • tensorrt.plugin.register
    • register()
  • tensorrt.plugin.impl
    • impl()
  • tensorrt.plugin.aot_impl
    • aot_impl()
    • KernelLaunchParams
      • KernelLaunchParams
  • tensorrt.plugin.autotune
    • autotune()
    • AutoTuneCombination
      • AutoTuneCombination
        • AutoTuneCombination.pos()
        • AutoTuneCombination.tactics()
  • Shape
    • Shape
      • Shape
        • Shape.is_dynamic
        • Shape.max
        • Shape.min
        • Shape.numel()
        • Shape.opt
    • ShapeExpr
      • ShapeExpr
        • ShapeExpr.constant_value()
        • ShapeExpr.is_constant
        • ShapeExpr.is_fake
        • ShapeExpr.is_size_tensor
      • ShapeExprs
        • ShapeExprs.from_tuple()
        • ShapeExprs.numel()
      • SizeTensorShapeExpr
  • Tensor
    • TensorDesc
      • TensorDesc
        • TensorDesc.aliased()
        • TensorDesc.dtype
        • TensorDesc.format
        • TensorDesc.get_aliased()
        • TensorDesc.has_shape
        • TensorDesc.has_shape_expr
        • TensorDesc.is_aliased
        • TensorDesc.is_dynamic
        • TensorDesc.like()
        • TensorDesc.ndim
        • TensorDesc.numel()
        • TensorDesc.scale
        • TensorDesc.shape
        • TensorDesc.shape_expr
      • SizeTensorDesc
        • SizeTensorDesc.expr()
        • SizeTensorDesc.index
        • SizeTensorDesc.opt
        • SizeTensorDesc.upper_bound
    • Tensor
      • Tensor
        • Tensor.aliased()
        • Tensor.data_ptr
        • Tensor.dtype
        • Tensor.format
        • Tensor.get_aliased()
        • Tensor.is_aliased
        • Tensor.is_data_dependent
        • Tensor.ndim
        • Tensor.numel()
        • Tensor.scale
        • Tensor.shape
        • Tensor.strides
  • Functions
    • cdiv()
    • max()
    • min()
    • size_tensor()
    • from_shape_expr()
• Int8
  • IInt8Calibrator
    • CalibrationAlgoType
    • IInt8Calibrator
      • IInt8Calibrator.get_algorithm()
      • IInt8Calibrator.get_batch()
      • IInt8Calibrator.get_batch_size()
      • IInt8Calibrator.read_calibration_cache()
      • IInt8Calibrator.write_calibration_cache()
  • IInt8LegacyCalibrator
    • IInt8LegacyCalibrator
      • IInt8LegacyCalibrator.get_algorithm()
      • IInt8LegacyCalibrator.get_batch()
      • IInt8LegacyCalibrator.get_batch_size()
      • IInt8LegacyCalibrator.read_calibration_cache()
      • IInt8LegacyCalibrator.write_calibration_cache()
  • IInt8EntropyCalibrator
    • IInt8EntropyCalibrator
      • IInt8EntropyCalibrator.get_algorithm()
      • IInt8EntropyCalibrator.get_batch()
      • IInt8EntropyCalibrator.get_batch_size()
      • IInt8EntropyCalibrator.read_calibration_cache()
      • IInt8EntropyCalibrator.write_calibration_cache()
  • IInt8EntropyCalibrator2
    • IInt8EntropyCalibrator2
      • IInt8EntropyCalibrator2.get_algorithm()
      • IInt8EntropyCalibrator2.get_batch()
      • IInt8EntropyCalibrator2.get_batch_size()
      • IInt8EntropyCalibrator2.read_calibration_cache()
      • IInt8EntropyCalibrator2.write_calibration_cache()
  • IInt8MinMaxCalibrator
    • IInt8MinMaxCalibrator
      • IInt8MinMaxCalibrator.get_algorithm()
      • IInt8MinMaxCalibrator.get_batch()
      • IInt8MinMaxCalibrator.get_batch_size()
      • IInt8MinMaxCalibrator.read_calibration_cache()
      • IInt8MinMaxCalibrator.write_calibration_cache()
• Algorithm Selector
  • IAlgorithmIOInfo
    • IAlgorithmIOInfo.__init__()
  • IAlgorithmVariant
    • IAlgorithmVariant.__init__()
  • IAlgorithmContext
    • IAlgorithmContext.__init__()
    • IAlgorithmContext.get_shape()
  • IAlgorithm
    • IAlgorithm.__init__()
    • IAlgorithm.get_algorithm_io_info()
  • IAlgorithmSelector
    • IAlgorithmSelector.__init__()
    • IAlgorithmSelector.report_algorithms()
    • IAlgorithmSelector.select_algorithms()
• Onnx Parser
  • OnnxParser
    • OnnxParser.__del__()
    • OnnxParser.__exit__()
    • OnnxParser.__init__()
    • OnnxParser.clear_errors()
    • OnnxParser.clear_flag()
    • OnnxParser.get_error()
    • OnnxParser.get_flag()
    • OnnxParser.get_layer_output_tensor()
    • OnnxParser.get_subgraph_nodes()
    • OnnxParser.get_used_vc_plugin_libraries()
    • OnnxParser.is_subgraph_supported()
    • OnnxParser.load_initializer()
    • OnnxParser.load_model_proto()
    • OnnxParser.parse()
    • OnnxParser.parse_from_file()
    • OnnxParser.parse_model_proto()
    • OnnxParser.parse_with_weight_descriptors()
    • OnnxParser.set_builder_config()
    • OnnxParser.set_flag()
    • OnnxParser.supports_model()
    • OnnxParser.supports_model_v2()
    • OnnxParser.supports_operator()
  • OnnxParserRefitter
    • OnnxParserRefitter.__init__()
    • OnnxParserRefitter.clear_errors()
    • OnnxParserRefitter.get_error()
    • OnnxParserRefitter.load_initializer()
    • OnnxParserRefitter.load_model_proto()
    • OnnxParserRefitter.refit_from_bytes()
    • OnnxParserRefitter.refit_from_file()
    • OnnxParserRefitter.refit_model_proto()
  • ErrorCode
  • ParserError
    • ParserError.code()
    • ParserError.desc()
    • ParserError.file()
    • ParserError.func()
    • ParserError.line()
    • ParserError.local_function_stack()
    • ParserError.local_function_stack_size()
    • ParserError.node()
    • ParserError.node_name()
    • ParserError.node_operator()
  • OnnxParserFlag
  • get_nv_onnx_parser_version()