Python APIs Added in 10.x

The following Python APIs have been added in TensorRT 10.x to support new features and improved functionality.

Added Python APIs, full catalog (types, methods)

Types

• APILanguage

• ExecutionContextAllocationStrategy

• IGpuAsyncAllocator

• InterfaceInfo

• IPluginResource

• IPluginV3

• IStreamReader

• IVersionedInterface

Methods and Properties

• ICudaEngine.is_debug_tensor()

• ICudaEngine.minimum_weight_streaming_budget

• ICudaEngine.streamable_weights_size

• ICudaEngine.weight_streaming_budget

• IExecutionContext.get_debug_listener()

• IExecutionContext.get_debug_state()

• IExecutionContext.set_all_tensors_debug_state()

• IExecutionContext.set_debug_listener()

• IExecutionContext.set_tensor_debug_state()

• IExecutionContext.update_device_memory_size_for_shapes()

• IGpuAllocator.allocate_async()

• IGpuAllocator.deallocate_async()

• INetworkDefinition.add_plugin_v3()

• INetworkDefinition.is_debug_tensor()

• INetworkDefinition.mark_debug()

• INetworkDefinition.unmark_debug()

• IPluginRegistry.acquire_plugin_resource()

• IPluginRegistry.all_creators

• IPluginRegistry.deregister_creator()

• IPluginRegistry.get_creator()

• IPluginRegistry.register_creator()

• IPluginRegistry.release_plugin_resource()

Removed Python APIs and Replacements

Removed Python APIs, full replacement table

The APIs listed below have been removed in TensorRT 10.x and will cause runtime errors if called. Review each entry for its replacement before upgrading.

Removed API	Replacement
BuilderFlag.ENABLE_TACTIC_HEURISTIC	Builder optimization level 2.
BuilderFlag.STRICT_TYPES	Use BuilderFlag.DIRECT_IO, BuilderFlag.PREFER_PRECISION_CONSTRAINTS, and BuilderFlag.REJECT_EMPTY_ALGORITHMS.
EngineCapability.DEFAULT	EngineCapability.STANDARD
EngineCapability.kSAFE_DLA	EngineCapability.DLA_STANDALONE
EngineCapability.SAFE_GPU	EngineCapability.SAFETY
IAlgorithmIOInfo.tensor_format	Strides, data type, and vectorization information are sufficient to identify tensor formats uniquely.
IBuilder.max_batch_size	Implicit batch support was removed.
IBuilderConfig.max_workspace_size	IBuilderConfig.set_memory_pool_limit() or get_memory_pool_limit() with MemoryPoolType.WORKSPACE
IBuilderConfig.min_timing_iterations	IBuilderConfig.avg_timing_iterations
ICudaEngine.binding_is_input()	ICudaEngine.get_tensor_mode()
ICudaEngine.get_binding_bytes_per_component()	ICudaEngine.get_tensor_bytes_per_component()
ICudaEngine.get_binding_components_per_element()	ICudaEngine.get_tensor_components_per_element()
ICudaEngine.get_binding_dtype()	ICudaEngine.get_tensor_dtype()
ICudaEngine.get_binding_format()	ICudaEngine.get_tensor_format()
ICudaEngine.get_binding_format_desc()	ICudaEngine.get_tensor_format_desc()
ICudaEngine.get_binding_index()	No name-based equivalent replacement.
ICudaEngine.get_binding_name()	No name-based equivalent replacement.
ICudaEngine.get_binding_shape()	ICudaEngine.get_tensor_shape()
ICudaEngine.get_binding_vectorized_dim()	ICudaEngine.get_tensor_vectorized_dim()
ICudaEngine.get_location()	ITensor.location
ICudaEngine.get_profile_shape()	ICudaEngine.get_tensor_profile_shape()
ICudaEngine.get_profile_shape_input()	ICudaEngine.get_tensor_profile_values()
ICudaEngine.has_implicit_batch_dimension()	Implicit batch is no longer supported.
ICudaEngine.is_execution_binding()	No name-based equivalent replacement.
ICudaEngine.is_shape_binding()	ICudaEngine.is_shape_inference_io()
ICudaEngine.max_batch_size()	Implicit batch is no longer supported.
ICudaEngine.num_bindings()	ICudaEngine.num_io_tensors()
IExecutionContext.get_binding_shape()	IExecutionContext.get_tensor_shape()
IExecutionContext.get_strides()	IExecutionContext.get_tensor_strides()
IExecutionContext.set_binding_shape()	IExecutionContext.set_input_shape()
IFullyConnectedLayer	IMatrixMultiplyLayer
INetworkDefinition.add_convolution()	INetworkDefinition.add_convolution_nd()
INetworkDefinition.add_deconvolution()	INetworkDefinition.add_deconvolution_nd()
INetworkDefinition.add_fully_connected()	INetworkDefinition.add_matrix_multiply()
INetworkDefinition.add_padding()	INetworkDefinition.add_padding_nd()
INetworkDefinition.add_pooling()	INetworkDefinition.add_pooling_nd()
INetworkDefinition.add_rnn_v2()	INetworkDefinition.add_loop()
INetworkDefinition.has_explicit_precision	Explicit precision support was removed in 10.0.
INetworkDefinition.has_implicit_batch_dimension	Implicit batch support was removed.
IRNNv2Layer	ILoop
NetworkDefinitionCreationFlag.EXPLICIT_BATCH	Support was removed in 10.0.
NetworkDefinitionCreationFlag.EXPLICIT_PRECISION	Support was removed in 10.0.
PaddingMode.CAFFE_ROUND_DOWN	Caffe support was removed.
PaddingMode.CAFFE_ROUND_UP	Caffe support was removed.
PreviewFeature.DISABLE_EXTERNAL_TACTIC_SOURCES_FOR_CORE_0805	External tactics are always disabled for core code.
PreviewFeature.FASTER_DYNAMIC_SHAPES_0805	This flag is on by default.
ProfilingVerbosity.DEFAULT	ProfilingVerbosity.LAYER_NAMES_ONLY
ProfilingVerbosity.VERBOSE	ProfilingVerbosity.DETAILED
ResizeMode	Use InterpolationMode. Alias was removed.
SampleMode.DEFAULT	SampleMode.STRICT_BOUNDS
SliceMode	Use SampleMode. Alias was removed.