IPluginRegistry¶
- class tensorrt.IPluginRegistry¶
Registers plugin creators.
- Variables:
plugin_creator_list – [DEPRECATED] Deprecated in TensorRT 10.0. List of IPluginV2-descendent plugin creators in current registry.
all_creators – List of all registered plugin creators of current registry.
all_creators_recursive – List of all registered plugin creators of current registry and its parents (if
parent_search_enabled
is True).error_recorder –
IErrorRecorder
Application-implemented error reporting interface for TensorRT objects.parent_search_enabled – bool variable indicating whether parent search is enabled. Default is True.
- acquire_plugin_resource(self: tensorrt.tensorrt.IPluginRegistry, key: str, resource: tensorrt.tensorrt.IPluginResource) tensorrt.tensorrt.IPluginResource ¶
Get a handle to a plugin resource registered against the provided key.
- Arg:
key: Key for identifying the resource.
- Arg:
resource: A plugin resource object. The object will only need to be valid until this method returns, as only a clone of this object will be registered by TRT. Cannot be null.
- deregister_creator(*args, **kwargs)¶
Overloaded function.
deregister_creator(self: tensorrt.tensorrt.IPluginRegistry, creator: tensorrt.tensorrt.IPluginCreator) -> bool
Deregister a previously registered plugin creator inheriting from IPluginCreator.
Since there may be a desire to limit the number of plugins, this function provides a mechanism for removing plugin creators registered in TensorRT. The plugin creator that is specified by
creator
is removed from TensorRT and no longer tracked.- arg creator:
The IPluginCreator instance.
- returns:
True
if the plugin creator was deregistered,False
if it was not found in the registry or otherwise could not be deregistered.
deregister_creator(self: tensorrt.tensorrt.IPluginRegistry, creator: tensorrt.tensorrt.IPluginCreatorInterface) -> bool
Deregister a previously registered plugin creator.
Since there may be a desire to limit the number of plugins, this function provides a mechanism for removing plugin creators registered in TensorRT. The plugin creator that is specified by
creator
is removed from TensorRT and no longer tracked.- arg creator:
The plugin creator instance.
- returns:
True
if the plugin creator was deregistered,False
if it was not found in the registry or otherwise could not be deregistered.
- deregister_library(self: tensorrt.tensorrt.IPluginRegistry, handle: capsule) None ¶
Deregister plugins associated with a library. Any resources acquired when the library was loaded will be released.
- Arg:
handle: the plugin library handle to deregister.
- get_creator(self: tensorrt.tensorrt.IPluginRegistry, type: str, version: str, plugin_namespace: str = '') object ¶
Return plugin creator based on type, version and namespace
- Parameters:
type – The type of the plugin.
version – The version of the plugin.
plugin_namespace – The namespace of the plugin.
- Returns:
An
IPluginCreator
.
- get_plugin_creator(self: tensorrt.tensorrt.IPluginRegistry, type: str, version: str, plugin_namespace: str = '') tensorrt.tensorrt.IPluginCreator ¶
Return plugin creator based on type, version and namespace
Warning
Returns None if a plugin creator with matching name, version, and namespace is found, but is not a descendent of IPluginCreator
- Parameters:
type – The type of the plugin.
version – The version of the plugin.
plugin_namespace – The namespace of the plugin.
- Returns:
An
IPluginCreator
.
- load_library(self: tensorrt.tensorrt.IPluginRegistry, plugin_path: str) capsule ¶
Load and register a shared library of plugins.
- Arg:
plugin_path: the plugin library path.
- Returns:
The loaded plugin library handle. The call will fail and return None if any of the plugins are already registered.
- register_creator(*args, **kwargs)¶
Overloaded function.
register_creator(self: tensorrt.tensorrt.IPluginRegistry, creator: tensorrt.tensorrt.IPluginCreator, plugin_namespace: str = ‘’) -> bool
Register a plugin creator implementing IPluginCreator.
- arg creator:
The IPluginCreator instance.
- arg plugin_namespace:
The namespace of the plugin creator.
- returns:
False if any plugin creator with the same name, version and namespace is already registered.
register_creator(self: tensorrt.tensorrt.IPluginRegistry, creator: tensorrt.tensorrt.IPluginCreatorInterface, plugin_namespace: str = ‘’) -> bool
Register a plugin creator.
- arg creator:
The plugin creator instance.
- arg plugin_namespace:
The namespace of the plugin creator.
- returns:
False if any plugin creator with the same name, version and namespace is already registered..
- release_plugin_resource(self: tensorrt.tensorrt.IPluginRegistry, key: str) int ¶
Decrement reference count for the resource with this key. If reference count goes to zero after decrement, release() will be invoked on the resource, and the key will be deregistered.
- Arg:
key: Key that was used to register the resource.
- class tensorrt.IPluginResource(self: tensorrt.tensorrt.IPluginResource)¶
Interface for plugins to define custom resources that could be shared through the plugin registry
- clone(self: tensorrt.tensorrt.IPluginResource) tensorrt.tensorrt.IPluginResource ¶
Resource initialization (if any) may be skipped for non-cloned objects since only clones will be registered by TensorRT.
- release(self: tensorrt.tensorrt.IPluginResource) None ¶
This will only be called for IPluginResource objects that were produced from IPluginResource::clone().
The IPluginResource object on which release() is called must still be in a clone-able state after release() returns.
- tensorrt.get_plugin_registry() detail::accessor<detail::accessor_policies::str_attr> ¶
Return the plugin registry for standard runtime
- tensorrt.init_libnvinfer_plugins(logger: capsule, namespace: str) bool ¶
Initialize and register all the existing TensorRT plugins to the
IPluginRegistry
with an optional namespace. The plugin library author should ensure that this function name is unique to the library. This function should be called once before accessing the Plugin Registry.- Parameters:
logger – Logger to print plugin registration information.
namespace – Namespace used to register all the plugins in this library.
- tensorrt.get_builder_plugin_registry(arg0: tensorrt.EngineCapability) tensorrt.tensorrt.IPluginRegistry ¶
Return the plugin registry used for building engines for the specified runtime