Refitter

class tensorrt.Refitter(self: tensorrt.tensorrt.Refitter, engine: tensorrt.tensorrt.ICudaEngine, logger: tensorrt.tensorrt.ILogger) → None

Updates weights in an ICudaEngine .

Parameters:
  • engine – The engine to refit.
  • logger – The logger to use.
get_all(self: tensorrt.tensorrt.Refitter) → Tuple[List[str], List[tensorrt.tensorrt.WeightsRole]]

Get description of all weights that could be refit.

Returns:The names of layers with refittable weights, and the roles of those weights.
get_missing(self: tensorrt.tensorrt.Refitter) → Tuple[List[str], List[tensorrt.tensorrt.WeightsRole]]

Get description of missing weights.

For example, if some Weights have been set, but the engine was optimized in a way that combines weights, any unsupplied Weights in the combination are considered missing.

Returns:The names of layers with missing weights, and the roles of those weights.
refit_cuda_engine(self: tensorrt.tensorrt.Refitter) → bool

Updates associated engine. Return True if successful.

Failure occurs if get_missing() != 0 before the call.

set_weights(self: tensorrt.tensorrt.Refitter, layer_name: str, role: tensorrt.tensorrt.WeightsRole, weights: tensorrt.tensorrt.Weights) → bool

Specify new weights for a layer of given name. Possible reasons for rejection are:

  • There is no such layer by that name.
  • The layer does not have weights with the specified role.
  • The number of weights is inconsistent with the layer’s original specification.

Modifying the weights before refit_cuda_engine() completes will result in undefined behavior.

Parameters:
  • layer_name – The name of the layer.
  • role – The role of the weights. See WeightsRole for more information.
  • weights – The weights to refit with.
Returns:

True on success, or False if new weights are rejected.