TensorRT 11.3.0
nvinfer2::safe::reference Namespace Reference

Classes

class  IReferenceChecker
 Validates a safety-certified TRT engine (serialized binary blob) by re-deriving each generated kernel's boundary outputs on CPU and comparing them against the kernel run on the remote target. More...
 

Functions

nvinfer2::safe::ErrorCode createReferenceChecker (IReferenceChecker *&irc, nvinfer2::safe::ISafeRecorder &recorder, void const *engineBlob, int64_t engineBlobSize, void const *checkerBlob, int64_t checkerBlobSize, char const *remoteConfig) noexcept
 Create an instance of an IReferenceChecker class. More...
 

Function Documentation

◆ createReferenceChecker()

nvinfer2::safe::ErrorCode nvinfer2::safe::reference::createReferenceChecker ( IReferenceChecker *&  irc,
nvinfer2::safe::ISafeRecorder recorder,
void const *  engineBlob,
int64_t  engineBlobSize,
void const *  checkerBlob,
int64_t  checkerBlobSize,
char const *  remoteConfig 
)
noexcept

Create an instance of an IReferenceChecker class.

ISafeRecorder is the error recorder class for the reference checker.

Parameters
ircOn success, set to a newly-allocated reference checker owned by the caller.
recorderRecorder for diagnostics.
engineBlobThe serialized safe engine to validate.
engineBlobSizeSize of engineBlob in bytes. Must be positive.
checkerBlobThe checker blob the compiler wrote beside the engine (trtexec –dumpCheckerBlob, <engine>.txt), which carries the per-kernel metadata a golden is derived from. May be nullptr: an engine whose instructions are all static library kernels is out of scope for a reference model and needs none, and validate() reports the omission for any engine that does need it.
checkerBlobSizeSize of checkerBlob in bytes. Must be 0 exactly when checkerBlob is nullptr.
remoteConfigOpaque connection token for the remote target that runs the engine's kernels, in ssh://user[:pass]@host[:port]?remote_exec_path=<path>[&remote_lib_path=<path>] form. Must not be empty: remote is the only supported target location.

  Copyright © 2024 NVIDIA Corporation
  Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact