NvInferReference.h File Reference

#include "NvInferForwardDecl.h"
#include "NvInferSafeRuntime.h"
#include <cstdint>

Go to the source code of this file.

Classes
class	nvinfer2::safe::reference::IReferenceChecker
	Validates a safety-certified TRT engine (serialized binary blob) by re-deriving each generated kernel's boundary outputs on CPU and comparing them against the kernel run on the remote target. More...

Namespaces
namespace	nvinfer2
namespace	nvinfer2::safe
namespace	nvinfer2::safe::reference

Functions
nvinfer2::safe::ErrorCode	nvinfer2::safe::reference::createReferenceChecker (IReferenceChecker *&irc, nvinfer2::safe::ISafeRecorder &recorder, void const *engineBlob, int64_t engineBlobSize, void const *checkerBlob, int64_t checkerBlobSize, char const *remoteConfig) noexcept
	Create an instance of an IReferenceChecker class. More...

Detailed Description

Per-kernel numerical reference check for a safety-certified TRT engine.

The check re-derives each generated kernel's boundary outputs on the CPU and compares them against the kernel run on a remote target.

Diagnostics are surfaced through the ISafeRecorder, and validate() returns a single pass/fail.