nvdsinfer::TrtModelBuilder Class Reference

Detailed Description

Helper class to build models and generate the TensorRT ICudaEngine required for inference.

This class will parse models using the nvdsinfer::IModelParser interface and then build the model engine using nvinfer1::IBuilder's BuilderConfig APIs based on initialization parameters passed to NvDsInferContext. Alternatively, this class can also deserialize an existing serialized engine to generate the ICudaEngine.

Definition at line 315 of file nvdsinfer_model_builder.h.

Public Member Functions
	TrtModelBuilder (int gpuId, nvinfer1::ILogger &logger, const std::shared_ptr< DlLibHandle > &dlHandle=nullptr)
	~TrtModelBuilder ()
void	setInt8Calibrator (std::unique_ptr< nvinfer1::IInt8Calibrator > &&calibrator)
std::unique_ptr< TrtEngine >	buildModel (const NvDsInferContextInitParams &initParams, std::string &suggestedPathName)
std::unique_ptr< TrtEngine >	buildEngine (nvinfer1::INetworkDefinition &network, BuildParams &options)
NvDsInferStatus	serializeEngine (const std::string &path, nvinfer1::ICudaEngine &engine)
std::unique_ptr< TrtEngine >	deserializeEngine (const std::string &path, int dla=-1)

Friends
class	BuildParams
class	ImplicitBuildParams
class	ExplicitBuildParams

Constructor & Destructor Documentation

TrtModelBuilder()

nvdsinfer::TrtModelBuilder::TrtModelBuilder	(	int	gpuId,
		nvinfer1::ILogger &	logger,
		const std::shared_ptr< DlLibHandle > &	dlHandle = nullptr
	)

~TrtModelBuilder()

nvdsinfer::TrtModelBuilder::~TrtModelBuilder ( )

inline

Definition at line 321 of file nvdsinfer_model_builder.h.

Member Function Documentation

buildEngine()

std::unique_ptr<TrtEngine> nvdsinfer::TrtModelBuilder::buildEngine	(	nvinfer1::INetworkDefinition &	network,
		BuildParams &	options
	)

buildModel()

std::unique_ptr<TrtEngine> nvdsinfer::TrtModelBuilder::buildModel	(	const NvDsInferContextInitParams &	initParams,
		std::string &	suggestedPathName
	)

deserializeEngine()

std::unique_ptr<TrtEngine> nvdsinfer::TrtModelBuilder::deserializeEngine	(	const std::string &	path,
		int	dla = -1
	)

serializeEngine()

NvDsInferStatus nvdsinfer::TrtModelBuilder::serializeEngine	(	const std::string &	path,
		nvinfer1::ICudaEngine &	engine
	)

setInt8Calibrator()

void nvdsinfer::TrtModelBuilder::setInt8Calibrator ( std::unique_ptr< nvinfer1::IInt8Calibrator > &&  calibrator )

inline

Definition at line 325 of file nvdsinfer_model_builder.h.

Friends And Related Function Documentation

BuildParams

friend class BuildParams

friend

Definition at line 402 of file nvdsinfer_model_builder.h.

ExplicitBuildParams

friend class ExplicitBuildParams

friend

Definition at line 404 of file nvdsinfer_model_builder.h.

ImplicitBuildParams

friend class ImplicitBuildParams

friend

Definition at line 403 of file nvdsinfer_model_builder.h.

---

The documentation for this class was generated from the following file:

• nvdsinfer_model_builder.h