NVIDIA DeepStream SDK API Reference
9.0 Release
nvdsinferserver Directory Reference
Directories
directory
tritonserver_include
Files
file
9.0/sources/libs/nvdsinferserver/infer_base_backend.h
[code]
Header file for inference processing backend base class.
file
9.0/sources/libs/nvdsinferserver/infer_base_context.h
[code]
Header file of the base class for inference context.
file
9.0/sources/libs/nvdsinferserver/infer_batch_buffer.h
[code]
Header file of batch buffer related class declarations.
file
9.0/sources/libs/nvdsinferserver/infer_common.h
[code]
Header file of the common declarations for the nvinferserver library.
file
9.0/sources/libs/nvdsinferserver/infer_cuda_context.h
[code]
Header file for the CUDA inference context class.
file
9.0/sources/libs/nvdsinferserver/infer_cuda_utils.h
[code]
Header file declaring utility classes for CUDA memory management, CIDA streams and events.
file
9.0/sources/libs/nvdsinferserver/infer_extra_processor.h
[code]
Header file of class for processing extra inputs and custom post processing.
file
9.0/sources/libs/nvdsinferserver/infer_grpc_backend.h
[code]
Header file of Triton Inference Server inference backend using gRPC.
file
9.0/sources/libs/nvdsinferserver/infer_grpc_client.h
[code]
Header file for the gRPC client and request class for inference using the Triton Inference Server. Uses the Triton client library for inference using gRPC.
file
9.0/sources/libs/nvdsinferserver/infer_grpc_context.h
[code]
Header file for the Triton gRPC mode inference context class.
file
9.0/sources/libs/nvdsinferserver/infer_ibackend.h
[code]
Inference processing backend interface header file.
file
9.0/sources/libs/nvdsinferserver/infer_iprocess.h
[code]
Preprocessing and postprocessing interface header file.
file
9.0/sources/libs/nvdsinferserver/infer_lstm.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_postproc_buf.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_postprocess.h
[code]
Header file for the post processing on inference results.
file
9.0/sources/libs/nvdsinferserver/infer_preprocess.h
[code]
Header file for the preprocessor classes for scaling and cropping.
file
9.0/sources/libs/nvdsinferserver/infer_preprocess_kernel.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_proto_utils.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_simple_context.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_simple_runtime.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_stream_manager.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_surface_bufs.h
[code]
file
9.0/sources/libs/nvdsinferserver/infer_trtis_backend.h
[code]
Header file of Triton Inference Server inference backend.
file
9.0/sources/libs/nvdsinferserver/infer_trtis_context.h
[code]
Header file for the Triton C-API mode inference context class.
file
9.0/sources/libs/nvdsinferserver/infer_trtis_server.h
[code]
Header file of wrapper classes for Triton Inference Server server instance, inference request, response.
file
9.0/sources/libs/nvdsinferserver/infer_trtis_utils.h
[code]
Triton Inference Server utilies header file.
file
9.0/sources/libs/nvdsinferserver/infer_utils.h
[code]
Header file containing utility functions and classes used by the nvinferserver low level library.
Privacy Policy
|
Manage My Privacy
|
Do Not Sell or Share My Data
|
Terms of Service
|
Accessibility
|
Corporate Policies
|
Product Security
|
Contact
© 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
NVIDIA Confidential | Subject to Change | For test and development only.
Fri Mar 20 2026 14:37:39 | PR-09318-R32