Full API¶

Namespaces¶

Namespace nvidia
- Namespaces

Namespace nvidia::inferenceserver
- Namespaces

Namespace nvidia::inferenceserver::custom
- Classes

Classes and Structs¶

Struct custom_initdata_struct
- Struct Documentation

Struct custom_payload_struct
- Struct Documentation

Class CustomInstance
- Class Documentation

Enums¶

Enum custom_memorytype_enum
- Enum Documentation

Enum custom_serverparamkind_enum
- Enum Documentation

Enum trtserver_errorcode_enum
- Enum Documentation

Enum trtserver_memorytype_enum
- Enum Documentation

Enum trtserver_metricformat_enum
- Enum Documentation

Enum trtserver_modelcontrolmode_enum
- Enum Documentation

Functions¶

Function CustomErrorString
- Function Documentation

Function CustomExecute
- Function Documentation

Function CustomExecuteV2
- Function Documentation

Function CustomFinalize
- Function Documentation

Function CustomInitialize
- Function Documentation

Function CustomVersion
- Function Documentation

Function TRTSERVER_ErrorCode
- Function Documentation

Function TRTSERVER_ErrorCodeString
- Function Documentation

Function TRTSERVER_ErrorDelete
- Function Documentation

Function TRTSERVER_ErrorMessage
- Function Documentation

Function TRTSERVER_ErrorNew
- Function Documentation

Function TRTSERVER_InferenceRequestProviderDelete
- Function Documentation

Function TRTSERVER_InferenceRequestProviderInputBatchByteSize
- Function Documentation

Function TRTSERVER_InferenceRequestProviderNew
- Function Documentation

Function TRTSERVER_InferenceRequestProviderSetInputData
- Function Documentation

Function TRTSERVER_InferenceResponseDelete
- Function Documentation

Function TRTSERVER_InferenceResponseHeader
- Function Documentation

Function TRTSERVER_InferenceResponseOutputData
- Function Documentation

Function TRTSERVER_InferenceResponseStatus
- Function Documentation

Function TRTSERVER_MetricsDelete
- Function Documentation

Function TRTSERVER_MetricsFormatted
- Function Documentation

Function TRTSERVER_ProtobufDelete
- Function Documentation

Function TRTSERVER_ProtobufSerialize
- Function Documentation

Function TRTSERVER_ResponseAllocatorDelete
- Function Documentation

Function TRTSERVER_ResponseAllocatorNew
- Function Documentation

Function TRTSERVER_ServerDelete
- Function Documentation

Function TRTSERVER_ServerId
- Function Documentation

Function TRTSERVER_ServerInferAsync
- Function Documentation

Function TRTSERVER_ServerIsLive
- Function Documentation

Function TRTSERVER_ServerIsReady
- Function Documentation

Function TRTSERVER_ServerLoadModel
- Function Documentation

Function TRTSERVER_ServerMetrics
- Function Documentation

Function TRTSERVER_ServerModelStatus
- Function Documentation

Function TRTSERVER_ServerNew
- Function Documentation

Function TRTSERVER_ServerOptionsAddTensorFlowVgpuMemoryLimits
- Function Documentation

Function TRTSERVER_ServerOptionsDelete
- Function Documentation

Function TRTSERVER_ServerOptionsNew
- Function Documentation

Function TRTSERVER_ServerOptionsSetExitOnError
- Function Documentation

Function TRTSERVER_ServerOptionsSetExitTimeout
- Function Documentation

Function TRTSERVER_ServerOptionsSetGpuMetrics
- Function Documentation

Function TRTSERVER_ServerOptionsSetLogError
- Function Documentation

Function TRTSERVER_ServerOptionsSetLogInfo
- Function Documentation

Function TRTSERVER_ServerOptionsSetLogVerbose
- Function Documentation

Function TRTSERVER_ServerOptionsSetLogWarn
- Function Documentation

Function TRTSERVER_ServerOptionsSetMetrics
- Function Documentation

Function TRTSERVER_ServerOptionsSetModelControlMode
- Function Documentation

Function TRTSERVER_ServerOptionsSetModelRepositoryPath
- Function Documentation

Function TRTSERVER_ServerOptionsSetProfiling
- Function Documentation

Function TRTSERVER_ServerOptionsSetServerId
- Function Documentation

Function TRTSERVER_ServerOptionsSetStrictModelConfig
- Function Documentation

Function TRTSERVER_ServerOptionsSetStrictReadiness
- Function Documentation

Function TRTSERVER_ServerOptionsSetTensorFlowGpuMemoryFraction
- Function Documentation

Function TRTSERVER_ServerOptionsSetTensorFlowSoftPlacement
- Function Documentation

Function TRTSERVER_ServerPollModelRepository
- Function Documentation

Function TRTSERVER_ServerRegisterSharedMemory
- Function Documentation

Function TRTSERVER_ServerSharedMemoryAddress
- Function Documentation

Function TRTSERVER_ServerStatus
- Function Documentation

Function TRTSERVER_ServerStop
- Function Documentation

Function TRTSERVER_ServerUnloadModel
- Function Documentation

Function TRTSERVER_ServerUnregisterAllSharedMemory
- Function Documentation

Function TRTSERVER_ServerUnregisterSharedMemory
- Function Documentation

Function TRTSERVER_SharedMemoryBlockCpuNew
- Function Documentation

Function TRTSERVER_SharedMemoryBlockDelete
- Function Documentation

Defines¶

Define CUSTOM_NO_GPU_DEVICE
- Define Documentation

Define CUSTOM_SERVER_PARAMETER_CNT
- Define Documentation

Define TRTIS_CUSTOM_EXPORT
- Define Documentation

Define TRTSERVER_EXPORT
- Define Documentation

Typedefs¶

Typedef CustomErrorStringFn_t
- Typedef Documentation

Typedef CustomExecuteFn_t
- Typedef Documentation

Typedef CustomExecuteV2Fn_t
- Typedef Documentation

Typedef CustomFinalizeFn_t
- Typedef Documentation

Typedef CustomGetNextInputFn_t
- Typedef Documentation

Typedef CustomGetNextInputV2Fn_t
- Typedef Documentation

Typedef CustomGetOutputFn_t
- Typedef Documentation

Typedef CustomGetOutputV2Fn_t
- Typedef Documentation

Typedef CustomInitializeData
- Typedef Documentation

Typedef CustomInitializeFn_t
- Typedef Documentation

Typedef CustomMemoryType
- Typedef Documentation

Typedef CustomPayload
- Typedef Documentation

Typedef CustomServerParameter
- Typedef Documentation

Typedef CustomVersionFn_t
- Typedef Documentation

Typedef TRTSERVER_Error_Code
- Typedef Documentation

Typedef TRTSERVER_InferenceCompleteFn_t
- Typedef Documentation

Typedef TRTSERVER_Memory_Type
- Typedef Documentation

Typedef TRTSERVER_Metric_Format
- Typedef Documentation

Typedef TRTSERVER_Model_Control_Mode
- Typedef Documentation

Typedef TRTSERVER_ResponseAllocatorAllocFn_t
- Typedef Documentation

Typedef TRTSERVER_ResponseAllocatorReleaseFn_t
- Typedef Documentation