1. Modules
Here is a list of all modules:
1.1. Data types used by cuDLA driver
Classes
Enumerations
- enum cudlaDevAttributeType
- enum cudlaFenceType
- enum cudlaMode
- enum cudlaModuleAttributeType
- enum cudlaNvSciSyncAttributes
- enum cudlaStatus
- enum cudlaSubmissionFlags
Enumerations
- enum cudlaDevAttributeType
-
Device attribute type.
Values
- CUDLA_UNIFIED_ADDRESSING = 0
- Flag to check for support for UVA.
- CUDLA_DEVICE_VERSION = 1
- Flag to check for DLA HW version.
- enum cudlaFenceType
-
Supported fence types.
Values
- CUDLA_NVSCISYNC_FENCE = 1
- NvSciSync fence type.
- enum cudlaMode
-
Device creation modes.
Values
- CUDLA_CUDA_DLA = 0
- Hyrbid mode.
- CUDLA_STANDALONE = 1
- Standalone mode.
- enum cudlaModuleAttributeType
-
Module attribute types.
Values
- CUDLA_NUM_INPUT_TENSORS = 0
- Flag to retrieve number of input tensors.
- CUDLA_NUM_OUTPUT_TENSORS = 1
- Flag to retrieve number of output tensors.
- CUDLA_INPUT_TENSOR_DESCRIPTORS = 2
- Flag to retrieve all the input tensor descriptors.
- CUDLA_OUTPUT_TENSOR_DESCRIPTORS = 3
- Flag to retrieve all the output tensor descriptors.
- enum cudlaNvSciSyncAttributes
-
cuDLA NvSciSync attributes.
Values
- CUDLA_NVSCISYNC_ATTR_WAIT = 1
- Wait attribute.
- CUDLA_NVSCISYNC_ATTR_SIGNAL = 2
- Signal attribute.
- enum cudlaStatus
-
Error codes.
Values
- cudlaSuccess = 0
- The API call returned with no errors.
- cudlaErrorInvalidParam = 1
- This indicates that one or more parameters passed to the API is/are incorrect.
- cudlaErrorOutOfResources = 2
- This indicates that the API call failed due to lack of underlying resources.
- cudlaErrorCreationFailed = 3
- This indicates that an internal error occurred during creation of device handle.
- cudlaErrorInvalidAddress = 4
- This indicates that the memory object being passed in the API call has not been registered before.
- cudlaErrorOs = 5
- This indicates that an OS error occurred.
- cudlaErrorCuda = 6
- This indicates that there was an error in a CUDA operation as part of the API call.
- cudlaErrorUmd = 7
- This indicates that there was an error in the DLA runtime for the API call.
- cudlaErrorInvalidDevice = 8
- This indicates that the device handle passed to the API call is invalid.
- cudlaErrorInvalidAttribute = 9
- This indicates that an invalid attribute is being requested.
- cudlaErrorIncompatibleDlaSWVersion = 10
- This indicates that the underlying DLA runtime is incompatible with the current cuDLA version.
- cudlaErrorMemoryRegistered = 11
- This indicates that the memory object is already registered.
- cudlaErrorInvalidModule = 12
- This indicates that the module being passed is invalid.
- cudlaErrorUnsupportedOperation = 13
- This indicates that the operation being requested by the API call is unsupported.
- cudlaErrorNvSci = 14
- This indicates that the NvSci operation requested by the API call failed.
- cudlaErrorDlaErrInvalidInput = 0x40000001
- DLA HW Error.
- cudlaErrorDlaErrInvalidPreAction = 0x40000002
- DLA HW Error.
- cudlaErrorDlaErrNoMem = 0x40000003
- DLA HW Error.
- cudlaErrorDlaErrProcessorBusy = 0x40000004
- DLA HW Error.
- cudlaErrorDlaErrTaskStatusMismatch = 0x40000005
- DLA HW Error.
- cudlaErrorDlaErrEngineTimeout = 0x40000006
- DLA HW Error.
- cudlaErrorDlaErrDataMismatch = 0x40000007
- DLA HW Error.
- cudlaErrorUnknown = 0x7fffffff
- This indicates that an unknown error has occurred.
- enum cudlaSubmissionFlags
-
Task submission flags for cudlaSubmitTask .
Values
- CUDLA_SUBMIT_NOOP = 1
- Flag to specify that the submitted task must be bypassed for execution.
1.2. cuDLA API
This section describes the application programming interface of the cuDLA driver.
Functions
- cudlaStatus cudlaCreateDevice ( const uint64_t device, const cudlaDevHandle* devHandle, const uint32_t flags )
- Create a device handle.
- cudlaStatus cudlaDestroyDevice ( const cudlaDevHandle devHandle )
- Destroy device handle.
- cudlaStatus cudlaDeviceGetAttribute ( const cudlaDevHandle devHandle, const cudlaDevAttributeType attrib, const cudlaDevAttribute* pAttribute )
- Get cuDLA device attributes.
- cudlaStatus cudlaDeviceGetCount ( const uint64_t* pNumDevices )
- Get device count.
- cudlaStatus cudlaGetLastError ( const cudlaDevHandle devHandle )
- Gets the last asynchronous error in task execution.
- cudlaStatus cudlaGetNvSciSyncAttributes ( uint64_t* attrList, const uint32_t flags )
- Get cuDLA's NvSciSync attributes.
- cudlaStatus cudlaGetVersion ( const uint64_t* version )
- Returns the version number of the library.
- cudlaStatus cudlaImportExternalMemory ( const cudlaDevHandle devHandle, const cudlaExternalMemoryHandleDesc* desc, const uint64_t** devPtr, const uint32_t flags )
- Imports external memory into cuDLA.
- cudlaStatus cudlaImportExternalSemaphore ( const cudlaDevHandle devHandle, const cudlaExternalSemaphoreHandleDesc* desc, const uint64_t** devPtr, const uint32_t flags )
- Imports external semaphore into cuDLA.
- cudlaStatus cudlaMemRegister ( const cudlaDevHandle devHandle, const uint64_t* ptr, const size_t size, const uint64_t** devPtr, const uint32_t flags )
- Registers the CUDA memory to DLA engine.
- cudlaStatus cudlaMemUnregister ( const cudlaDevHandle devHandle, const uint64_t* devPtr )
- Unregisters the input memory from DLA engine.
- cudlaStatus cudlaModuleGetAttributes ( const cudlaModule hModule, const cudlaModuleAttributeType attrType, const cudlaModuleAttribute* attribute )
- Get DLA module attributes.
- cudlaStatus cudlaModuleLoadFromMemory ( const cudlaDevHandle devHandle, const uint8_t* pModule, const size_t moduleSize, const cudlaModule* hModule, const uint32_t flags )
- Load a DLA module.
- cudlaStatus cudlaModuleUnload ( const cudlaModule hModule, const uint32_t flags )
- Unload a DLA module.
- cudlaStatus cudlaSubmitTask ( const cudlaDevHandle devHandle, const cudlaTask* ptrToTasks, const uint32_t numTasks, const void* stream, const uint32_t flags )
- Submits the inference operation on DLA.
Functions
- cudlaStatus cudlaCreateDevice ( const uint64_t device, const cudlaDevHandle* devHandle, const uint32_t flags )
-
Create a device handle.
Parameters
- device
- - Device number (can be 0 or 1).
- devHandle
- - Pointer to hold the created cuDLA device handle.
- flags
- - Flags controlling device creation.
Returns
cudlaSuccess, cudlaErrorOutOfResources, cudlaErrorInvalidParam, cudlaErrorIncompatibleDlaSWVersion, cudlaErrorCreationFailed, cudlaErrorCuda, cudlaErrorUmd, cudlaErrorUnsupportedOperation
Description
Creates an instance of a cuDLA device which can be used to submit DLA operations. The application can create the handle in hybrid or standalone mode. In hybrid mode, the current set GPU device is used by this API to decide the association of the created DLA device handle. This function returns cudlaErrorUnsupportedOperation if the current set GPU device is a dGPU as cuDLA is not supported on dGPU presently.
Valid values for flags are:
-
CUDLA_CUDA_DLA - In this mode, cuDLA serves as a programming model extension of CUDA wherein DLA work can be submitted using CUDA constructs.
-
CUDLA_STANDALONE - In this mode, cuDLA works standalone without any interaction with CUDA.
- cudlaStatus cudlaDestroyDevice ( const cudlaDevHandle devHandle )
-
Destroy device handle.
Parameters
- devHandle
- - A valid device handle.
Description
Destroys the instance of the cuDLA device which was created with cudlaCreateDevice. Before destroying the handle, it is important to ensure that all the tasks submitted previously to the device are completed. Failure to do so can lead to application crashes.
In hybrid mode, cuDLA internally performs memory allocations with CUDA using the primary context. As a result, before destroying or resetting a CUDA primary context, it is mandatory that all cuDLA device initializations are destroyed.
- cudlaStatus cudlaDeviceGetAttribute ( const cudlaDevHandle devHandle, const cudlaDevAttributeType attrib, const cudlaDevAttribute* pAttribute )
-
Get cuDLA device attributes.
Parameters
- devHandle
- - The input cuDLA device handle.
- attrib
- - The attribute that is being requested.
- pAttribute
- - The output pointer where the attribute will be available.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorInvalidDevice, cudlaErrorUmd, cudlaErrorInvalidAttribute
Description
UVA addressing between CUDA and DLA requires special support in the underlying kernel mode drivers. Applications are expected to query the cuDLA runtime to check if the current version of cuDLA supports UVA addressing.
- cudlaStatus cudlaDeviceGetCount ( const uint64_t* pNumDevices )
-
Get device count.
Parameters
- pNumDevices
- - The number of DLA devices will be available in this variable upon successful completion.
Description
Get number of DLA devices available to use.
- cudlaStatus cudlaGetLastError ( const cudlaDevHandle devHandle )
-
Gets the last asynchronous error in task execution.
Parameters
- devHandle
- - A valid device handle.
Returns
cudlaSuccess, cudlaErrorInvalidDevice, cudlaErrorDlaErrInvalidInput, cudlaErrorDlaErrInvalidPreAction, cudlaErrorDlaErrNoMem, cudlaErrorDlaErrProcessorBusy, cudlaErrorDlaErrTaskStatusMismatch, cudlaErrorDlaErrEngineTimeout, cudlaErrorDlaErrDataMismatch, cudlaErrorUnknown
Description
The DLA tasks execute asynchronously on the DLA HW. As a result, the status of the task execution is not known at the time of task submission. The status of the task executed by the DLA HW most recently for the particular device handle can be queried using this interface.
Note that a return code of cudlaSuccess from this function does not necessarily imply that most recent task executed successfully. Since this function returns immediately, it can only report the status of the tasks at the snapshot of time when it is called. To be guaranteed of task completion, applications must synchronize on the submitted tasks in hybrid or standalone modes and then call this API to check for errors.
- cudlaStatus cudlaGetNvSciSyncAttributes ( uint64_t* attrList, const uint32_t flags )
-
Get cuDLA's NvSciSync attributes.
Parameters
- attrList
- - Attribute list created by the application.
- flags
- - Applications can use this flag to specify how they intend to use the NvSciSync object created from the attrList.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorUnsupportedOperation, cudlaErrorInvalidAttribute, cudlaErrorNvSci
Description
Gets the NvSciSync's attributes in the attribute list created by the application.
In the event of failed NvSci initialization this function would return cudlaErrorUnsupportedOperation. This function can return cudlaErrorNvSci or cudlaErrorInvalidAttribute in certain cases when the underlying NvSci operation fails.
The valid values of flags can be one of the following (or an OR of these values):
-
CUDLA_NVSCISYNC_ATTR_WAIT, specifies that the application intends to use the NvSciSync object created using this attribute list as a waiter in cuDLA and therefore needs cuDLA to fill waiter specific NvSciSyncAttr.
-
CUDLA_NVSCISYNC_ATTR_SIGNAL, specifies that the application intends to use the NvSciSync object created using this attribute list as a signaler in cuDLA and therefore needs cuDLA to fill signaler specific NvSciSyncAttr.
- cudlaStatus cudlaGetVersion ( const uint64_t* version )
-
Returns the version number of the library.
Parameters
- version
- - cuDLA library version will be available in this variable upon successful execution.
Returns
Description
cuDLA is semantically versioned. This function will return the version as 1000000*major + 1000*minor + patch.
- cudlaStatus cudlaImportExternalMemory ( const cudlaDevHandle devHandle, const cudlaExternalMemoryHandleDesc* desc, const uint64_t** devPtr, const uint32_t flags )
-
Imports external memory into cuDLA.
Parameters
- devHandle
- - A valid device handle.
- desc
- - Contains description about allocated external memory.
- devPtr
- - The output pointer where the mapping will be available.
- flags
- - Reserved for future. Must be set to 0.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorInvalidDevice, cudlaErrorUnsupportedOperation, cudlaErrorNvSci, cudlaErrorInvalidAttribute, cudlaErrorMemoryRegistered, cudlaErrorUmd
Description
Imports the allocated external memory by registering it with DLA. After successful registration, the returned pointer can be used in a task submit.
On Tegra, cuDLA supports importing NvSciBuf objects in standalone mode only. In the event of failed NvSci initialization (either due to usage of this API in hybrid mode or an issue in the NvSci library initialization), this function would return cudlaErrorUnsupportedOperation. This function can return cudlaErrorNvSci or cudlaErrorInvalidAttribute in certain cases when the underlying NvSci operation fails.
Note:This API can return task execution errors from previous DLA task submissions.
- cudlaStatus cudlaImportExternalSemaphore ( const cudlaDevHandle devHandle, const cudlaExternalSemaphoreHandleDesc* desc, const uint64_t** devPtr, const uint32_t flags )
-
Imports external semaphore into cuDLA.
Parameters
- devHandle
- - A valid device handle.
- desc
- - Contains sempahore object.
- devPtr
- - The output pointer where the mapping will be available.
- flags
- - Reserved for future. Must be set to 0.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorInvalidDevice, cudlaErrorUnsupportedOperation, cudlaErrorNvSci, cudlaErrorInvalidAttribute, cudlaErrorMemoryRegistered
Description
Imports the allocated external semaphore by registering it with DLA. After successful registration, the returned pointer can be used in a task submit to signal synchronization objects.
On Tegra, cuDLA supports importing NvSciSync objects in standalone mode only. In the event of failed NvSci initialization (either due to usage of this API in hybrid mode or an issue in the NvSci library initialization), this function would return cudlaErrorUnsupportedOperation. This function can return cudlaErrorNvSci or cudlaErrorInvalidAttribute in certain cases when the underlying NvSci operation fails.
Note:This API can return task execution errors from previous DLA task submissions.
- cudlaStatus cudlaMemRegister ( const cudlaDevHandle devHandle, const uint64_t* ptr, const size_t size, const uint64_t** devPtr, const uint32_t flags )
-
Registers the CUDA memory to DLA engine.
Parameters
- devHandle
- - A valid cuDLA device handle create by a previous call to cudlaCreateDevice.
- ptr
- - The CUDA pointer to be registered.
- size
- - The size of the mapping i.e the number of bytes from ptr that must be mapped.
- devPtr
- - The output pointer where the mapping will be available.
- flags
- - Reserved for future. Must be set to 0.
Returns
cudlaSuccess, cudlaErrorInvalidDevice, cudlaErrorInvalidParam, cudlaErrorInvalidAddress, cudlaErrorCuda, cudlaErrorUmd, cudlaErrorOutOfResources, cudlaErrorMemoryRegistered
Description
As part of registration, a system mapping is created whereby the DLA HW can access the underlying CUDA memory. The resultant mapping is available in devPtr and applications must use this mapping while referring this memory in submit operations.
This function will return cudlaErrorInvalidAddress if the pointer or size to be registered is invalid. In addition, if the input pointer was already registered, then this function will return cudlaErrorMemoryRegistered. Attempting to re-register memory does not cause any irrecoverable error in cuDLA and applications can continue to use cuDLA APIs even after this error has occurred.
Note:This API can return task execution errors from previous DLA task submissions.
- cudlaStatus cudlaMemUnregister ( const cudlaDevHandle devHandle, const uint64_t* devPtr )
-
Unregisters the input memory from DLA engine.
Parameters
- devHandle
- - A valid cuDLA device handle create by a previous call to cudlaCreateDevice.
- devPtr
- - The pointer to be unregistered.
Description
The system mapping that enables the DLA HW to access the memory is removed. This mapping could have been created by a previous call to cudlaMemRegister , cudlaImportExternalMemory or cudlaImportExternalSemaphore.
Note:This API can return task execution errors from previous DLA task submissions.
- cudlaStatus cudlaModuleGetAttributes ( const cudlaModule hModule, const cudlaModuleAttributeType attrType, const cudlaModuleAttribute* attribute )
-
Get DLA module attributes.
Parameters
- hModule
- - The input DLA module.
- attrType
- - The attribute type that is being requested.
- attribute
- - The output pointer where the attribute will be available.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorInvalidModule, cudlaErrorInvalidDevice, cudlaErrorUmd, cudlaErrorInvalidAttribute
Description
Get module attributes from the loaded module. This API returns cudlaErrorInvalidDevice if the module is not loaded in any device.
- cudlaStatus cudlaModuleLoadFromMemory ( const cudlaDevHandle devHandle, const uint8_t* pModule, const size_t moduleSize, const cudlaModule* hModule, const uint32_t flags )
-
Load a DLA module.
Parameters
- devHandle
- - The input cuDLA device handle. The module will be loaded in the context of this handle.
- pModule
- - A pointer to an in-memory module.
- moduleSize
- - The size of the module.
- hModule
- - The address in which the loaded module handle will be available upon successful execution.
- flags
- - Reserved for future. Must be set to 0.
Returns
cudlaSuccess, cudlaErrorInvalidDevice, cudlaErrorInvalidParam, cudlaErrorOutOfResources, cudlaErrorUnsupportedOperation, cudlaErrorUmd
Description
Loads the module into the current device handle. Currently, DLA supports only 1 loadable per device handle. So, attempting to load another loadable in the same device handle would return with an error code of cudlaErrorUnsupportedOperation.
- cudlaStatus cudlaModuleUnload ( const cudlaModule hModule, const uint32_t flags )
-
Unload a DLA module.
Parameters
- hModule
- - Handle to the loaded module.
- flags
- - Reserved for future. Must be set to 0.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorInvalidDevice, cudlaErrorInvalidModule, cudlaErrorUmd
Description
Unload the module from the device handle that it was loaded into. This API returns cudlaErrorInvalidDevice if the module is not loaded into a valid device.
Note:This API can return task execution errors from previous DLA task submissions.
- cudlaStatus cudlaSubmitTask ( const cudlaDevHandle devHandle, const cudlaTask* ptrToTasks, const uint32_t numTasks, const void* stream, const uint32_t flags )
-
Submits the inference operation on DLA.
Parameters
- devHandle
- - A valid cuDLA device handle.
- ptrToTasks
- - A list of inferencing tasks.
- numTasks
- - The number of tasks.
- stream
- - The stream on which the DLA task has to be submitted.
- flags
- - Reserved for future. Must be set to 0.
Returns
cudlaSuccess, cudlaErrorInvalidParam, cudlaErrorInvalidDevice, cudlaErrorInvalidModule, cudlaErrorCuda, cudlaErrorUmd, cudlaErrorOutOfResources, cudlaErrorInvalidAddress, cudlaErrorUnsupportedOperation, cudlaErrorInvalidAttribute, cudlaErrorNvSci
Description
This operation takes in a sequence of tasks and submits them to the DLA HW for execution in the same sequence as they appear in the input task array. The input and output tensors are assumed to be pre-registered using cudlaMemRegister (in hybrid mode) or cudlaImportExternalMemory (in standalone mode). Failure to do so can result in this function returning cudlaErrorInvalidAddress.
The stream parameter must be specified as the CUDA stream on which the DLA task is submitted for execution in hybrid mode. In standalone mode, this parameter must be passed as NULL and failure to do so will result in this function returning cudlaErrorInvalidParam.
The cudlaTask structure has a provision to specify wait and signal events that cuDLA must wait on and signal respectively as part of cudlaSubmitTask(). Each submitted task will wait for all its wait events to be signaled before beginning execution and will provide a signal event (if one is requested for during cudlaSubmitTask) that the application (or any other entity) can wait on to ensure that the submitted task has completed execution. In cuDLA 1.0, only NvSciSync fences are supported as part of wait events. Furthermore, only NvSciSync objects (registered as part of cudlaImportExternalSemaphore) can be signaled as part of signal events and the fence corresponding to the signaled event is returned as part of cudlaSubmitTask.
For wait events, applications are expected to
-
register their synchronization objects using cudlaImportExternalSemaphore.
-
create the required number of fence placeholders using CudlaFence.
-
fill in the placeholders with the relevant fences from the application.
-
list out all the fences in cudlaWaitEvents.
For signal events, applications are expected to
-
register their synchronization objects using cudlaImportExternalSemaphore.
-
create the required number of placeholder fences using CudlaFence.
-
place the registered objects and the corresponding fences in cudlaSignalEvents.
When cudlaSubmitTask returns successfully, the fences present in cudlaSignalEvents can be used to wait for the particular task to be completed. As cuDLA only supports syncpoints at the present moment, the number of events specified in cudlaTask::signalEvents cannot be more than 1. If more than 1 is specified, cudlaErrorInvalidParam is returned.
This function can return cudlaErrorUnsupportedOperation if
-
stream being used in hybrid mode is in capturing state.
-
application attempts to use NvSci functionalities in hybrid mode.
-
loading of NvSci libraries failed for a particular platform.
-
fence type other than CUDLA_NVSCISYNC_FENCE is specified.
This function can return cudlaErrorNvSci or cudlaErrorInvalidAttribute in certain cases when the underlying NvSci operation fails.
Note:This API can return task execution errors from previous DLA task submissions.
2. Data Structures
Here are the data structures with brief descriptions:
2.1. cudlaDevAttribute Union Reference
[Data types used by cuDLA driver]
Device attribute.
Public Variables
- uint32_t deviceVersion
- uint8_t unifiedAddressingSupported
Variables
- uint32_t cudlaDevAttribute::deviceVersion [inherited]
-
DLA device version. Xavier has 1.0 and Orin has 2.0.
- uint8_t cudlaDevAttribute::unifiedAddressingSupported [inherited]
-
Returns 0 if unified addressing is not supported.
2.2. cudlaExternalMemoryHandleDesc_t Struct Reference
[Data types used by cuDLA driver]
External memory handle descriptor.
Public Variables
- const void * extBufObject
- unsigned long long size
Variables
- const void * cudlaExternalMemoryHandleDesc_t::extBufObject [inherited]
-
A handle representing an external memory object.
- unsigned long long cudlaExternalMemoryHandleDesc_t::size [inherited]
-
Size of the memory allocation
2.3. cudlaExternalSemaphoreHandleDesc_t Struct Reference
[Data types used by cuDLA driver]
External semaphore handle descriptor.
Public Variables
- const void * extSyncObject
Variables
- const void * cudlaExternalSemaphoreHandleDesc_t::extSyncObject [inherited]
-
A handle representing an external synchronization object.
2.4. CudlaFence Struct Reference
[Data types used by cuDLA driver]
Fence description.
Public Variables
- void * fence
- cudlaFenceType type
Variables
- void * CudlaFence::fence [inherited]
-
Fence.
- cudlaFenceTypeCudlaFence::type [inherited]
-
Fence type.
2.5. cudlaModuleAttribute Union Reference
[Data types used by cuDLA driver]
Module attribute.
Public Variables
- cudlaModuleTensorDescriptor * inputTensorDesc
- uint32_t numInputTensors
- uint32_t numOutputTensors
- cudlaModuleTensorDescriptor * outputTensorDesc
Variables
- cudlaModuleTensorDescriptor * cudlaModuleAttribute::inputTensorDesc [inherited]
-
Returns an array of input tensor descriptors.
- uint32_t cudlaModuleAttribute::numInputTensors [inherited]
-
Returns the number of input tensors.
- uint32_t cudlaModuleAttribute::numOutputTensors [inherited]
-
Returns the number of output tensors.
- cudlaModuleTensorDescriptor * cudlaModuleAttribute::outputTensorDesc [inherited]
-
Returns an array of output tensor descriptors.
2.6. cudlaModuleTensorDescriptor Struct Reference
[Data types used by cuDLA driver]
Tensor descriptor.
2.7. cudlaSignalEvents Struct Reference
[Data types used by cuDLA driver]
Signal events for cudlaSubmitTask
Public Variables
- const * devPtrs
- CudlaFence * eofFences
- uint32_t numEvents
Variables
- const * cudlaSignalEvents::devPtrs [inherited]
-
Array of registered synchronization objects (via cudlaImportExternalSemaphore).
- CudlaFence * cudlaSignalEvents::eofFences [inherited]
-
Array of fences pointers for all the signal events corresponding to the synchronization objects.
- uint32_t cudlaSignalEvents::numEvents [inherited]
-
Total number of signal events.
2.8. cudlaTask Struct Reference
[Data types used by cuDLA driver]
Structure of Task.
Public Variables
- const * inputTensor
- cudlaModule moduleHandle
- uint32_t numInputTensors
- uint32_t numOutputTensors
- const * outputTensor
- cudlaSignalEvents * signalEvents
- const cudlaWaitEvents * waitEvents
Variables
- const * cudlaTask::inputTensor [inherited]
-
Array of input tensors.
- cudlaModule cudlaTask::moduleHandle [inherited]
-
cuDLA module handle.
- uint32_t cudlaTask::numInputTensors [inherited]
-
Number of input tensors.
- uint32_t cudlaTask::numOutputTensors [inherited]
-
Number of output tensors.
- const * cudlaTask::outputTensor [inherited]
-
Array of output tensors.
- cudlaSignalEvents * cudlaTask::signalEvents [inherited]
-
Signal events.
- const cudlaWaitEvents * cudlaTask::waitEvents [inherited]
-
Wait events.
2.9. cudlaWaitEvents Struct Reference
[Data types used by cuDLA driver]
Wait events for cudlaSubmitTask.
Public Variables
- uint32_t numEvents
- const CudlaFence * preFences
Variables
- uint32_t cudlaWaitEvents::numEvents [inherited]
-
Total number of wait events.
- const CudlaFence * cudlaWaitEvents::preFences [inherited]
-
Array of fence pointers for all the wait events.
3. Data Fields
Here is a list of all documented struct and union fields with links to the struct/union documentation for each field:
- deviceVersion
- cudlaDevAttribute
- devPtrs
- cudlaSignalEvents
- eofFences
- cudlaSignalEvents
- extBufObject
- cudlaExternalMemoryHandleDesc
- extSyncObject
- cudlaExternalSemaphoreHandleDesc
- fence
- CudlaFence
- inputTensor
- cudlaTask
- inputTensorDesc
- cudlaModuleAttribute
- moduleHandle
- cudlaTask
- numEvents
- cudlaWaitEvents
- cudlaSignalEvents
- numInputTensors
- cudlaTask
- cudlaModuleAttribute
- numOutputTensors
- cudlaTask
- cudlaModuleAttribute
- outputTensor
- cudlaTask
- outputTensorDesc
- cudlaModuleAttribute
- preFences
- cudlaWaitEvents
- signalEvents
- cudlaTask
- size
- cudlaExternalMemoryHandleDesc
- type
- CudlaFence
- unifiedAddressingSupported
- cudlaDevAttribute
- waitEvents
- cudlaTask
Notices
Notice
This document is provided for information purposes only and shall not be regarded as a warranty of a certain functionality, condition, or quality of a product. NVIDIA Corporation (“NVIDIA”) makes no representations or warranties, expressed or implied, as to the accuracy or completeness of the information contained in this document and assumes no responsibility for any errors contained herein. NVIDIA shall have no liability for the consequences or use of such information or for any infringement of patents or other rights of third parties that may result from its use. This document is not a commitment to develop, release, or deliver any Material (defined below), code, or functionality.
NVIDIA reserves the right to make corrections, modifications, enhancements, improvements, and any other changes to this document, at any time without notice.
Customer should obtain the latest relevant information before placing orders and should verify that such information is current and complete.
NVIDIA products are sold subject to the NVIDIA standard terms and conditions of sale supplied at the time of order acknowledgement, unless otherwise agreed in an individual sales agreement signed by authorized representatives of NVIDIA and customer (“Terms of Sale”). NVIDIA hereby expressly objects to applying any customer general terms and conditions with regards to the purchase of the NVIDIA product referenced in this document. No contractual obligations are formed either directly or indirectly by this document.
NVIDIA products are not designed, authorized, or warranted to be suitable for use in medical, military, aircraft, space, or life support equipment, nor in applications where failure or malfunction of the NVIDIA product can reasonably be expected to result in personal injury, death, or property or environmental damage. NVIDIA accepts no liability for inclusion and/or use of NVIDIA products in such equipment or applications and therefore such inclusion and/or use is at customer’s own risk.
NVIDIA makes no representation or warranty that products based on this document will be suitable for any specified use. Testing of all parameters of each product is not necessarily performed by NVIDIA. It is customer’s sole responsibility to evaluate and determine the applicability of any information contained in this document, ensure the product is suitable and fit for the application planned by customer, and perform the necessary testing for the application in order to avoid a default of the application or the product. Weaknesses in customer’s product designs may affect the quality and reliability of the NVIDIA product and may result in additional or different conditions and/or requirements beyond those contained in this document. NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.
No license, either expressed or implied, is granted under any NVIDIA patent right, copyright, or other NVIDIA intellectual property right under this document. Information published by NVIDIA regarding third-party products or services does not constitute a license from NVIDIA to use such products or services or a warranty or endorsement thereof. Use of such information may require a license from a third party under the patents or other intellectual property rights of the third party, or a license from NVIDIA under the patents or other intellectual property rights of NVIDIA.
Reproduction of information in this document is permissible only if approved in advance by NVIDIA in writing, reproduced without alteration and in full compliance with all applicable export laws and regulations, and accompanied by all associated conditions, limitations, and notices.
THIS DOCUMENT AND ALL NVIDIA DESIGN SPECIFICATIONS, REFERENCE BOARDS, FILES, DRAWINGS, DIAGNOSTICS, LISTS, AND OTHER DOCUMENTS (TOGETHER AND SEPARATELY, “MATERIALS”) ARE BEING PROVIDED “AS IS.” NVIDIA MAKES NO WARRANTIES, EXPRESSED, IMPLIED, STATUTORY, OR OTHERWISE WITH RESPECT TO THE MATERIALS, AND EXPRESSLY DISCLAIMS ALL IMPLIED WARRANTIES OF NONINFRINGEMENT, MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE. TO THE EXTENT NOT PROHIBITED BY LAW, IN NO EVENT WILL NVIDIA BE LIABLE FOR ANY DAMAGES, INCLUDING WITHOUT LIMITATION ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES, HOWEVER CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF ANY USE OF THIS DOCUMENT, EVEN IF NVIDIA HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Notwithstanding any damages that customer might incur for any reason whatsoever, NVIDIA’s aggregate and cumulative liability towards customer for the products described herein shall be limited in accordance with the Terms of Sale for the product.