Frontend APIUtilities

CUDA Graphs

View as Markdown

populate_cuda_graph

The populate_cuda_graph function is a member function of the Graph class. It is used to populate a CUDA graph with the necessary data and operations.

Parameters

  • handle: A cuDNN handle.
  • uid_to_device_ptrs: A map of tensor UIDs to device pointers.
  • workspace: A pointer to the workspace memory.
  • cudnn_cuda_graph: A pointer to the CUDA graph.

Return Value

  • An error_t object indicating the success or failure of the function.

update_cuda_graph

The update_cuda_graph function is a member function of the Graph class. It is used to update a CUDA graph with the necessary data and operations.

Parameters

  • handle: A cuDNN handle.
  • uid_to_device_ptrs: A map of tensor UIDs to device pointers.
  • workspace: A pointer to the workspace memory.
  • cudnn_cuda_graph: A pointer to the CUDA graph.

Return Value

  • An error_t object indicating the success or failure of the function.