Function TRITONSERVER_InferenceTraceNew

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceTraceNew(TRITONSERVER_InferenceTrace **trace, TRITONSERVER_InferenceTraceLevel level, uint64_t parent_id, TRITONSERVER_InferenceTraceActivityFn_t activity_fn, TRITONSERVER_InferenceTraceReleaseFn_t release_fn, void *trace_userp)

Create a new inference trace object.

The caller takes ownership of the TRITONSERVER_InferenceTrace object and must call TRITONSERVER_TraceDelete to release the object.

The activity callback function will be called to report activity for ‘trace’ as well as for any child traces that are spawned by ‘trace’, and so the activity callback must check the trace object to determine specifically what activity is being reported.

The release callback is called for both ‘trace’ and for any child traces spawned by ‘trace’.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • trace: Returns the new infernece trace object.

  • level: The tracing level.

  • parent_id: The parent trace id for this trace. A value of 0 indicates that there is not parent trace.

  • activity_fn: The callback function where activity for the trace is reported.

  • release_fn: The callback function called when all activity is complete for the trace.

  • trace_userp: User-provided pointer that is delivered to the activity and release callback functions.