Defined in File common.h
Cumulative inference statistics.
For GRPC protocol, ‘cumulative_send_time_ns’ represents the time for marshaling infer request. ‘cumulative_receive_time_ns’ represents the time for unmarshaling infer response.
Total number of requests completed.
Time from the request start until the response is completely received.
Time from the request start until the last byte is sent.
Time from receiving first byte of the response until the response is completely received.