- Defined in File request.h
Cumulative statistic of the InferContext.
- For gRPC protocol, ‘cumulative_send_time_ns’ represents the time for marshaling infer request. ‘cumulative_receive_time_ns’ represents the time for unmarshaling infer response.
Create a new Stat object with zero-ed statistics.
Total number of requests completed.
Time from the request start until the response is completely received.
Time from the request start until the last byte is sent.
Time from receiving first byte of the response until the response is completely received.