Class ProfileContext¶
- Defined in File request.h
Inheritance Relationships¶
Derived Types¶
public nvidia::inferenceserver::client::ProfileGrpcContext
(Class ProfileGrpcContext)public nvidia::inferenceserver::client::ProfileHttpContext
(Class ProfileHttpContext)
Class Documentation¶
-
class
ProfileContext
¶ A ProfileContext object is used to control profiling on the inference server.
Once created a ProfileContext object can be used repeatedly.
A ProfileContext object can use either HTTP protocol or gRPC protocol depending on the Create function (ProfileHttpContext::Create or ProfileGrpcContext::Create). For example:
std::unique_ptr<ProfileContext> ctx; ProfileGrpcContext::Create(&ctx, "localhost:8000"); ctx->StartProfile(); ... ctx->StopProfile(); ...
- Note
- ProfileContext::Create methods are thread-safe. StartProfiling() and StopProfiling() are not thread-safe. For a given ProfileContext, calls to these methods must be serialized.
Subclassed by nvidia::inferenceserver::client::ProfileGrpcContext, nvidia::inferenceserver::client::ProfileHttpContext
Public Functions
Protected Functions
-
ProfileContext
(bool)¶
Protected Attributes
-
const bool
verbose_
¶