Function TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize¶
Defined in File tritonserver.h
Function Documentation¶
-
TRITONSERVER_Error *
TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize
(TRITONSERVER_ServerOptions *options, uint64_t size)¶ Set the total pinned memory byte size that the server can allocate in a server options.
This option will not affect the allocation conducted by the backend frameworks.
- Return
a TRITONSERVER_Error indicating success or failure.
- Parameters
options
: The server options object.size
: The pinned memory pool byte size.