Function TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize

Function Documentation

TRITONSERVER_Error *TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize(TRITONSERVER_ServerOptions *options, uint64_t size)

Set the total pinned memory byte size that the server can allocate in a server options.

This option will not affect the allocation conducted by the backend frameworks.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters
  • options: The server options object.

  • size: The pinned memory pool byte size.