Function TRTSERVER_ServerOptionsSetPinnedMemoryPoolByteSize

Function Documentation

TRTSERVER_Error *TRTSERVER_ServerOptionsSetPinnedMemoryPoolByteSize(TRTSERVER_ServerOptions *options, uint64_t size)

Set the total pinned memory byte size that the server can allocate in a server options.

This option will not affect the allocation conducted by the backend frameworks.

Return

a TRTSERVER_Error indicating success or failure.

Parameters
  • options: The server options object.

  • size: The pinned memory pool byte size.