Function TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize

• Defined in File tritonserver.h

Function Documentation

TRITONSERVER_Error *TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize(TRITONSERVER_ServerOptions *options, uint64_t size)

Set the total pinned memory byte size that the server can allocate in a server options.

The pinned memory pool will be shared across Triton itself and the backends that use TRITONBACKEND_MemoryManager to allocate memory.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

• options: The server options object.

• size: The pinned memory pool byte size.