Function TRTSERVER_ServerOptionsSetTensorFlowGpuMemoryFraction

Function Documentation

TRTSERVER_Error *TRTSERVER_ServerOptionsSetTensorFlowGpuMemoryFraction(TRTSERVER_ServerOptions *options, float fraction)

Set the fraction of GPU memory dedicated to TensorFlow models on each GPU visible to the inference server.

Zero (0) indicates that no memory will be dedicated to TensorFlow and that it will instead allocate memory as needed.


a TRTSERVER_Error indicating success or failure.

  • options: The server options object.

  • fraction: The fraction of the GPU memory dedicated to TensorFlow.