Function TRTSERVER_ServerOptionsAddTensorFlowVgpuMemoryLimits¶
Defined in File trtserver.h
Function Documentation¶
-
TRTSERVER_Error *
TRTSERVER_ServerOptionsAddTensorFlowVgpuMemoryLimits
(TRTSERVER_ServerOptions *options, int gpu_device, int num_vgpus, uint64_t per_vgpu_memory_mbytes)¶ Add Tensorflow virtual GPU instances to a physical GPU.
- Return
a TRTSERVER_Error indicating success or failure.
- Parameters
options
: The server options object.gpu_device
: The physical GPU device id.num_vgpus
: The number of virtual GPUs to create on the physical GPU.per_vgpu_memory_mbytes
: The amount of GPU memory, in megabytes, to dedicate to each virtual GPU instance.