User Guide
Developer Guide
Reference
Defined in File trtserver.h
trtserver_allocatorregion_enum
TRTSERVER_ResponseAllocator.
Object representing a memory allocator for inference response tensors.Allocation regions.
Values:
TRTSERVER_MEMORY_CPU
TRTSERVER_MEMORY_GPU