RMMExtension#

Extension for RAPIDS memory managament operation. Also supports stream ordered memory allocations on device memory.

  • UUID: 45fa2002-1f83-11ef-a380-ef5f83754f84

  • Version: 0.0.1

  • Author: NVIDIA

  • License: LICENSE

Components#

nvidia::gxf::RMMAllocator#

Allocator which is used to allocate/deallocate memory using Rapids Memory Manager (RMM). This component enables efficient and stream-ordered memory allocation for GPU operations. This can be used to allocate pinned host memory.

  • Component ID: 5a8ac4c2-1f83-11ef-8859-d710d3299dfa

  • Base Type: nvidia::gxf::CudaAllocator

Parameters#

gpu_device

GPU device resource from which is used allocate CUDA memory.

  • Flags: GXF_PARAMETER_FLAGS_NONE

  • Type: GXF_PARAMETER_TYPE_HANDLE

  • Handle Type: nvidia::gxf::GPUDevice

device_memory_initial_size

The initial memory pool size used by device memory resource. The size is specified as a string containing a number and an (optional) unit. If no unit is given the value is assumed to be in bytes. Supported units are: B, KB, MB, GB, TB.

  • Flags: GXF_PARAMETER_FLAGS_NONE

  • Type: GXF_PARAMETER_TYPE_STRING

  • Default: “16MB” (non-Jetson machine) or “8MB” (Jetson machine)


host_memory_initial_size

The initial memory pool size used by this pinned host memory resource. The size is specified as a string containing a number and an (optional) unit. If no unit is given the value is assumed to be in bytes. Supported units are: B, KB, MB, GB, TB.

  • Flags: GXF_PARAMETER_FLAGS_NONE

  • Type: GXF_PARAMETER_TYPE_STRING

  • Default: “16MB” (non-Jetson machine) or “8MB” (Jetson machine)


device_memory_max_size

The maximum memory pool size used by device memory resource. The size is specified as a string containing a number and an (optional) unit. If no unit is given the value is assumed to be in bytes. Supported units are: B, KB, MB, GB, TB.

  • Flags: GXF_PARAMETER_FLAGS_NONE

  • Type: GXF_PARAMETER_TYPE_STRING

  • Default: “32MB” (non-Jetson machine) or “16MB” (Jetson machine)


host_memory_max_size

The maximum memory pool size used by this pinned host memory resource. The size is specified as a string containing a number and an (optional) unit. If no unit is given the value is assumed to be in bytes. Supported units are: B, KB, MB, GB, TB.

  • Flags: GXF_PARAMETER_FLAGS_NONE

  • Type: GXF_PARAMETER_TYPE_STRING

  • Default: “32MB” (non-Jetson machine) or “16MB” (Jetson machine)

On this page