HybridMemoryModeOptions#
-
class nvmath.
sparse. advanced. HybridMemoryModeOptions( - hybrid_memory_mode: bool = False,
- hybrid_device_memory_limit: int | str | None = None,
- register_cuda_memory: bool = True,
A data class for providing options related to the use of hybrid (CPU-GPU) memory to those execution spaces that support it.
- hybrid_memory_mode#
If set to True, use CPU memory to store factors (default:
False
). Seenvmath.
.bindings. cudss. ConfigParam. HYBRID_MODE - Type:
- device_memory_limit#
The maximum device memory available for execution. It can be specified as a value (with optional suffix like K[iB], M[iB], G[iB]) or as a percentage. The default is based on internal heuristics. See
nvmath.
.bindings. cudss. ConfigParam. HYBRID_DEVICE_MEMORY_LIMIT
- register_cuda_memory#
Specify whether to register memory using
cudaHostRegister()
if hybrid memory mode is used. The default isTrue
. Seenvmath.
.bindings. cudss. ConfigParam. USE_CUDA_REGISTER_MEMORY - Type:
See also