dynamo.nixl_connect.Device#
Device class describes the device a given allocation resides in.
Usually host ("cpu") or GPU ("cuda") memory.
When a system contains multiple GPU devices, specific GPU devices can be identified by including their ordinal index number.
For example, to reference the second GPU in a system "cuda:1" can be used.
By default, when "cuda" is provided, it is assumed to be "cuda:0" or the first GPU enumerated by the system.
Properties#
id#
@property
def id(self) -> int:
Gets the identity, or ordinal, of the device.
When the device is the HOST, this value is always 0.
When the device is a GPU, this value identifies a specific GPU.
kind#
@property
def kind(self) -> DeviceKind:
Gets the DeviceKind of device the instance references.