Skip to navigation

lens.resources.gpu

View as Markdown

GPU identity detection.

Module Contents

Functions

API

lens.resources.gpu._decode(
value
)
lens.resources.gpu._first_value(
explicit: int | str | None,
env: collections.abc.Mapping[str, str],
env_names: str = ()
) -> int | str | None
lens.resources.gpu._physical_gpu_index(
local_rank: int | str | None,
env: collections.abc.Mapping[str, str]
) -> int | None
lens.resources.gpu._set_compute_capability(
attrs,
pynvml,
handle
) -> None
lens.resources.gpu._set_optional(
attrs: dict[str, nemo.lens.resources.attributes.ResourceAttributeValue],
key: str,
getter,
handle
) -> None
lens.resources.gpu._set_optional_field(
attrs: dict[str, nemo.lens.resources.attributes.ResourceAttributeValue],
key: str,
getter
) -> None
lens.resources.gpu.detect_gpu(
local_rank: int | str | None = None,
environ: collections.abc.Mapping[str, str] | None = None
) -> dict[str, nemo.lens.resources.attributes.ResourceAttributeValue]

Detect worker-local GPU identity from NVML.

local_rank is the rank’s index within CUDA_VISIBLE_DEVICES. Callers that already know their local rank should pass it explicitly; otherwise the helper falls back to common launcher environment variables and then rank 0.