For AI agents: a documentation index is available at the root level at /llms.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
LogoLogoDocumentation
Digest
DocumentationRecipes
DocumentationRecipes
  • Getting Started
    • Quickstart
    • Introduction
    • Local Installation
    • Building from Source
    • Kubernetes Deployment
    • Contribution Guide
  • Resources
    • Support Matrix
    • Feature Matrix
    • Release Artifacts
    • Examples
    • Glossary
  • Feature Benchmarks
    • Browse All Benchmarks
  • Digest
    • NVIDIA Dynamo Snapshot: Fast Startup for Inference Workloads on Kubernetes
    • DynoSim: Simulating the Pareto Frontier
    • Dynamo Day 0 support for TokenSpeed
    • Multi-Turn Agentic Harnesses
    • Full-Stack Optimizations for Agentic Inference
    • Flash Indexer: Inter-Galactic KV Routing
  • Kubernetes Deployment
  • Feature Guides
    • KV Cache Aware Routing
    • Disaggregated Serving
    • KV Cache Offloading
    • Benchmarking
    • Tool Calling & Reasoning Parsing
    • Fault Tolerance
    • Observability (Local)
    • Inference Simulation
    • Agents
    • LoRA Adapters
    • Multimodal
    • Diffusion
    • Fastokens Tokenizer
  • Backends
    • SGLang
    • TensorRT-LLM
    • vLLM
  • Components
    • Frontend
    • Router
    • Planner
    • Profiler
    • KVBM
  • Integrations
  • Design Docs
    • Overall Architecture
    • Architecture Flow
    • Disaggregated Serving
    • Distributed Runtime
  • Documentation
    • Style Guide
    • Building and Publishing
  • Additional Resources
    • NIXL Connect API
      • Device Kind
  • Quickstart
  • Introduction
  • Local Installation
  • Building from Source
  • Kubernetes Deployment
  • Contribution Guide
  • Support Matrix
  • Feature Matrix
  • Release Artifacts
  • Examples
  • Glossary
  • Feature Benchmarks
  • Browse All Benchmarks
  • Digest
  • NVIDIA Dynamo Snapshot: Fast Startup for Inference Workloads on Kubernetes
  • DynoSim: Simulating the Pareto Frontier
  • Dynamo Day 0 support for TokenSpeed
  • Multi-Turn Agentic Harnesses
  • Full-Stack Optimizations for Agentic Inference
  • Flash Indexer: Inter-Galactic KV Routing
  • Kubernetes Quickstart
  • Installation Guide
  • Dynamo Operator
  • Minikube Setup
  • Deployment Overview
  • Managing Models with DynamoModel
  • DGDR Reference
  • DGDR Examples
  • Model Caching
  • ModelExpress
  • Autoscaling
  • Rolling Update
  • Disagg Communication
  • Topology-Aware KV Transfer
  • Metrics
  • Logging
  • Operator Metrics
  • Multinode Deployments
  • Grove
  • Topology Aware Scheduling
  • Service Discovery
  • Webhooks
  • Snapshotting GPU Workers
  • Shadow Engine Failover
  • Developing with Tilt
  • EKS Setup
  • EFA (RDMA over AWS Fabric)
  • EFS
  • ECS
  • AKS Setup
  • RDMA / InfiniBand
  • AKS Storage
  • Azure Lustre CSI Driver
  • Spot VMs
  • GKE Setup
  • Feature Guides
  • KV Cache Aware Routing
  • Disaggregated Serving
  • Sizing with AIConfigurator
  • KV Cache Offloading
  • Benchmarking
  • Tool Calling & Reasoning Parsing
  • Tool Call Parsing (Dynamo)
  • Reasoning Parsing (Dynamo)
  • Parser Engine Fallback
  • Parser Configuration
  • Tool Calling Probe Snapshot for Dynamo 1.2
  • Troubleshooting Tool Calls
  • Fault Tolerance
  • Request Migration
  • Request Cancellation
  • Request Rejection
  • Graceful Shutdown
  • Testing
  • Observability (Local)
  • Prometheus + Grafana Setup
  • Metrics
  • Metrics Developer Guide
  • Health Checks
  • Tracing
  • Logging
  • Inference Simulation
  • Live Simulation with Mocker
  • Simulation Runs
  • Simulation Sweeps
  • Planner Simulation Benchmarking
  • Agents
  • Session IDs
  • Agent Tracing
  • Agent Simulation
  • Agent Hints
  • Agent Harnesses
  • ThunderAgent Program Scheduler
  • LoRA Adapters
  • Multimodal
  • Embedding Cache
  • Encoder Disaggregation
  • Multimodal KV Routing
  • Diffusion
  • FastVideo
  • Fastokens Tokenizer
  • SGLang
  • Reference Guide
  • Examples
  • Disaggregation
  • Diffusion
  • Frontend Processor Fallback
  • Logits Processing
  • Observability
  • Agentic Workloads
  • TensorRT-LLM
  • Reference Guide
  • Examples
  • Observability
  • Diffusion (Experimental)
  • Known Issues and Mitigations
  • vLLM
  • Reference Guide
  • Frontend Processor Fallback
  • Logits Processing
  • Examples
  • KV Cache Offloading
  • Observability
  • vLLM-Omni
  • Custom Backend Overview
  • Writing Unified Backends
  • Writing Python Workers
  • Runtime Containers
  • Frontend
  • Frontend Guide
  • Configuration Reference
  • Tokenizer
  • Router
  • Routing Concepts
  • Configuration and Tuning
  • Deficit Round Robin Queue Scheduling
  • Priority Scheduling
  • Disaggregated Serving
  • Topology-Aware KV Transfer
  • Router Operations
  • Router Examples
  • Standalone Indexer
  • Standalone Selection Service
  • Standalone Slot Tracker
  • KV Event Replay — Dynamo vs vLLM
  • Planner
  • Planner Guide
  • Global Planner Guide
  • Planner Examples
  • Profiler
  • Profiler Guide
  • Profiler Examples
  • KVBM
  • HiCache
  • LMCache
  • FlexKV
  • KV Events for Custom Engines
  • LWS
  • Gateway API Inference Extension (GAIE)
  • Overall Architecture
  • Architecture Flow
  • Disaggregated Serving
  • Distributed Runtime
  • Discovery Plane
  • Request Plane
  • Event Plane
  • Router Design
  • KVBM Design
  • Planner Design
  • Style Guide
  • Building and Publishing
Digest
On this page
  • Values
  • CUDA
  • HOST
  • Related Classes
Additional ResourcesNIXL Connect API

Device Kind

||View as Markdown|

Represents the kind of device a Device object represents.

Values

CUDA

CUDA addressable device (GPU) memory.

HOST

System (CPU) memory.

Related Classes

  • Connector
  • Descriptor
  • Device
  • OperationStatus
  • RdmaMetadata
  • ReadOperation
  • WritableOperation
  • WriteOperation
Previous

NIXL Connect API

NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.