System Overview

The NVIDIA DGX Station is a powerful system based on the Grace Blackwell architecture. Its purpose is to provide AI developers, data scientists and researches with a desktop-sized device that features the same architecture found in cloud-scale NVIDIA solutions. Applications can be developed and debugged locally with DGX Station and then brought to massive scale on the cloud. Both desktop and server use cases are supported.

Hardware

DGX Station is based on the Grace Blackwell architecture capable of up to 20 PFLOPs of AI compute. The system contains up to 748 GB of coherent memory and enables work with huge AI models of up to 1T parameters. This section details the architectural specifics of this platform.

CPU Architecture

DGX Station features one Grace CPU with 72 cores based on the Neoverse V2 architecure. The CPU cores support the ARM v9.0 instruction set with crypto extensions and contain four 128b SVE2 units. The CPU has a 6-way instruction decoder, is able to dispatch 8 instructions per clock and has 6 scalar ALUs. Each core has 64 KB of L1 instruction cache and 64 KB of L1 data cache, as well as 1 MB of L2 cache (8-way set associative). There is a total of 114 MB of L3 cache available to the CPU.

Up to 496 GB of LPDDR5X memory is attached to the CPU.

GPU

The GPU is a GB300 with up to 252 GB of HBM3e, delivering up to 7.1 TB/s of GPU memory bandwidth. The CPU and GPU are connected with a high speed NVLink C2C interconnect that facilitates coherent access to CPU and GPU memory.

Networking

One NVIDIA ConnectX-8 NIC is included to allow networking at up to 800 Gbit/s.

Software

DGX Station is preinstalled with Ubuntu with NVIDIA AI Developer Tools which is based on Ubuntu version 24.04. NVIDIA drivers, libraries, frameworks and tools are included.