RadarSnapshotExtraction#

Overview#

Snapshot Extraction is a radar signal processing operator that performs Doppler Division Multiplexing (DDM) disambiguation and gathers antenna snapshots from the range-Doppler map at detected target locations. It is typically used after CFAR detection to prepare data for Direction of Arrival (DOA) estimation.

The operator takes a folded detection list (range index, folded Doppler index), resolves the true Doppler indices using DDM offsets, and extracts complex-valued snapshots containing all TX-RX channel combinations for each detected target. Optional calibration weights can be applied during extraction.

Algorithm Description#

Formal inputs and outputs#

  1. Inputs

    1. Detection count: Scalar number of detections to process.

    2. Folded detection list: \([N, 2]\) — per detection: range index, folded Doppler index (within a Doppler fold).

    3. DDM Doppler offsets: [numDopplerFolds] float32 — offset per TX (or per fold) for DDM space and DDMA weights.

    4. NCI Rx: \([\text{numRangeBins}, \text{numDopplerBins}]\) — unfolded NCI combined range–Doppler map over RX (used for DDM disambiguation).

    5. Range–Doppler map (RDM): \([\text{numRangeBins}, \text{numRx}, \text{numDopplerBins}]\) or \([\text{numRangeBins}, \text{numDopplerBins}, \text{numRx}]\) complex int32 (FT2D), per rangeDopplerFormat.

    6. Calibration weights (optional): \([\text{numTx}, \text{numRx}]\) complex int32 — if present, used instead of DDMA weights.

  2. Outputs

    1. Detection list: \([N, 2]\) — range index and unfolded Doppler index (Doppler bin for TX1).

    2. Snapshots: \([N, \text{numTx}, \text{numRx}]\) complex int32 — virtual antenna response per detection after weighting.

Processing per detection#

The high-level stages match the following detailed steps.

DDM disambiguation#

In Doppler Division Multiplexing, different TX antennas transmit with different Doppler frequency offsets. The received signal at each folded Doppler bin is a superposition of contributions from multiple TX antennas. The operator resolves this ambiguity by:

  1. Taking the folded detection coordinates (range, folded Doppler)

  2. Applying TX-specific Doppler offsets to compute the true (unfolded) Doppler index for each TX antenna

  3. Writing the unfolded detection list for downstream use

Snapshot gathering#

For each detection, the operator gathers a snapshot matrix of shape [numTx × numRx] from the range-Doppler map:

  1. For each TX antenna, the appropriate Doppler bin is accessed using the DDM-resolved offset

  2. For each RX channel at that Doppler bin, the complex value at the detected range bin is extracted

  3. Optional calibration weights are applied element-wise to correct for antenna array imperfections

The resulting snapshot contains the complex antenna response for each virtual channel (TX-RX pair), which encodes the spatial information needed for DOA estimation.

Weight correction#

Gathered samples are multiplied element-wise by weights. If calibration weights are provided (\([\text{numTx}, \text{numRx}]\) complex, Q28), those are used. Otherwise DDMA weights are applied: one complex weight per TX,

\[w_{\text{tx}} = \overline{\exp\bigl(-j \, 2\pi \, \texttt{ddmDopplerOffset}[\text{tx}]\bigr)}\]

in fixed-point (Q16), broadcast across RX for that TX. Output is truncated/rounded to the configured format.

Notes#

  • The first and last range bins are not treated specially; all range indices present in the folded list are valid.

  • DDM disambiguation reuses the same NCI maximum-selection principle as standard Peak Detection.

Design Requirements#

  • Maximum number of detections: 8192 (VMEM limit for the folded detection list).

  • TX and RX counts: each at most 8; supported configurations include 4×4 and 8×8.

  • Maximum range bins: 512; Doppler bins: 4 to 512.

  • numDopplerFolds: 4 to 16, must divide numDopplerBins evenly; must be \(\geq\) number of TX antennas.

  • numDopplerFolds must match the DDM Doppler offsets tensor length.

  • RDM layout: PVA_FFT_LAYOUT_RANGE_RX_DOPPLER or PVA_FFT_LAYOUT_RANGE_DOPPLER_RX; any other layout is rejected.

  • Calibration weights tensor is optional; when omitted, DDMA weights are derived from DDM Doppler offsets.

Implementation Details#

Dataflow variants#

Two VPU implementations share the same math:

  • SQDF variant: For each detection, load one full RDM row (one range: \([\text{numRx}, \text{numDopplerBins}]\) or \([\text{numDopplerBins}, \text{numRx}]\)) and one NCI row via SQDF; index in VMEM with bestDopplerIdxs. Suited when row loads are acceptable.

  • GSDF variant: Gather only the needed RDM elements via GSDF—either \(\text{numTx} \times \text{numRx}\) single-complex tiles (RANGE_RX_DOPPLER) or numTx tiles of numRx complexes (RANGE_DOPPLER_RX). NCI is still loaded per range via SQDF. Reduces bandwidth when detections are numerous and the RDM is large.

The host selects the variant (for example from RDM size and format).

Dataflow configuration#

  • One SQDF for coefficients: DDMA or calibration weights and DDM space \([\text{numTx}]\).

  • One SQDF for the folded detection list (DRAM → VMEM).

  • One SQDF for NCI Rx (one range row at a time).

  • RDM: one SQDF (full row per detection) or one GSDF gather by computed offset.

  • One SQDF for snapshot output (VMEM → DRAM); one SQDF for the unfolded detection list.

Input and output tiling#

  • Folded detection list: VMEM \([\text{maxDetections}, 2]\); loaded once.

  • NCI: One row per range (numDopplerBins samples); loaded per detection’s range, double-buffered with the next.

  • RDM (SQDF): One range row per detection; double-buffered.

  • RDM (GSDF): Offsets per detection from range and bestDopplerIdxs; tile count \(\text{numTx} \times \text{numRx}\) or numTx with appropriate tile width.

  • Snapshots: One \([\text{numTx}, \text{numRx}]\) complex per detection; SQDF out, ping-pong with next detection.

  • Detection list out: \([\text{maxDetections}, 2]\) written after all detections.

DDM disambiguation on device#

Using the NCI row at the detection range, the kernel sums NCI at DDM-related bins for each candidate fold. A host-prepared DDM space bitmask (ddmSpaceBitMask) selects which NCI lanes participate per TX. Vector paths use vbitunpackw, vmux / dvmux, and vsumr_s. After argmax over candidates, TX1 Doppler is unfolded and bestDopplerIdxs is filled.

DDM space bitmask (ddmSpaceBitMask)#

Host (OpSnapshotExtraction.cpp):

  1. From DDM offsets and numDopplerBins, compute per-TX DDMspace[tx].

  2. foldedDdmSpace[tx] = DDMspace[tx] / foldSize with foldSize = numDopplerBins / numDopplerFolds.

  3. Build bitMaskVec of length \(2 \times \text{numDopplerFolds}\) (1 = ignore, 0 = use); mark occupied folds; duplicate for periodicity.

  4. Pack into a 32-bit ddmSpaceBitMask for vbitunpackw sliding windows: ddmSpaceBitMask |= bitMaskVec[1 + i] << i for \(i = 0 \ldots 2\text{numDopplerFolds}-2\).

  5. Pass to VPU (scalar parameter / VMEM), loaded with other coefficients.

Device (summary): gatherNciRxTileComputeDopplerIdx fills nciRxTileBufGather for each candidate fold; computeNciRxSumFindMax_8folds / _16folds applies the unpacked bitmask, accumulates masked sums, shifts the mask, then selects the winning fold. Unfolded TX1 index: dopplerIdx = dopplerFoldIdx + index * (numDopplerBins / numDopplerFolds); snapshot indices bestDopplerIdxs[tx] = (DDMspace[tx] + dopplerIdx) % numDopplerBins.

RDM snapshot gather (device)#

SQDF: Index the loaded RDM row with (rxIdx, bestDopplerIdxs[tx]) or (bestDopplerIdxs[tx], rxIdx). GSDF: computeRdmGatherOffsets forms byte offsets for each (rangeIdx, bestDopplerIdxs[tx], rxIdx); gather into a contiguous complex buffer, then apply weights.

Weight correction (device)#

Pre-initialized AGEN paths feed weights, gathered RDM, and output. Element-wise complex multiply applies DDMA (Q16) or calibration (Q28) rules; without calibration, the first DDMA row is replicated across RX so one loop can cover all pairs. Results are written to the snapshot buffer and SQDF’d to DRAM.

Double-buffering#

Ping-pong NCI, RDM (and GSDF gather buffer), and snapshot output so the next detection’s loads overlap the current detection’s compute and DMA.

Performance#

Time splits roughly into:

  1. DDM disambiguation — compute-bound vs detections and numDopplerFolds.

  2. RDM transfer — SQDF is one full row per detection; GSDF moves fewer samples but adds per-tile overhead.

  3. Weight correction — compute-bound in \(\text{numTx} \times \text{numRx}\).

  4. Outputs — largely overlapped via double-buffering.

Choose GSDF when RDM rows are large and each detection only needs a small subset of samples.

Execution Time is the average time required to execute the operator on a single VPU core. Note that each PVA contains two VPU cores, which can operate in parallel to process two streams simultaneously, or reduce execution time by approximately half by splitting the workload between the two cores.

Total Power represents the average total power consumed by the module when the operator is executed concurrently on both VPU cores. Idle power is approximately 7.6 W on Jetson AGX Orin and 11.8 W on Jetson AGX Thor when the PVA is not processing data.

For detailed information on interpreting the performance table below and understanding the benchmarking setup, see Performance Benchmark.

Detections

Doppler Folds

Range Bins

Doppler Bins

Rx Antennas

Tx Antennas

Range-Doppler Layout

Calibrated

Execution Time

Submit Latency

Total Power

1024

16

256

256

8

8

RangeRxDoppler

OFF

1.929ms

0.013ms

11.614W

1024

8

256

256

4

4

RangeRxDoppler

OFF

2.069ms

0.008ms

9.311W

1024

8

512

512

4

4

RangeRxDoppler

OFF

2.104ms

0.010ms

9.411W

1024

16

512

512

8

8

RangeRxDoppler

OFF

2.304ms

0.012ms

13.126W

8192

16

256

256

8

8

RangeRxDoppler

OFF

15.230ms

0.045ms

12.014W

8192

8

256

256

4

4

RangeRxDoppler

OFF

15.809ms

0.032ms

9.71W

8192

8

512

512

4

4

RangeRxDoppler

OFF

15.846ms

0.043ms

9.81W

8192

16

512

512

8

8

RangeRxDoppler

OFF

17.979ms

0.045ms

13.525W

8192

8

256

256

4

4

RangeRxDoppler

Calibrated

15.842ms

0.037ms

9.71W

8192

16

512

512

8

8

RangeRxDoppler

Calibrated

17.977ms

0.045ms

13.627W

8192

16

256

256

8

8

RangeDopplerRx

OFF

10.305ms

0.048ms

9.81W

8192

16

512

512

8

8

RangeDopplerRx

OFF

10.473ms

0.047ms

9.911W

8192

8

256

256

4

4

RangeDopplerRx

OFF

8.295ms

0.025ms

9.411W

8192

8

512

512

4

4

RangeDopplerRx

OFF

8.694ms

0.032ms

9.512W

8192

16

512

512

8

8

RangeDopplerRx

Calibrated

10.470ms

0.045ms

9.512W

Detections

Doppler Folds

Range Bins

Doppler Bins

Rx Antennas

Tx Antennas

Range-Doppler Layout

Calibrated

Execution Time

Submit Latency

Total Power

1024

8

256

256

4

4

RangeRxDoppler

OFF

1.332ms

0.005ms

12.66W

1024

8

512

512

4

4

RangeRxDoppler

OFF

1.642ms

0.006ms

12.761W

1024

16

256

256

8

8

RangeRxDoppler

OFF

2.155ms

0.006ms

13.155W

1024

16

512

512

8

8

RangeRxDoppler

OFF

2.225ms

0.006ms

15.664W

8192

8

256

256

4

4

RangeRxDoppler

OFF

10.218ms

0.007ms

13.054W

8192

8

512

512

4

4

RangeRxDoppler

OFF

12.731ms

0.008ms

13.56W

8192

16

256

256

8

8

RangeRxDoppler

OFF

17.031ms

0.014ms

15.461W

8192

16

512

512

8

8

RangeRxDoppler

OFF

17.590ms

0.016ms

17.05W

8192

8

256

256

4

4

RangeRxDoppler

Calibrated

10.220ms

0.007ms

12.55W

8192

16

512

512

8

8

RangeRxDoppler

Calibrated

17.591ms

0.015ms

16.655W

8192

16

256

256

8

8

RangeDopplerRx

OFF

11.480ms

0.015ms

12.761W

8192

16

512

512

8

8

RangeDopplerRx

OFF

11.656ms

0.015ms

12.963W

8192

8

256

256

4

4

RangeDopplerRx

OFF

8.382ms

0.006ms

12.761W

8192

8

512

512

4

4

RangeDopplerRx

OFF

8.472ms

0.007ms

13.459W

8192

16

512

512

8

8

RangeDopplerRx

Calibrated

11.657ms

0.015ms

13.955W