What are the context-size limits for Kumo Tabular and Kumo Relational?
Neither model has a fixed model-level context-size limit. In the standalone SDM library, practical capacity depends on available GPU memory. Inference currently runs on a single GPU.
For Kumo Tabular, approximate peak GPU memory as:
As a rough reference, about 100 million cells can fit on a single H100. Actual capacity depends on input shape and memory overhead.
For Kumo Relational, memory use also depends on the related-table context. There is no equivalent sizing formula available; measure peak memory with representative data to determine what fits.
The SDM client currently caps context at 10,000 rows for both models when sending context to an inference server. This client constraint is separate from model capacity. See the client limits documentation.