Building KVBench
KVBench requires Python 3.12 or later. For GPU-accelerated benchmarks, PyTorch is also required.
Installation
Docker
Python venv
KVBench is included in the NIXLBench Docker container. See Building NIXLBench for Docker build and setup instructions.
After building the container, KVBench is available at /workspace/benchmark/kvbench/ inside the container.