Prompt corpus selection

View as Markdown

AIPerf synthesizes prompt text from a named corpus when the dataset does not already carry verbatim content. Author the corpus as prompts.corpus in YAML or pass --prompt-corpus on the CLI.

Values

ValueContent
sonnetShakespeare sonnets (default for synthetic and most loaders)
codingProcedural coding / tool-use content

When it applies

Honored only where content is synthesized:

  • synthetic datasets
  • count / hash-id trace loaders (e.g. mooncake_trace, bailian_trace, weka_trace)
  • public trace datasets that reconstruct from hash ids (e.g. SemiAnalysis weka HF)

Verbatim formats (single_turn, multi_turn, baseten_trace, …) ignore it.

Defaults

When omitted, the active loader’s default_prompt_corpus from the plugin registry applies. Agentic coding loaders such as weka_trace default to coding; most others default to sonnet. Synthetic with no authored corpus uses sonnet.

YAML shape

1datasets:
2 - type: synthetic
3 prompts:
4 isl: 128
5 corpus: coding
6
7 - type: file
8 format: weka_trace
9 path: ./traces/
10 prompts:
11 corpus: coding

Prefix prompts

coding uses the same synthetic prefix / shared-system / user-context surface as sonnet: those features sample from the selected corpus rather than requiring a separate generator type.