Results
Download resultsModels
| Model | Performance | Beat baseline | Correct | ADP gain | Reasoning | Attempts |
|---|---|---|---|---|---|---|
Scroll for all metrics →
Beat-baseline rate across all recorded attempts.
Operators
Scroll for all operators →
Metric definitions & evaluation notes
Beat baseline: correct attempts with lower cells × cycles than the baseline, divided by all attempts. Correctness: correct attempts divided by all attempts.
ADP = cells × cycles. ADP gain is the geometric mean of baseline ADP / design ADP across correct runs only. Operator bars are relative to the best correct result.
Reasoning: the share of a model's generated characters that were reasoning rather than answer text or tool-call arguments, measured from its saved responses. "Asked" is the reasoning setting the harness requested; providers do not always honor it.