LOADING COMMUNITY DATA
How derpy is your AI today?
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · MODELS
One card per model: its score, time and tokens in every daily run on today's chores, with a dashed line where its CLI version changed. Hover a chart (or focus it and use the arrow keys) for each run's numbers. Up is worse on every chart. Lower score is smarter.
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 25.0 | 5 / 5 / 0 | 91s · 5 overlapped | 8.1k / 2.5k | 2.1.323 |
| Model | This week | Week before | Votes | Most common reason | Avg time | Tokens in / out | Quota per run (5h · week) |
|---|---|---|---|---|---|---|---|
| Claude Fable 5.2 | 25.0 | — | 10 | Too slow · 5 | 91s | 229k / 8k | 1.00 · 0.20 pt |
| Claude Opus 5.5 | 18.3 | 18.6 | 60 | Too slow · 20 | 93s | 398k / 8k | 0.58 · 0.06 pt |
| Claude Sonnet 5.5 | 6.7 | 1.4 | 60 | Too slow · 6 | 62s | 250k / 5k | 0.41 · 0.00 pt |
| Model | This week | Week before | Votes | Most common reason | Avg time | Tokens in / out | Quota per run (5h · week) |
|---|---|---|---|---|---|---|---|
| GPT-6.1 Sol | 17.5 | 9.3 | 60 | Too slow · 15 | 67s | 158k / 2k | 1.20 · 0.20 pt |
Larder
Claude Code
Codex
Antigravitylarder-fefolarder-i18nlarder-roleslarder-saleslarder-sitesPython-Markdown
pymd-heading-offsetpymd-slugpymd-tasklistCLI changes (dashed lines): 2.1.317 from 11-03 18h, 2.1.318 from 11-04 18h, 2.1.319 from 11-06 18h, 2.1.322 from 11-10 18h, 2.1.323 from 11-13 18h.
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 25.0 | 5 / 5 / 0 | 97s · 6 overlapped | 8.0k / 1.7k | 2.1.323 (new) |
| 2026-11-12 18:30 UTC | 20.0 | 6 / 4 / 0 | 89s · 6 overlapped | 7.9k / 2.0k | 2.1.322 |
| 2026-11-11 18:30 UTC | 20.0 | 6 / 4 / 0 | 96s · 4 overlapped | 7.9k / 2.0k | 2.1.322 |
| 2026-11-10 18:30 UTC | 15.0 | 7 / 3 / 0 | 89s · 3 overlapped | 7.3k / 1.9k | 2.1.322 (new) |
| 2026-11-09 18:30 UTC | 15.0 | 7 / 3 / 0 | 87s · 2 overlapped | 7.3k / 1.5k | 2.1.319 |
| 2026-11-08 18:30 UTC | 15.0 | 7 / 3 / 0 | 98s · 3 overlapped | 7.9k / 2.1k | 2.1.319 |
| 2026-11-07 18:30 UTC | 20.0 | 6 / 4 / 0 | 96s · 6 overlapped | 7.7k / 1.8k | 2.1.319 |
| 2026-11-06 18:30 UTC | 25.0 | 5 / 5 / 0 | 108s · 2 overlapped | 7.8k / 1.8k | 2.1.319 (new) |
| 2026-11-05 18:30 UTC | 15.0 | 7 / 3 / 0 | 96s · 2 overlapped | 8.0k / 2.0k | 2.1.318 |
| 2026-11-04 18:30 UTC | 20.0 | 6 / 4 / 0 | 84s · 1 overlapped | 7.9k / 1.7k | 2.1.318 (new) |
| 2026-11-03 18:30 UTC | 15.0 | 7 / 3 / 0 | 72s · 3 overlapped | 7.4k / 1.8k | 2.1.317 (new) |
| 2026-11-02 18:30 UTC | 10.0 | 8 / 2 / 0 | 79s · 5 overlapped | 7.9k / 2.1k | 2.1.316 |
| 2026-11-01 18:30 UTC | 25.0 | 5 / 5 / 0 | 133s · 6 overlapped | 14k / 6.1k | 2.1.316 |
CLI changes (dashed lines): 2.1.317 from 11-03 18h, 2.1.318 from 11-04 18h, 2.1.319 from 11-06 18h, 2.1.322 from 11-10 18h, 2.1.323 from 11-13 18h.
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 20.0 | 6 / 4 / 0 | 72s · 2 overlapped | 5.4k / 1.0k | 2.1.323 (new) |
| 2026-11-12 18:30 UTC | 5.0 | 9 / 1 / 0 | 66s · 8 overlapped | 4.9k / 999 | 2.1.322 |
| 2026-11-11 18:30 UTC | 5.0 | 9 / 1 / 0 | 60s | 4.6k / 780 | 2.1.322 |
| 2026-11-10 18:30 UTC | 5.0 | 9 / 1 / 0 | 59s | 4.6k / 848 | 2.1.322 (new) |
| 2026-11-09 18:30 UTC | 0.0 | 10 / 0 / 0 | 62s | 4.9k / 965 | 2.1.319 |
| 2026-11-08 18:30 UTC | 5.0 | 9 / 1 / 0 | 51s | 5.0k / 1.1k | 2.1.319 |
| 2026-11-07 18:30 UTC | 0.0 | 10 / 0 / 0 | 57s | 5.0k / 1.0k | 2.1.319 |
| 2026-11-06 18:30 UTC | 5.0 | 9 / 1 / 0 | 57s · 1 overlapped | 4.9k / 851 | 2.1.319 (new) |
| 2026-11-05 18:30 UTC | 0.0 | 10 / 0 / 0 | 55s | 5.0k / 917 | 2.1.318 |
| 2026-11-04 18:30 UTC | 0.0 | 10 / 0 / 0 | 53s | 5.5k / 948 | 2.1.318 (new) |
| 2026-11-03 18:30 UTC | 0.0 | 10 / 0 / 0 | 48s · 1 overlapped | 5.2k / 996 | 2.1.317 (new) |
| 2026-11-02 18:30 UTC | 5.0 | 9 / 1 / 0 | 49s · 2 overlapped | 4.8k / 932 | 2.1.316 |
| 2026-11-01 18:30 UTC | 0.0 | 10 / 0 / 0 | 40s | 4.7k / 919 | 2.1.316 |
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 25.0 | 5 / 5 / 0 | 73s | 2.2k / 98 | 0.163.0 |
| 2026-11-12 18:30 UTC | 15.0 | 7 / 3 / 0 | 70s | 2.3k / 91 | 0.163.0 |
| 2026-11-11 18:30 UTC | 20.0 | 6 / 4 / 0 | 67s | 2.2k / 83 | 0.163.0 |
| 2026-11-10 18:30 UTC | 20.0 | 6 / 4 / 0 | 67s | 2.1k / 61 | 0.163.0 |
| 2026-11-09 18:30 UTC | 10.0 | 8 / 2 / 0 | 66s | 2.2k / 78 | 0.163.0 |
| 2026-11-08 18:30 UTC | 15.0 | 7 / 3 / 0 | 62s | 2.2k / 60 | 0.163.0 |
| 2026-11-07 18:30 UTC | 10.0 | 8 / 2 / 0 | 65s | 2.2k / 52 | 0.163.0 |
| 2026-11-06 18:30 UTC | 15.0 | 7 / 3 / 0 | 68s | 2.3k / 91 | 0.163.0 |
| 2026-11-05 18:30 UTC | 10.0 | 8 / 2 / 0 | 61s | 2.1k / 63 | 0.163.0 |
| 2026-11-04 18:30 UTC | 10.0 | 8 / 2 / 0 | 62s | 2.3k / 90 | 0.163.0 |
| 2026-11-03 18:30 UTC | 10.0 | 8 / 2 / 0 | 47s | 2.2k / 72 | 0.163.0 |
| 2026-11-02 18:30 UTC | 5.0 | 9 / 1 / 0 | 48s | 2.3k / 57 | 0.163.0 |
| 2026-11-01 18:30 UTC | 5.0 | 9 / 1 / 0 | 45s | 2.3k / 59 | 0.163.0 |
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 15.0 | 7 / 3 / 0 | 68s | 2.3k / 73 | 0.163.0 |
| 2026-11-12 18:30 UTC | 15.0 | 7 / 3 / 0 | 56s | 2.0k / 76 | 0.163.0 |
| 2026-11-11 18:30 UTC | 15.0 | 7 / 3 / 0 | 54s | 1.9k / 86 | 0.163.0 |
| 2026-11-10 18:30 UTC | 15.0 | 7 / 3 / 0 | 62s | 2.1k / 67 | 0.163.0 |
| 2026-11-09 18:30 UTC | 5.0 | 9 / 1 / 0 | 56s | 1.9k / 76 | 0.163.0 |
| 2026-11-08 18:30 UTC | 5.0 | 9 / 1 / 0 | 55s | 2.1k / 70 | 0.163.0 |
| 2026-11-07 18:30 UTC | 10.0 | 8 / 2 / 0 | 55s | 2.1k / 69 | 0.163.0 |
| 2026-11-06 18:30 UTC | 10.0 | 8 / 2 / 0 | 63s | 2.1k / 84 | 0.163.0 |
| 2026-11-05 18:30 UTC | 10.0 | 8 / 2 / 0 | 56s | 2.1k / 114 | 0.163.0 |
| 2026-11-04 18:30 UTC | 10.0 | 8 / 2 / 0 | 51s | 2.1k / 63 | 0.163.0 |
| 2026-11-03 18:30 UTC | 5.0 | 9 / 1 / 0 | 28s | 2.0k / 106 | 0.163.0 |
| 2026-11-02 18:30 UTC | 5.0 | 9 / 1 / 0 | 34s | 2.1k / 62 | 0.163.0 |
| 2026-11-01 18:30 UTC | 5.0 | 9 / 1 / 0 | 25s | 1.9k / 94 | 0.163.0 |
CLI changes (dashed lines): 1.5.8 from 11-13 18h.
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 80.0 | 0 / 4 / 6 | 518s · 2 overlapped | 24k / 18k | 1.5.8 (new) |
| 2026-11-12 18:30 UTC | 75.0 | 0 / 5 / 5 | 490s · 2 overlapped | 27k / 20k | 1.5.5 |
CLI changes (dashed lines): 1.5.0 from 11-04 18h, 1.5.1 from 11-05 18h, 1.5.2 from 11-06 18h, 1.5.3 from 11-08 18h, 1.5.4 from 11-10 18h, 1.5.5 from 11-11 18h, 1.5.8 from 11-13 18h.
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 70.0 | 1 / 4 / 5 | 462s · 2 overlapped | 23k / 17k | 1.5.8 (new) |
| 2026-11-12 18:30 UTC | 60.0 | 1 / 6 / 3 | 440s · 2 overlapped | 25k / 18k | 1.5.5 |
| 2026-11-11 18:30 UTC | 65.0 | 0 / 7 / 3 | 366s · 1 overlapped | 18k / 12k | 1.5.5 (new) |
| 2026-11-10 18:30 UTC | 70.0 | 0 / 6 / 4 | 464s · 2 overlapped | 19k / 14k · 1 no record | 1.5.4 (new) |
| 2026-11-09 18:30 UTC | 75.0 | 0 / 5 / 5 | 452s · 2 overlapped | 24k / 17k | 1.5.3 |
| 2026-11-08 18:30 UTC | 70.0 | 0 / 6 / 4 | 460s · 2 overlapped | 28k / 21k | 1.5.3 (new) |
| 2026-11-07 18:30 UTC | 70.0 | 1 / 4 / 5 | 373s · 1 overlapped | 20k / 14k | 1.5.2 |
| 2026-11-06 18:30 UTC | 75.0 | 0 / 5 / 5 | 478s · 2 overlapped | 26k / 20k | 1.5.2 (new) |
| 2026-11-05 18:30 UTC | 55.0 | 2 / 5 / 3 | 319s | 18k / 12k | 1.5.1 (new) |
| 2026-11-04 18:30 UTC | 60.0 | 2 / 4 / 4 | 456s · 5 overlapped | 32k / 25k | 1.5.0 (new) |
| 2026-11-03 18:30 UTC | 60.0 | 2 / 4 / 4 | 444s · 6 overlapped | 30k / 23k | 1.4.12 |
| 2026-11-02 18:30 UTC | 55.0 | 2 / 5 / 3 | 433s · 5 overlapped | 20k / 13k · 3 no record | 1.4.12 |
| 2026-11-01 18:30 UTC | 60.0 | 1 / 6 / 3 | 349s · 6 overlapped | 12k / 6.1k · 3 no record | 1.4.12 |
CLI changes (dashed lines): 1.5.8 from 11-13 18h.
| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC | 25.0 | 5 / 5 / 0 | 134s | 13k / 7.0k | 1.5.8 (new) |
| 2026-11-12 18:30 UTC | 25.0 | 5 / 5 / 0 | 120s | 13k / 7.1k | 1.5.7 |
| GPT-6.1 Terra | 11.7 | 7.9 | 60 | Poor output · 7 | 59s | 177k / 2k | 0.75 · 0.10 pt |
|---|
| Model | This week | Week before | Votes | Most common reason | Avg time | Tokens in / out | Quota per run (5h · week) |
|---|---|---|---|---|---|---|---|
| Gemini 4 Carbon (medium) | 77.5 | — | 20 | Repeated mistake · 11 | 504s | 141k / 26k | 0.83 · 0.36 pt |
| Gemini 4 Argon (medium) | 68.3 | 62.1 | 60 | Too slow · 33 | 441s | 107k / 23k | 0.80 · 0.48 pt |
| Gemini 4 Hydrogen (medium) | 25.0 | — | 20 | Too slow · 7 | 127s | 59k / 13k | 0.32 · 0.14 pt |
larder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-saleslarder-siteslarder-roleslarder-saleslarder-sitespymd-tasklistlarder-saleslarder-sites