LOADING COMMUNITY DATA
How derpy is your AI today?
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · MODELS
Pick a model to see its score, time, tokens and API $ run by run, or add up to three to compare them on one chart. Up is worse on every chart.
+ adds a model to compare (up to 3).
Antigravity 1.5.10 · 14 runs · newest 2026-11-17 18:30 UTC →
| Model | This week | Week before | Votes | Most common reason | Avg time | Tokens in / out | Quota per run (5h · week) |
|---|---|---|---|---|---|---|---|
| Claude Fable 5.2 | 17.0 | — | 50 | Too slow · 15 | 99s | 358k / 9k | 1.50 · 0.14 pt |
| Claude Opus 5.5 | 16.2 | 17.9 | 71 | Too slow · 20 | 98s | 521k / 9k | 0.58 · 0.09 pt |
| Claude Sonnet 5.5 | 6.3 | 2.1 | 71 | Too slow · 7 | 63s | 304k / 6k | 0.38 · 0.04 pt |
| Model | This week | Week before | Votes | Most common reason | Avg time | Tokens in / out | Quota per run (5h · week) |
|---|---|---|---|---|---|---|---|
| GPT-6.1 Sol | 17.6 | 12.9 | 71 | Too slow · 18 | 76s | 248k / 3k | 1.35 · 0.21 pt |
CLI changes: 1.5.1 from 11-05 18h, 1.5.2 from 11-06 18h, 1.5.3 from 11-08 18h, 1.5.4 from 11-10 18h, 1.5.5 from 11-11 18h, 1.5.8 from 11-13 18h, 1.5.9 from 11-15 18h, 1.5.10 from 11-17 18h.
Larder
larder-fefolarder-i18nlarder-roleslarder-saleslarder-sitesPython-Markdown
pymd-heading-offsetpymd-slugPantry
toon-episode-copytoon-failed-chargestoon-image-fetch| Run (UTC) | Score | S / M / D | Time per chore | Output / reasoning per chore | CLI |
|---|---|---|---|---|---|
| 2026-11-17 18:30 UTC | 63.6 | 2 / 4 / 5 | 751s | 80k / 53k | 1.5.10 (new) |
| 2026-11-16 18:30 UTC | 81.3 | 0 / 3 / 5 | 483s · 1 overlapped | 24k / 17k | 1.5.9 |
| 2026-11-15 18:30 UTC | 62.5 | 1 / 4 / 3 | 332s | 17k / 9.0k | 1.5.9 (new) |
| 2026-11-14 18:30 UTC | 62.5 | 1 / 4 / 3 | 530s · 2 overlapped | 26k / 17k | 1.5.8 |
| 2026-11-13 18:30 UTC | 75.0 | 1 / 2 / 5 | 564s · 2 overlapped | 29k / 22k | 1.5.8 (new) |
| 2026-11-12 18:30 UTC | 62.5 | 1 / 4 / 3 | 542s · 2 overlapped | 32k / 23k | 1.5.5 |
| 2026-11-11 18:30 UTC | 68.8 | 0 / 5 / 3 | 449s · 1 overlapped | 23k / 15k | 1.5.5 (new) |
| 2026-11-10 18:30 UTC | 75.0 | 0 / 4 / 4 | 570s · 2 overlapped | 25k / 17k · 1 no record | 1.5.4 (new) |
| 2026-11-09 18:30 UTC | 81.3 | 0 / 3 / 5 | 557s · 2 overlapped | 29k / 21k | 1.5.3 |
| 2026-11-08 18:30 UTC | 75.0 | 0 / 4 / 4 | 562s · 2 overlapped | 35k / 26k | 1.5.3 (new) |
| 2026-11-07 18:30 UTC | 75.0 | 1 / 2 / 5 | 458s · 1 overlapped | 24k / 18k | 1.5.2 |
| 2026-11-06 18:30 UTC | 81.3 | 0 / 3 / 5 | 586s · 2 overlapped | 33k / 25k | 1.5.2 (new) |
| 2026-11-05 18:30 UTC | 56.3 | 2 / 3 / 3 | 390s | 23k / 15k | 1.5.1 (new) |
| 2026-11-04 18:30 UTC | 75.0 | 0 / 4 / 4 | 565s · 5 overlapped | 40k / 31k | 1.5.0 |
| GPT-6.1 Terra | 12.7 | 9.3 | 71 | Too slow · 8 | 64s | 241k / 3k | 0.83 · 0.13 pt |
|---|
| Model | This week | Week before | Votes | Most common reason | Avg time | Tokens in / out | Quota per run (5h · week) |
|---|---|---|---|---|---|---|---|
| Gemini 4 Carbon (high) | 79.7 | — | 59 | Repeated mistake · 35 | 555s | 147k / 30k | 1.06 · 0.40 pt |
| Gemini 4 Argon (high) | 64.8 | 67.9 | 71 | Too slow · 36 | 451s | 136k / 29k | 1.14 · 0.62 pt |
| Gemini 4 Hydrogen (high) | 29.8 | — | 47 (+1 skipped) | Too slow · 17 | 167s | 62k / 14k | 0.39 · 0.20 pt |
pymd-tasklist