Claude Code
Codex
Antigravity0.0Smart
LOADING COMMUNITY DATA
How derpy is your AI today?
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · tuning
Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →
Percent points of each plan's 5-hour and weekly windows. A model counts only chores measured while no other session of that CLI was working; the run total is first reading to last, on the owner's own accounts. Claude Code and Codex report whole percents.
Claude CodeMax
| Model | 5-hour | Weekly | Measured |
|---|---|---|---|
| Claude Opus 5.5 | +3.0%p | +1.0%p | 15/15 |
| Claude Sonnet 5.5 | +2.0%p | +0.0%p | 15/15 |
| Whole run | +5.0%p | +1.0%p | |
| Used after the run | 7% | 81% |
OpenAI CodexPlus
| Model | 5-hour | Weekly | Measured |
|---|---|---|---|
| GPT-6.1 Sol | +9.0%p | +2.0%p | 15/15 |
| GPT-6.1 Terra | +4.0%p | +0.0%p | 15/15 |
| Whole run | +13.0%p | +2.0%p | |
| Used after the run | 54% | 38% |
AntigravityPlan not reported
| Model | 5-hour | Weekly | Measured |
|---|---|---|---|
| Gemini 4 Argonmedium | +3.4%p |
Tokens each chore used in this run, as each CLI reports them. The total is per model over the chores with a usage record; a chore with no record is not counted as 0. Hover a cell for cache, reasoning and its API price. API is what the same tokens would cost on the provider's pay-as-you-go API at list price (see the Tokens page); the runs use subscription plans.
Input is the whole prompt, cache reads and writes included.
| Chore | Claude Opus 5.5 | Claude Sonnet 5.5 |
|---|---|---|
| concurrent-ids | 123k / 1.8k | 123k / 1.8k |
| expiring-days | 105k / 2.6k | 97k / 1.5k |
| expiry-boundary | 145k / 1.8k | 95k / 1.6k |
| fix-failing-test | 121k / 1.4k | 119k / 871 |
GPT-6.1 Sol · generated-doc · Too slow · 27s
27s over 21s
GPT-6.1 Sol · release-checklist · Too slow · 37s
37s over 30s
Gemini 4 Argon · concurrent-ids · Too slow · 72s
72s over 40s
Gemini 4 Argon · expiring-days · Too slow · 256s
256s over 39s
Gemini 4 Argon · expiry-boundary · Too slow · 117s
117s over 33s
Gemini 4 Argon · fix-failing-test · Too slow · 47s
47s over 26s
| +1.1%p |
| 11/15 |
| Whole run | +3.2%p | +0.9%p | |
|---|---|---|---|
| Used after the run | 11% | 4% |
| expiring-days | S | S | S | S | MToo slow |
|---|
| expiry-boundary | S | S | S | S | MToo slow |
|---|
| fix-failing-test | S | S | S | S | MToo slow |
|---|
| generated-doc | S | S | MToo slow | S | MToo slow |
|---|
| impossible-test | S | S | S | S | MToo slow |
|---|
| lint-only | S | S | S | S | MToo slow |
|---|
| paginate-items | S | S | S | S | MToo slow |
|---|
| regression-fix | S | S | S | S | MToo slow |
|---|
| release-checklist | S | S | MToo slow | S | MToo slow |
|---|
| rename | S | S | S | S | MToo slow |
|---|
| report-route | S | S | S | S | MToo slow |
|---|
| stock-route | S | S | S | S | MToo slow |
|---|
| tag-case | S | S | S | S | MToo slow |
|---|
| trap-missing-file | S | S | S | S | MToo slow |
|---|
Pantry
| generated-doc |
|---|
| 70k / 652 |
| 69k / 495 |
| impossible-test | 71k / 899 | 70k / 534 |
|---|
| lint-only | 141k / 1.2k | 92k / 674 |
|---|
| paginate-items | 133k / 2.0k | 74k / 1.2k |
|---|
| regression-fix | 178k / 2.0k | 96k / 1.5k |
|---|
| release-checklist | 102k / 1.1k | 74k / 876 |
|---|
| rename | 124k / 1.4k | 150k / 2.4k |
|---|
| report-route | 101k / 1.8k | 97k / 1.5k |
|---|
| stock-route | 156k / 3.2k | 72k / 1.7k |
|---|
| tag-case | 95k / 1.2k | 94k / 956 |
|---|
| trap-missing-file | 69k / 383 | 69k / 394 |
|---|
| Total (this model) | 1.73M / 23k API $1.75 15 of 15 chores recorded | 1.39M / 18k API $0.744 15 of 15 chores recorded |
|---|
Input is the whole prompt, cache reads included.
| Chore | GPT-6.1 Sol | GPT-6.1 Terra |
|---|---|---|
| concurrent-ids | 85k / 974 | 107k / 986 |
| expiring-days | 89k / 1.5k | 87k / 1.2k |
| expiry-boundary | 69k / 762 | 86k / 727 |
| fix-failing-test | 69k / 449 | 103k / 464 |
| generated-doc | 86k / 541 | 50k / 439 |
| impossible-test | 71k / 352 | 86k / 374 |
| lint-only | 67k / 344 | 66k / 278 |
| paginate-items | 89k / 1.3k | 88k / 1.1k |
| regression-fix | 107k / 764 | 140k / 939 |
| release-checklist | 90k / 556 | 83k / 572 |
| rename | 71k / 781 | 89k / 758 |
| report-route | 87k / 1.4k | 90k / 1.3k |
| stock-route | 88k / 1.2k | 89k / 1.2k |
| tag-case | 69k / 676 | 85k / 501 |
| trap-missing-file | 49k / 149 | 49k / 285 |
| Total (this model) | 1.19M / 12k API $0.748 15 of 15 chores recorded | 1.30M / 11k API $0.253 15 of 15 chores recorded |
Input leaves cache reads out (they are counted on their own), so it reads lower than the other CLIs' input.
| Chore | Gemini 4 Argon (medium) |
|---|---|
| concurrent-ids | 26k / 1.7k |
| expiring-days | 44k / 14k |
| expiry-boundary | 34k / 6.8k |
| fix-failing-test | 20k / 989 |
| generated-doc | 30k / 1.1k |
| impossible-test | 21k / 1.1k |
| lint-only | 18k / 424 |
| paginate-items | 34k / 5.3k |
| regression-fix | 21k / 2.4k |
| release-checklist | 20k / 1.7k |
| rename | 29k / 5.8k |
| report-route | 39k / 7.9k |
| stock-route | 23k / 4.5k |
| tag-case | 34k / 1.8k |
| trap-missing-file | 13k / 348 |
| Total (this model) | 407k / 56k API $1.47 15 of 15 chores recorded |
Gemini 4 Argon · generated-doc · Too slow · 89s
89s over 21s
Gemini 4 Argon · impossible-test · Too slow · 29s
29s over 25s
Gemini 4 Argon · lint-only · Too slow · 33s
33s over 26s
Gemini 4 Argon · paginate-items · Too slow · 132s
132s over 37s
Gemini 4 Argon · regression-fix · Too slow · 83s
83s over 32s
Gemini 4 Argon · release-checklist · Too slow · 68s
68s over 30s
Gemini 4 Argon · rename · Too slow · 114s
114s over 32s
Gemini 4 Argon · report-route · Too slow · 143s
143s over 45s
Gemini 4 Argon · stock-route · Too slow · 86s
86s over 37s
Gemini 4 Argon · tag-case · Too slow · 115s
115s over 30s
Gemini 4 Argon · trap-missing-file · Too slow · 28s
28s over 20s