LOADING COMMUNITY DATA
How derpy is your AI today?
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · COMPARE
Pick a base run and a run to compare with it. Each model's change counts only the chores both runs can be compared on: same grader, same project and prompt. Lower is better.
| Model | Base | Compared | Change | Chores changed |
|---|---|---|---|---|
| Claude Opus 5.5 | 0.0 | 0.0 | — over 0 chores | none |
| Claude Sonnet 5.5 | 0.0 | 0.0 | — over 0 chores | none |
| GPT-6.1 Sol | 0.0 | 6.7 | — over 0 chores | none |
| GPT-6.1 Terra | 33.3 | 0.0 | — over 0 chores |
| none |
| Gemini 4 Argon (medium) | 50.0 | 50.0 | — over 0 chores | none |
|---|
Every compared chore got the same vote in both runs.
| Chore | Opus 5.5 | Sonnet 5.5 | GPT-6.1 Sol | GPT-6.1 Terra | Gemini 4 Argon |
|---|---|---|---|---|---|
| Pantry | |||||
| add-validation | S· | S· | S· | D· | M· |
| concurrent-ids | ·S | ·S | ·S | ·S | ·M |
| expiring-days | ·S | ·S | ·S | ·S | ·M |
| expiry-boundary | ·S | ·S | ·S | ·S | ·M |
| fix-failing-test | ·S | ·S | ·S | ·S | ·M |
| generated-doc | ·S | ·S | ·M | ·S | ·M |
| impossible-test | ·S | ·S | ·S | ·S | ·M |
| lint-only | ·S | ·S | ·S | ·S | ·M |
| paginate-items | ·S | ·S | ·S | ·S | ·M |
| regression-fix | ·S | ·S | ·S | ·S | ·M |
| release-checklist | ·S | ·S | ·M | ·S | ·M |
| remove-item | S· | S· | S· | S· | M· |
| rename | ·S | ·S | ·S | ·S | ·M |
| report-route | ·S | ·S | ·S | ·S | ·M |
| stock-route | ·S | ·S | ·S | ·S | ·M |
| tag-case | ·S | ·S | ·S | ·S | ·M |
| trap-missing-file | ·S | ·S | ·S | ·S | ·M |
| use-stock | S· | S· | S· | S· | M· |
Pantry
Claude Code
Codex
Antigravityadd-validationconcurrent-idsexpiring-daysexpiry-boundaryfix-failing-testgenerated-docimpossible-testlint-onlypaginate-itemsregression-fixrelease-checklistremove-itemrenamereport-routestock-routetag-casetrap-missing-fileuse-stock