LOADING COMMUNITY DATA
How derpy is your AI today?
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · COMPARE
Pick a base run and a run to compare with it. Each model's change counts only the chores both runs can be compared on: same grader, same project and prompt. Lower is better.
40 chore votes are left out of the change: missing or skipped in one run, or scored on other inputs.
| Model | Base | Compared | Change | Chores changed |
|---|---|---|---|---|
| Claude Opus 5.5 | 10.0 | 0.0 | no change over 2 chores | none |
| Claude Sonnet 5.5 | 5.0 | 0.0 | no change over 2 chores | none |
| GPT-6.1 Sol | 5.0 | 0.0 | no change over 2 chores | none |
| GPT-6.1 Terra | 5.0 | 0.0 | no change over 2 chores |
| none |
| Gemini 4 Argon (medium) | 55.0 | 83.3 | ▲ +25.0 dumber over 2 chores | 1 dumber |
|---|
| Chore | Opus 5.5 | Sonnet 5.5 | GPT-6.1 Sol | GPT-6.1 Terra | Gemini 4 Argon |
|---|---|---|---|---|---|
| Pantry | |||||
| impossible-test | S· | S· | S· | S· | M· |
| trap-missing-file | S· | S· | S· | S· | S· |
| Larder | |||||
| larder-fefo | S· | S· | S· | S· | M· |
| larder-i18n | S· | S· | S· | S· | M |
| Python-Markdown | |||||
| pymd-heading-offset | SS | SS | SS | SS | DD |
| pymd-slug | SS | SS | |||
Pantry
Claude Code
Codex
Antigravityimpossible-testtrap-missing-file| larder-roles | M· | S· | S· | S· | D· |
|---|
| larder-sales | S· | S· | M· | M· | D· |
|---|
| larder-sites | M· | M· | S· | S· | M· |
|---|
| SS |
| SM |
| pymd-tasklist | SS | SS | SS | SS | MD |
|---|
Larder
larder-fefolarder-i18nlarder-roleslarder-saleslarder-sitesPython-Markdown
pymd-heading-offsetpymd-slugpymd-tasklist