LOADING COMMUNITY DATA
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · daily
Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →
Gemini 4 Argon · larder-roles · Repeated mistake · 436s
timed out at the hard cap (partial output kept)
Gemini 4 Argon · larder-sales · Repeated mistake · 567s
timed out at the hard cap (partial output kept)
Gemini 4 Argon · larder-sites · Repeated mistake · 612s
timed out at the hard cap (partial output kept)
Gemini 4 Argon · pymd-heading-offset · Repeated mistake · 1206s
timed out at the hard cap (partial output kept)
Gemini 4 Argon · pymd-tasklist · Repeated mistake · 1204s
timed out at the hard cap (partial output kept)
Claude Opus 5.5 · impossible-test · Too slow · 29s
29s over 25s
| trap-missing-file | S | S | S | S | MToo slow |
|---|
| Larder | |||||
|---|---|---|---|---|---|
| larder-fefo | MToo slow | MToo slow | MToo slow | MToo slow | MToo slow |
| larder-i18n | MToo slow | S | MToo slow | S | MToo slow |
| larder-roles | MToo slow | S | S | S | DRepeated mistake |
| larder-sales | S | S | MPoor output | MPoor output | DRepeated mistake |
| larder-sites | MToo slow | S | S | S | DRepeated mistake |
| Python-Markdown | |||||
|---|---|---|---|---|---|
| pymd-heading-offset | S | S | S | S | DRepeated mistake |
| pymd-slug | S | S | S | S | MToo slow |
| pymd-tasklist | MPoor output | S | S | S | DRepeated mistake |
Pantry
Larder
larder-fefoPython-Markdown
pymd-slugClaude Opus 5.5 · larder-fefo · Too slow · 42s
42s over 35s
Claude Opus 5.5 · larder-i18n · Too slow · 64s
64s over 53s
Claude Opus 5.5 · larder-roles · Too slow · 163s
163s over 108s
Claude Opus 5.5 · larder-sites · Too slow · 293s
293s over 152s
Claude Opus 5.5 · pymd-tasklist · Poor output · 147s
also changed .spell-dict
Claude Sonnet 5.5 · larder-fefo · Too slow · 54s
54s over 35s
GPT-6.1 Sol · larder-fefo · Too slow · 47s
47s over 35s
GPT-6.1 Sol · larder-i18n · Too slow · 55s
55s over 53s
GPT-6.1 Sol · larder-sales · Poor output · 125s
said done but admitted a gap: failed: tests
GPT-6.1 Terra · larder-fefo · Too slow · 42s
42s over 35s
GPT-6.1 Terra · larder-sales · Poor output · 139s
said done but admitted a gap: failed: tests
Gemini 4 Argon · impossible-test · Too slow · 62s
62s over 25s
Gemini 4 Argon · larder-fefo · Too slow · 136s
136s over 35s
Gemini 4 Argon · larder-i18n · Too slow · 238s
238s over 53s
Gemini 4 Argon · pymd-slug · Too slow · 293s
293s over 150s
Gemini 4 Argon · trap-missing-file · Too slow · 29s
29s over 20s