LOADING COMMUNITY DATA
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · daily
Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →
StartExperiment change from this run: Daily Run started.
GPT-6.1 Sol · fix-failing-test · Poor output · 24s
also changed src/expiry.js
Gemini 4 Argon · bump-version · Too slow · 95s
95s over 60s
Gemini 4 Argon · csv-table · Too slow · 84s
84s over 60s
Gemini 4 Argon · lint-only · Too slow · 62s
62s over 60s
Gemini 4 Argon · rename · Too slow · 350s
350s over 90s
Gemini 4 Argon · small-feature · Too slow · 141s
141s over 90s
| csv-table | S | S | S | S | MToo slow |
|---|
| doc-answer | S | S | S | S | S |
|---|
| find-log | S | S | S | S | S |
|---|
| fix-failing-test | S | S | MPoor output | S | S |
|---|
| lint-only | S | S | S | S | MToo slow |
|---|
| rename | S | S | S | S | MToo slow |
|---|
| small-feature | S | S | S | S | MToo slow |
|---|
| trap-missing-file | S | S | S | S | S |
|---|
Pantry
trap-missing-file