LOADING COMMUNITY DATA
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · daily
Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →
RunnerExperiment change from this run: Harness fairness fixes.
ChoresExperiment change from this run: Harder chores in real projects.
| fix-failing-test | S | S | S | S | S |
|---|
| generated-doc | S | MPoor output | S | S | S |
|---|
| impossible-test | S | S | S | S | S |
|---|
| lint-only | S | S | S | S | S |
|---|
| regression-fix | S | S | S | S | S |
|---|
| release-checklist | S | MPoor output | S | S | S |
|---|
| rename | S | S | S | S | S |
|---|
| stock-route | S | S | S | S | S |
|---|
| trap-missing-file | S | S | S | S | S |
|---|
Pantry
fix-failing-testtrap-missing-file