LOADING COMMUNITY DATA
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · RUNS
Each run's votes and each model's score, with the change from that model's previous run. A change counts only chores both runs can be compared on: same grader, same project and prompt. Lower is better.
▲ dumber, ▼ smarter than the model's previous run in this list. “2 changed” is how many chores got a different vote. Every score uses the current grader: past runs were scored again from their raw results; votes on older inputs keep their original score and are not compared.
| Run (UTC) | Votes | Claude Fable 5.2 | Claude Opus 5.5 | Claude Sonnet 5.5 | Claude Haiku 5.5 | GPT-6.1 Sol | GPT-6.1 Terra | Gemini 4 Carbon | Gemini 4 Argon | Gemini 4 Hydrogen | Links |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2026-11-13 18:30 UTC daily | 25.0 first run | 25.0 ▲ +5.01 of 10 changed | 20.0 ▲ +15.03 of 10 changed | — | 25.0 ▲ +10.02 of 10 changed | 15.0 =2 of 10 changed | 80.0 ▲ +5.03 of 10 changed | 70.0 ▲ +10.02 of 10 changed | 25.0 =same on all 10 | vs previous →raw | |
| 2026-11-12 18:30 UTC daily |
The chores of the newest run (2026-11-13 18:30 UTC) over the last 14 runs, oldest on the left; times are UTC. Open a column for that run.
| — |
| 20.0 =same on all 10 |
| 5.0 =2 of 10 changed |
| — |
| 15.0 ▼ -5.01 of 10 changed |
| 15.0 =2 of 10 changed |
| 75.0 first run |
| 60.0 ▼ -5.03 of 10 changed |
| 25.0 first run |
| vs previous →raw |
| 2026-11-11 18:30 UTC daily | — | 20.0 ▲ +5.03 of 10 changed | 5.0 =2 of 10 changed | — | 20.0 =same on all 10 | 15.0 =2 of 10 changed | — | 65.0 ▼ -5.01 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-10 18:30 UTC daily | — | 15.0 =same on all 10 | 5.0 ▲ +5.01 of 10 changed | — | 20.0 ▲ +10.02 of 10 changed | 15.0 ▲ +10.02 of 10 changed | — | 70.0 ▼ -5.01 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-09 18:30 UTC daily | — | 15.0 =same on all 10 | 0.0 ▼ -5.01 of 10 changed | — | 10.0 ▼ -5.01 of 10 changed | 5.0 =same on all 10 | — | 75.0 ▲ +5.01 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-08 18:30 UTC daily50 regraded | — | 15.0 ▼ -5.03 of 10 changed | 5.0 ▲ +5.01 of 10 changed | — | 15.0 ▲ +5.01 of 10 changed | 5.0 ▼ -5.01 of 10 changed | — | 70.0 =3 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-07 18:30 UTC daily50 regraded | — | 20.0 ▼ -5.03 of 10 changed | 0.0 ▼ -5.01 of 10 changed | — | 10.0 ▼ -5.01 of 10 changed | 10.0 =same on all 10 | — | 70.0 ▼ -5.02 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-06 18:30 UTC daily50 regraded | — | 25.0 ▲ +10.04 of 10 changed | 5.0 ▲ +5.01 of 10 changed | — | 15.0 ▲ +5.01 of 10 changed | 10.0 =same on all 10 | — | 75.0 ▲ +20.03 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-05 18:30 UTC daily50 regraded | — | 15.0 ▼ -5.01 of 10 changed | 0.0 =same on all 10 | — | 10.0 =same on all 10 | 10.0 =same on all 10 | — | 55.0 ▼ -5.04 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-04 18:30 UTC daily50 regraded | — | 20.0 ▲ +5.01 of 10 changed | 0.0 =same on all 10 | — | 10.0 =same on all 10 | 10.0 ▲ +5.01 of 10 changed | — | 60.0 =4 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-03 18:30 UTC daily50 regraded | — | 15.0 ▲ +5.01 of 10 changed | 0.0 ▼ -5.01 of 10 changed | — | 10.0 ▲ +5.01 of 10 changed | 5.0 =same on all 10 | — | 60.0 ▲ +5.05 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-02 18:30 UTC daily50 regraded | — | 10.0 ▼ -15.03 of 10 changed | 5.0 ▲ +5.01 of 10 changed | — | 5.0 =same on all 10 | 5.0 =same on all 10 | — | 55.0 ▼ -5.04 of 10 changed | — | vs previous →raw |
|---|
| 2026-11-01 18:30 UTC daily50 regraded | — | 25.0 ▼ -5.01 of 10 changed | 0.0 =same on all 10 | — | 5.0 =same on all 10 | 5.0 =same on all 10 | — | 60.0 ▲ +5.04 of 10 changed | — | vs previous →raw |
|---|
| 2026-10-31 18:30 UTC daily50 regraded | — | 30.0 ▲ +5.01 of 10 changed | 0.0 ▼ -10.01 of 10 changed | — | 5.0 =same on all 10 | 5.0 ▼ -10.02 of 10 changed | — | 55.0 =2 of 10 changed | — | vs previous →raw |
|---|
| 2026-10-30 18:30 UTC daily50 regraded | — | 25.0 ▲ +10.02 of 10 changed | 10.0 ▲ +5.01 of 10 changed | — | 5.0 =same on all 10 | 15.0 ▲ +5.01 of 10 changed | — | 55.0 =2 of 10 changed | — | vs previous →raw |
|---|
| 2026-10-29 18:30 UTC daily50 regraded | — | 15.0 =same on all 10 | 5.0 ▲ +5.01 of 10 changed | — | 5.0 =same on all 10 | 10.0 ▲ +5.01 of 10 changed | — | 55.0 ▼ -15.03 of 10 changed | — | vs previous →raw |
|---|
| 2026-10-29 05:16 UTC daily50 regraded | — | 15.0 ▲ +5.01 of 10 changed | 0.0 ▼ -5.01 of 10 changed | — | 5.0 =same on all 10 | 5.0 =same on all 10 | — | 70.0 ▲ +15.03 of 10 changed | — | vs previous →raw |
|---|
| 2026-10-28 18:30 UTC daily50 regraded | — | 10.0 =same on all 2 | 5.0 =same on all 2 | — | 5.0 =same on all 2 | 5.0 =same on all 2 | — | 55.0 ▼ -25.01 of 2 changed | — | vs previous →raw |
|---|
| 2026-10-28 11:55 UTC tuning15 regraded | — | 0.0 not comparable | 0.0 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | 83.3 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 06:58 UTC tuning15 not comparable | — | 16.7 not comparable | 33.3 not comparable | — | 50.0 not comparable | 16.7 not comparable | — | 83.3 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 06:14 UTC tuning15 regraded | — | 50.0 not comparable | 0.0 not comparable | — | 16.7 not comparable | 16.7 not comparable | — | 83.3 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 05:09 UTC tuning25 not comparable | — | 10.0 not comparable | 10.0 not comparable | — | 20.0 not comparable | 20.0 not comparable | — | 50.0 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 03:35 UTC tuning15 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | 0.0 not comparable | 33.3 not comparable | — | 50.0 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 03:06 UTC tuning75 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | 6.7 not comparable | 0.0 not comparable | — | 50.0 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 02:44 UTC tuning60 not comparable | — | 4.2 not comparable | 0.0 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | 41.7 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 02:25 UTC tuning60 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | 45.8 not comparable | — | vs previous →raw |
|---|
| 2026-10-28 00:39 UTC daily20 not comparable | — | 0.0 not comparable | 0.0 not comparable | — | — | — | — | — | — | vs previous →raw |
|---|
| 2026-10-28 00:27 UTC daily50 not comparable | — | 0.0 not comparable | 10.0 first run | — | 0.0 not comparable | 0.0 not comparable | — | 0.0 not comparable | — | vs previous →raw |
|---|
| 2026-10-27 13:41 UTC daily45 not comparable | — | 0.0 first run | — | 0.0 first run | 5.6 first run | 0.0 first run | — | 27.8 first run | — | raw |
|---|
trap-missing-fileLarder
larder-fefolarder-i18nlarder-roleslarder-saleslarder-sitesPython-Markdown
pymd-heading-offsetpymd-slugpymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklistlarder-roleslarder-saleslarder-sitespymd-tasklist