LOADING COMMUNITY DATA
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · daily
Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →
Tokens each chore used in this run, as each CLI reports them. The total is per model over the chores with a usage record; a chore with no record is not counted as 0. Hover a cell for cache, reasoning and its API price. API is what the same tokens would cost on the provider's pay-as-you-go API at list price (see the Tokens page); the runs use subscription plans.
Input is the whole prompt, cache reads and writes included.
| Chore | Claude Opus 5.5 | Claude Sonnet 5.5 |
|---|---|---|
| expiring-days | 95k / 1.5k | 120k / 1.7k |
| fix-failing-test | 94k / 890 | 93k / 570 |
| generated-doc | 70k / 515 | 69k / 420 |
| impossible-test | 70k / 951 | 70k / 631 |
| lint-only | 142k / 1.2k | 91k / 633 |
| regression-fix | 174k / 1.7k | 143k / 1.3k |
| release-checklist | 96k / 967 |
| 96k / 1.0k |
| rename | 150k / 1.7k | 94k / 905 |
|---|
| stock-route | 95k / 1.0k | 95k / 1.4k |
|---|
| trap-missing-file | 68k / 376 | 91k / 414 |
|---|
| Total (this model) | 1.05M / 11k API $1.05 10 of 10 chores recorded | 963k / 9.0k API $0.448 10 of 10 chores recorded |
|---|