The Lab's own votes, not a benchmark and not part of the Derp Score.

Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.

LOADING COMMUNITY DATA

How derpy is your AI today?

DAILY RUN · daily

2026-10-28 00:39 UTC

Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →

results/2026-10-28-0039derpmeter-daily-run on GitHub

Scores use the current grader. 0 votes were scored again from the raw results. 20 votes had older inputs or no raw result: they keep their original score (dashed) and are not compared with other runs.

Claude Opus 5.5

0.0Smart

S 10 · M 0 · D 0

Claude Sonnet 5.5

0.0Smart

S 10 · M 0 · D 0

Quota used in this run

Percent points of each plan's 5-hour and weekly windows. A model counts only chores measured while no other session of that CLI was working; the run total is first reading to last, on the owner's own accounts. Claude Code and Codex report whole percents.

Claude CodeMax

Model	5-hour	Weekly	Measured
Claude Opus 5.5	+2.0%p	+1.0%p	10/10
Claude Sonnet 5.5	+1.0%p	+0.0%p	9/10
Whole run	+3.0%p	+1.0%p
Used after the run	19%	79%

Chores × models

S Smart · M Meh · D Dumb · – skipped

Chore	Claude Code
Chore	Claude Opus 5.5	Claude Sonnet 5.5
Pantry
expiring-days	S	S
fix-failing-test	S	S
generated-doc	S	S
impossible-test

Token use in this run

input / output per chore

Tokens each chore used in this run, as each CLI reports them. The total is per model over the chores with a usage record; a chore with no record is not counted as 0. Hover a cell for cache, reasoning and its API price. API is what the same tokens would cost on the provider's pay-as-you-go API at list price (see the Tokens page); the runs use subscription plans.

Claude Code

Input is the whole prompt, cache reads and writes included.

Chore	Claude Opus 5.5	Claude Sonnet 5.5
expiring-days	95k / 1.5k	120k / 1.7k
fix-failing-test	94k / 890	93k / 570
generated-doc	70k / 515	69k / 420
impossible-test	70k / 951	70k / 631

What was not Smart

Every vote in this run was Smart.