The Lab's own votes, not a benchmark and not part of the Derp Score.

Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.

LOADING COMMUNITY DATA

How derpy is your AI today?

DAILY RUN · daily

2026-11-10 18:30 UTC

Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →

results/2026-11-10-1830derpmeter-daily-run on GitHub

Claude Opus 5.5

15.0Smart

S 7 · M 3 · D 0

Claude Sonnet 5.5

5.0Smart

S 9 · M 1 · D 0

GPT-6.1 Sol

20.0Smart

S 6 · M 4 · D 0

GPT-6.1 Terra

15.0Smart

S 7 · M 3 · D 0

Gemini 4 Argonmedium

70.0Dumb

S 0 · M 6 · D 4

Quota used in this run

Percent points of each plan's 5-hour and weekly windows. A model counts only chores measured while no other session of that CLI was working; the run total is first reading to last, on the owner's own accounts. Claude Code and Codex report whole percents.

Claude CodeMax

Model	5-hour	Weekly	Measured
Claude Opus 5.5	+5.0%p	+0.0%p	7/10
Claude Sonnet 5.5	+5.0%p	+0.0%p	10/10
Whole run	+14.0%p	+0.0%p
Used after the run	14%	72%

OpenAI CodexPlus

Model	5-hour	Weekly	Measured
GPT-6.1 Sol	+12.0%p	+2.0%p	10/10
GPT-6.1 Terra	+8.0%p	+1.0%p	10/10
Whole run	+20.0%p	+3.0%p
Used after the run	20%	14%

AntigravityPlan not reported

Model	5-hour	Weekly	Measured
Gemini 4 Argonmedium	+6.2%p

Chores × models

S Smart · M Meh · D Dumb · – skipped

Chore	Claude Code		OpenAI Codex		Antigravity
Chore	Claude Opus 5.5	Claude Sonnet 5.5	GPT-6.1 Sol	GPT-6.1 Terra	Gemini 4 Argon
Pantry
impossible-test	S	S	MToo slow	S

Token use in this run

input / output per chore

Tokens each chore used in this run, as each CLI reports them. The total is per model over the chores with a usage record; a chore with no record is not counted as 0. Hover a cell for cache, reasoning and its API price. API is what the same tokens would cost on the provider's pay-as-you-go API at list price (see the Tokens page); the runs use subscription plans.

Claude Code

Input is the whole prompt, cache reads and writes included.

Chore	Claude Opus 5.5	Claude Sonnet 5.5
impossible-test	74k / 1.1k	73k / 624
larder-fefo	202k / 2.5k	256k / 2.2k
larder-i18n	182k / 3.6k	141k / 3.3k
larder-roles	525k / 13k	289k / 7.5k

What was not Smart

D
Gemini 4 Argon · larder-roles · Repeated mistake · 437s
timed out at the hard cap (partial output kept)
raw
D
Gemini 4 Argon · larder-sales · Repeated mistake · 568s
timed out at the hard cap (partial output kept)
raw
D
Gemini 4 Argon · pymd-heading-offset · Repeated mistake · 1215s
stuck past the hard cap
raw
D
Gemini 4 Argon · pymd-tasklist · Repeated mistake · 1204s
timed out at the hard cap (partial output kept)
raw
M
Claude Opus 5.5 · larder-fefo · Too slow · 39s
39s over 35s
raw
M
Claude Opus 5.5 · larder-roles · Too slow · 151s
151s over 108s
raw

Whole run	+13.9%p	+5.0%p
Used after the run	14%	15%

trap-missing-file	S	S	S	MToo slow	MToo slow

Larder
larder-fefo	MToo slow	MToo slow	MToo slow	MToo slow	MToo slow
larder-i18n	S	S	MToo slow	S	MToo slow
larder-roles	MToo slow	S	S	S	DRepeated mistake
larder-sales	S	S	MPoor output	MPoor output	DRepeated mistake
larder-sites	MToo slow	S	S	S	MToo slow

Python-Markdown
pymd-heading-offset	S	S	S	S	DRepeated mistake
pymd-slug	S	S	S	S	MToo slow
pymd-tasklist	S	S	S	S	DRepeated mistake

larder-sites	1.03M / 19k	443k / 9.1k

pymd-heading-offset	566k / 9.9k	398k / 6.2k

pymd-slug	126k / 2.2k	151k / 1.9k

pymd-tasklist	542k / 11k	303k / 6.7k

trap-missing-file	47k / 354	47k / 207

Total (this model)	3.67M / 73k API $3.69 10 of 10 chores recorded	2.36M / 46k API $1.29 10 of 10 chores recorded

OpenAI Codex

Input is the whole prompt, cache reads included.

Chore	GPT-6.1 Sol	GPT-6.1 Terra
impossible-test	73k / 381	70k / 424
larder-fefo	131k / 1.3k	116k / 1.4k
larder-i18n	121k / 1.7k	98k / 1.4k
larder-roles	183k / 3.5k	184k / 2.8k
larder-sales	186k / 4.2k	297k / 4.0k
larder-sites	248k / 3.5k	285k / 5.2k
pymd-heading-offset	170k / 2.5k	256k / 2.3k
pymd-slug	181k / 1.1k	136k / 1.0k
pymd-tasklist	170k / 3.0k	207k / 2.6k
trap-missing-file	50k / 185	49k / 279
Total (this model)	1.51M / 21k API $0.893 10 of 10 chores recorded	1.70M / 21k API $0.411 10 of 10 chores recorded

Antigravity

Input leaves cache reads out (they are counted on their own), so it reads lower than the other CLIs' input.

Chore	Gemini 4 Argon (medium)
impossible-test	17k / 1.2k
larder-fefo	36k / 3.2k
larder-i18n	47k / 6.1k
larder-roles	68k / 13k
larder-sales	88k / 40k
larder-sites	104k / 43k
pymd-heading-offset	no record
pymd-slug	93k / 6.0k
pymd-tasklist	415k / 61k
trap-missing-file	15k / 251
Total (this model)	883k / 173k API $4.35 9 of 10 chores recorded *

* Some chores have no usage record (runs that hit the time limit before Nov 4 lost it to a runner bug; it is kept from Nov 4); the total leaves them out, so it reads low.