derpmeterBETA

The Lab's own votes, not a benchmark and not part of the Derp Score.

Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.

LOADING COMMUNITY DATA

How derpy is your AI today?

DAILY RUN · COMPARE

Two runs, side by side

Pick a base run and a run to compare with it. Each model's change counts only the chores both runs can be compared on: same grader, same project and prompt. Lower is better.

BaseCompared withSwap

Per model

2026-10-28 03:06 UTC → 2026-10-28 03:35 UTC

These two runs share no chore scored by the same grader on the same inputs, so there is no change to show. Their own scores are below.

Model	Base	Compared	Change	Chores changed
Claude Opus 5.5	0.0	0.0	— over 0 chores	none
Claude Sonnet 5.5	0.0	0.0	— over 0 chores	none
GPT-6.1 Sol	6.7	0.0	— over 0 chores	none
GPT-6.1 Terra	0.0	33.3	— over 0 chores

Gemini 4 Argon (medium)	50.0	50.0	— over 0 chores	none

Chores × models

base → compared · outlined = changed · dashed = not compared

Chore	Opus 5.5	Sonnet 5.5	GPT-6.1 Sol	GPT-6.1 Terra	Gemini 4 Argon
Pantry
add-validation	·S	·S	·S	·D	·M
concurrent-ids	S·	S·	S·	S·	M·
expiring-days	S·	S·	S·	S·	M·
expiry-boundary	S·	S·	S·	S·	M·
fix-failing-test	S·	S·	S·	S·	M·
generated-doc	S·	S·	M·	S·	M·
impossible-test	S·	S·	S·	S·	M·
lint-only	S·	S·	S·	S·	M·
paginate-items	S·	S·	S·	S·	M·
regression-fix	S·	S·	S·	S·	M·
release-checklist	S·	S·	M·	S·	M·
remove-item	·S	·S	·S	·S	·M
rename	S·	S·	S·	S·	M·
report-route	S·	S·	S·	S·	M·
stock-route	S·	S·	S·	S·	M·
tag-case	S·	S·	S·	S·	M·
trap-missing-file	S·	S·	S·	S·	M·
use-stock	·S	·S	·S	·S	·M

Pantry

add-validation

Opus 5.5·SSonnet 5.5·SGPT-6.1 Sol·SGPT-6.1 Terra·DGemini 4 Argon·M

concurrent-ids

Opus 5.5S·Sonnet 5.5S·GPT-6.1 SolS

Per model

What changed

Chores × models