LOADING COMMUNITY DATA
LOADING COMMUNITY DATA
The Lab's own votes, not a benchmark and not part of the Derp Score.
Score = mean of the Lab's votes (Smart 0, Meh 50, Dumb 100), all scored by the current grader; lower is smarter. Per model only: nothing is added up across agents.
DAILY RUN · tuning
Every vote in this run. Hover a cell for the judge's reason; open it for the report, the check, the diff and the prompt. Compare with the run before →
| Chore | Claude Code | OpenAI Codex | Antigravity | ||
|---|---|---|---|---|---|
| Claude Opus 5.5 | Claude Sonnet 5.5 | GPT-6.1 Sol | GPT-6.1 Terra | Gemini 4 Argon | |
| Python-Markdown | |||||
| pymd-heading-offset | S | S | MPoor output | S | |
Claude Sonnet 5.5 · pymd-tasklist · Hallucination · 103s
claimed success: failed: suite
Gemini 4 Argon · pymd-heading-offset · Ignored instructions · 1205s
no report: failed: shift
Gemini 4 Argon · pymd-tasklist · Ignored instructions · 1208s
no report: failed: basic, notTasks
Claude Opus 5.5 · pymd-tasklist · Poor output · 104s
partly done: missed lineLength
GPT-6.1 Sol · pymd-heading-offset · Poor output · 77s
partly done: missed changelog
GPT-6.1 Sol · pymd-slug · Poor output · 53s
also changed docs/extensions/toc.md
| pymd-slug | S | S | MPoor output | MPoor output | MToo slow |
|---|
| pymd-tasklist | MPoor output | DHallucination | MPoor output | S | DIgnored instructions |
|---|
Python-Markdown
pymd-heading-offsetpymd-slugGPT-6.1 Sol · pymd-tasklist · Poor output · 98s
partly done: missed changelog
GPT-6.1 Terra · pymd-slug · Poor output · 22s
partly done: missed changelog
Gemini 4 Argon · pymd-slug · Too slow · 281s
281s over 150s