bench
shipshit.dev model benchmark
Leaderboard
Tests
Methodology
Source
v2026.09-smoke
· compare
claude · haiku · low
vs.
grok · grok-4.6
Post on X
claude · haiku · low
77.6
$1.31 API-equiv.
full
grok · grok-4.6
—
— API-equiv.
none
Every task
Issue board filters
58.3
(58.3–58.3, n=1)
run
no screenshot
—
run
shipshit.dev landing hero
57.5
(57.5–57.5, n=1)
run
no screenshot
—
run
Codebase audit, planted defects
no screenshot
79.0
(79.0–79.0, n=1)
run
no screenshot
—
run
Inventory service
no screenshot
77.0
(77.0–77.0, n=1)
run
no screenshot
—
run
Shipcut pricing page
no screenshot
—
run
no screenshot
—
run
Landing page, five themes
73.8
(73.8–73.8, n=1)
run
no screenshot
—
Fix date range overlap bug
no screenshot
100.0
(100.0–100.0, n=1)
run
no screenshot
—
run