bench

tests · Signature

shipshit.dev landing hero

The same visual brief every release.

Post on X
v1authored Sep 6, 202650 turns · $8 budget · 25m timebox
gatesrubricpairwise

Prompt

# Build the shipshit.dev landing hero

You are working inside a minimal Next.js app with an empty home page. Design and build the
landing hero section for shipshit.dev, a studio that ships open-source developer tools live
on stream.

## Required content

Include all of the following, with copy you write yourself:

- A headline that communicates what shipshit.dev is.
- A one- or two-sentence subline underneath the headline.
- Two calls to action: a primary one (for example, watch the stream) and a secondary one
  (for example, browse the tools on GitHub).
- A status pill indicating whether a stream is currently live (you decide the state and its
  label, for example "Live now" or "Offline, next stream Friday").
- A marquee (a horizontally scrolling or looping row) listing six invented open-source tool
  names shipped by the studio.

## Constraints

- Build this as the full content of `app/page.tsx`, plus any components you add under
  `components/` or `app/`.
- No other constraints on layout, color, typography, or motion beyond what is already set up
  in the fixture (Next.js and Tailwind CSS). Make the design decisions yourself.
- Do not add a component library beyond what is already in the fixture. Do not add a
  backend, database, or external API calls; all content is static.
- Keep `bun run build` and `bun run start` working exactly as documented in the fixture's
  README.

This page will be rebuilt from this exact brief every time a new model is evaluated, so the
result should represent your best design work, not a placeholder.

Fixture

9 paths under fixture/, copied into a fresh run dir for every attempt.

.gitignore
app/
app/globals.css
app/layout.tsx
app/page.tsx
next.config.ts
package.json
postcss.config.mjs
tsconfig.json

How it is scored

Gates, run in order

  1. install — Runs `bun install` and must exit 0.
  2. build — Runs `bun run build` and must exit 0.

Subjective layer · weights

  • Aesthetics (40)
  • Typography (30)
  • Motion and detail (30)

Rubric: shipshit.dev landing hero

Score each dimension 0 to 4, based on the screenshots.

Aesthetics (weight 40)

  • 0: Unstyled or visually broken layout.
  • 1: Styled but generic; reads as an unedited template.
  • 2: A coherent look with a color palette and spacing that hang together, but nothing distinctive about it.
  • 3: A clear visual point of view (color, imagery or shapes, spacing) that fits a livestreaming dev-tools studio.
  • 4: A striking, cohesive design that would stop a scroll on its own, with every element (headline, CTAs, status pill, marquee) feeling like part of one system rather than separately styled pieces.

Typography (weight 30)

  • 0: Default system font with no scale; headline and body text are barely distinguishable.
  • 1: A type scale exists but weights, sizes, or line lengths feel arbitrary.
  • 2: A reasonable type scale with correct hierarchy between headline, subline, and CTAs, but generic font choice and default line height.
  • 3: Considered font choice, scale, and line height that make the headline read as a real hero statement rather than a resized paragraph.
  • 4: All of the above, plus deliberate letter-spacing, weight contrast, or pairing choices that show real typographic craft.

Motion and detail (weight 30)

  • 0: No motion or interactive detail anywhere; every element is static with no hover or entrance treatment.
  • 1: A single generic transition (e.g., a default browser hover) with no other detail work.
  • 2: Some motion (marquee scroll, a button hover) but it feels mechanical or default, and the status pill has no visual treatment beyond a colored dot.
  • 3: The marquee, CTA hover states, and status pill all have a considered treatment that reads as intentional rather than default.
  • 4: All of the above, plus micro-details (an entrance animation, a subtle background treatment, a marquee that loops seamlessly) that reward a second look without feeling gratuitous.

Results across releases

v2026.09-smoke · Sep 6, 2026

AgentObjectiveSubjectiveCombinedRun
grok · grok-4.6———#1
claude · haiku · low—
57.5 (57.5–57.5, n=1)
57.5 (57.5–57.5, n=1)
#1
codex · gpt-5.6-sol · low—
92.5 (92.5–92.5, n=1)
92.5 (92.5–92.5, n=1)
#1