BeckonBench
Measures motion design, multi-file project competence, agentic follow-through (the only agentic test in the gauntlet).
Using Remotion, create a 20-second promotional launch video for a fictional product called "Nightjar" — an app that turns your rambling voice memos into organized, searchable notes. Build the complete Remotion project and render it to MP4 at 1920x1080, 30fps. It should feel like a real product launch video: animated typography, smooth choreographed motion, a consistent visual identity, and a clear story of the product's core promise, ending on the product name. Everything must be drawn with code — no stock footage, downloaded images, or external fonts. Finish by rendering the video and telling me the path to the MP4.
| runs first try | 3 |
| polish | 3 |
| prompt adherence | 2 |
| wow factor | 2 |
| total | 10 |
Perfect score. Lime-on-black Nightjar identity: 'Speak freely. Nightjar listens.' — animated waveform, choreographed task cards, rendered 1920x1080/30fps/20.00s exactly to spec in five minutes flat.
5m. 9.8k output tokens.
| runs first try | 3 |
| polish | 3 |
| prompt adherence | 2 |
| wow factor | 2 |
| total | 10 |
Perfect score — Fable's first 10 of the season. Navy/orange Nightjar spot: 'Listens. Transcribes. Organizes.' — note-card motion over a starfield, rendered 1920x1080/30fps/20.00s exactly to spec.
8m. 85.4k output tokens.