
Summaries like this, in your inbox every morning.
Sign up free →LLM judges incorrectly rank zero-shot AI stories above New Yorker short stories on the EQ-Bench creative writing benchmark, exposing a fundamental flaw in existing evaluation methods
The 100-Endings metric measures narrative tension by having models predict story endings 100 times at each sentence, with higher prediction failure rates indicating stronger tension
The metric tracks inflection rate—how frequently prediction patterns reverse—to identify plot twists and revelations that characterize compelling narratives
Unlike traditional rubric-based judging systems, 100-Endings correctly identifies professional human stories as significantly superior to LLM-generated content
No comments yet. Be the first to share your thoughts!
Log in to join the discussion




Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.
Get Started FreeFree · takes 30 seconds · unsubscribe anytime
1 minute a day. The AI essentials.
200+ sources · Email / LINE / Slack