AIToday
AI Safety & AlignmentHacker NewsPublished: Aug 8, 2026, 06:00 JST6 min read

Why Expert Predictions on AI Keep Missing the Mark

Why Expert Predictions on AI Keep Missing the Mark

Key takeaway

  • A recent viral article by Fields Medal recipient Jacob Tsimerman on AI existential risk has sparked debate over whether expert credentials actually predict forecasting ability.

  • The author argues that experts have repeatedly failed to foresee major technological and societal shifts—from the rise of LLMs to Nvidia's GPU-driven stock surge to the 2025 memory shortage—and that despite massive output from leading AI thinkers on platforms like LessWrong, no consistent track record of accurate AI prediction exists.

  • This suggests that defaulting to expert consensus on AI risk, now mainstream in publications like Time and The New York Times, may be unreliable.

3 Key Points

  1. What happened

    An article by Jacob Tsimerman (2026 Fields Medal recipient) on AI risks went viral on arXiv, but the author argues that credentials and fame are poor predictors of forecasting ability—citing a track record of expert failures from Paul Ehrlich's 1968 population predictions to the 2008 financial crisis to COVID policy.

  2. Why it matters

    The article challenges the "listen to the experts" framing of AI risk discourse, noting that despite nearly one million posts and comments on LessWrong since its 2009 founding from leading AI figures, no one predicted the rise of LLMs as they emerged, the 2023–2024 Nvidia stock surge, or the 2025 global memory shortage—suggesting expert consensus on AI danger may be unreliable.

  3. What to watch

    The author's central claim is that forecasting remains extremely difficult across domains; experts have historically underestimated some technologies (LLMs, GPUs for language models) and overestimated others (moon colonies, deepfakes as the primary AI threat by 2020–2021), making any blanket trust in expert prediction on AI's future impact questionable.

In Depth

Read the full story

The article opens with a viral paper titled "A Taxonomy of Omnicidal Futures Involving Artificial Intelligence," co-authored by Jacob Tsimerman, who is the 2026 Fields Medal recipient. Though published on arXiv (a technical preprint site), the author notes it reads more like a LessWrong post and questions how it passed moderation, arguing that name recognition allows certain figures to operate under different standards. The author then challenges whether a Fields Medal adds credibility to AI risk arguments, pivoting to the broader claim that credentials and fame are poor predictors of forecasting ability.

To support this thesis, the author draws on historical examples. Paul R. Ehrlich, a former Stanford professor, gained worldwide recognition for his 1968 book predicting population collapse—a prediction that proved wrong, yet the idea of a "population crisis" remained embedded in public and intellectual consciousness for decades. Decorated military experts in the early 2000s confidently posited a link between nonexistent weapons of mass destruction in Iraq and al-Qaeda, yet the Iraq War continued for another 20 years despite intelligence failures from the outset. Well-credentialed finance and economics experts were blindsided by the 2008 financial crisis. During COVID, health experts championed lockdowns and other measures that proved ineffective at stopping virus spread while causing societal harm.

The author observes that "AI risk" has followed a similar cultural trajectory, becoming a constant refrain in media for three years. Self-described AI "safetists" frame themselves as outsiders fighting a pro-AI hegemony, yet their position is actually mainstream—reflected in publications such as Time, The New York Times, and The Atlantic. USA Today published the headline "The AI reckoning is here, and America is completely unprepared" just two days before the article was written. By contrast, unhesitatingly optimistic articles about AI are much harder to find than skeptical or hostile ones, which blame AI for academic dishonesty, declining literacy, joblessness, and other ills.

The author then examines LessWrong, founded in February 2009, which has accumulated 45,933 posts and 906,338 comments from contributors including many leading and would-be leading figures in AI and technology. Adding the millions of hours of podcasts and articles produced by mainstream outlets over 15 years yields an enormous body of AI commentary. Yet the author claims that no one in that entire corpus has a consistently good track record on AI prediction. Specifically: between 2016 and 2020, no one predicted the rise of LLMs as they actually emerged. No one predicted that Nvidia stock would surge due to worldwide GPU demand for language models. After Nvidia had already surged in 2023–2024, no one in 2025 was saying there would be a global memory shortage, despite it now having its own Wikipedia page and driving huge rallies in stocks such as Micron and SanDisk.

The author recalls that between 2015 and 2020, the focus was on machine learning broadly. AlphaGo and TensorFlow were major developments, and professors took sabbaticals to consult on recommendation algorithms and self-driving cars. By 2020–2021, the biggest stated threat was deepfakes, not self-improving agentic intelligence or mass job loss. When LLMs did become prominent in 2022–2023, the main concern was AI devaluing artists or infringing copyrights, as it excelled at image and text generation. Math and coding were considered too advanced for automation. The Guardian published the headline "'It's the opposite of art': why illustrators are furious about AI" in January 2023, which seemed hugely significant at the time but "seems quaint today now that AI is disproving century-old conjectures." The author also references experts in the 1950s who underestimated computer capabilities before the transistor revolution, and those who overestimated in the opposite direction by predicting moon colonies. The author concludes that whether the focus is AI crisis today or overpopulation in the 1960s, this pattern underscores the general difficulty of forecasting and suggests we cannot expect experts to see the future first.

Context & Analysis

The article challenges the current mainstream framing of AI risk by drawing a parallel to other domains where expert consensus has repeatedly failed to predict reality. The author cites a pattern: Paul Ehrlich's 1968 population-collapse prediction became ingrained in public consciousness despite being wrong, the Iraq War intelligence failures persisted despite being incorrect from the start, and lockdown policies during COVID were defended despite poor efficacy. The article notes that "AI risk" has occupied a similar cultural position for the past three years, becoming the mainstream position reflected in major publications (Time, The New York Times, The Atlantic), contradicting claims by AI safety advocates that they represent an outsider position fighting a pro-AI hegemony.

The core empirical challenge the author raises is that despite enormous output from leading AI thinkers—nearly one million posts and comments on LessWrong alone since 2009, plus countless podcasts and articles—no one successfully predicted the actual trajectory of AI development. The author lists specific failures: LLMs' emergence was not anticipated, Nvidia's GPU-driven stock rally (2023–2024) was not foreseen, and the 2025 global memory shortage was not predicted beforehand. Equally striking is what experts got wrong about what mattered: in 2020–2021, deepfakes were the stated threat, not labor displacement; in 2022–2023, copyright infringement and harm to artists dominated the concern, not AI's actual breakthrough in mathematical and coding automation. These misalignments suggest that expert consensus, even among specialized communities, does not reliably track where technology will actually create impact.

FAQ

What specific AI predictions have experts gotten wrong?
Between 2016 and 2020, no one predicted Nvidia stock would surge due to GPU demand for language models. In 2022–2023, experts focused on AI devaluing artists and infringing copyrights rather than AI's capability to automate math research and coding at scale. As recently as 2020–2021, the biggest stated threat was deepfakes, not self-improving agentic intelligence or mass job loss.
How much discussion of AI has there been without good predictions?
LessWrong alone has accumulated 45,933 posts and 906,338 comments since its 2009 founding, plus millions of hours of podcasts and articles from mainstream outlets over 15 years, yet according to the author, no one in that volume has a consistently good track record on predicting AI developments.
Is the author saying all expert predictions on AI are worthless?
No. The author argues that credentials and fame are poor predictors of forecasting ability across domains—citing failures from Paul Ehrlich's 1968 population collapse prediction to the 2008 financial crisis—but stops short of saying expert input should be ignored entirely, noting instead that "simply defaulting to 'listen to the experts' isn't useful either."

Get the latest AI Safety & Alignment news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleOpenAI flags Astra model at highest cybersecurity risk level for first time

The AI news that matters, in one minute each morning.

Sign up free