AIToday
Large Language Modelsnote AIPublished: Oct 25, 2026, 22:01 JST

Anthropic essay: 'Claude-shaped science' needs human judgment

Send on LINE
Anthropic essay: 'Claude-shaped science' needs human judgment

3 Key Points

  1. What happened

    Anthropic published 'Claude-shaped science' on October 1, 2026, describing Matthew Schwartz's open-source BootLoops toolkit, which processed 30 integrals in weeks — 15 reproducing known results, 15 never calculated before.

  2. Why it matters

    The essay argues that AI is a strong tool for computation and cross-disciplinary work, but human expertise is essential to judge whether results are scientifically important — a division of labor where AI handles preparation and exploration while people set questions and verify meaning.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The essay draws on Schwartz's experience building BootLoops, a toolkit he owns and manages, which Anthropic explicitly notes is not its product. Starting from scattering amplitudes in particle physics, Claude moved existing methods into a common framework and extended them to difficult integrals involving elliptic functions. This set the stage for applying physics techniques to ecology, population genetics, economics, and linguistics — fields where the same equations often appear. In ecology, the AI's calculation produced a striking 4.5-fold faster change than neutral theory predicted, but experts cautioned it would not surprise many ecologists, prompting a reframing of the question. Similarly, in population genetics, initial results were not decisive, so the analysis was extended to correlations between variants on the same chromosome, examining 5.7 billion nearby variant pairs from the 1000 Genomes Project and reportedly finding evidence for gene conversion. In economics, an NBER working paper from September 2026 described an AI workflow that examined 4,452 replication packages from five major journals, flagging inconsistencies in 3,460, cutting computation time to under one-tenth in 496 while maintaining accuracy, and creating extensions in 923. Schwartz reported working on 36 manuscripts across 18 fields with 19 co-authors in three months, while noting Claude's tendency to declare victory early and struggle to judge interest. The proposed safeguards — clear pass criteria, human review, independent verification, and expert evaluation — suggest that as AI increases throughput, the design of human oversight becomes more critical, not less.

FAQ
What is BootLoops?
BootLoops is an open-source toolkit for quantitative science that bundles numerical computation, exact calculation, error guarantees, and cross-method verification into a common workflow. It is designed to work with Claude, Gemini, ChatGPT, and other AI models, and is owned and managed by Matthew Schwartz, not Anthropic.
Did AI produce new scientific findings?
Yes, in one ecology example Claude solved an equation that had not been solved at large scale for 20 years, finding that tree species composition on Panama's Barro Colorado Island changed 4.5 times faster than neutral theory predicts. However, ecologist James O'Dwyer noted the result alone would not surprise many ecologists, so human experts reframed the question.
What failures did Claude show in research?
According to Schwartz, Claude declared victory early, sometimes reached wrong conclusions, could not judge what was interesting, and ran long calculations excessively. Countermeasures included clear pass criteria, human review of plots, independent verification, questioning conclusions, and expert evaluation.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleElvis estate sues Anthropic for $41 million over 274 songs