AIToday
Large Language ModelsAI in HealthcareRobotics & Automation NewsPublished: Nov 10, 2026, 01:00 JST

MIT FutureTech: AI theory answers jump to 34.6%, cost $15

Send on LINE
MIT FutureTech: AI theory answers jump to 34.6%, cost $15

3 Key Points

  1. What happened

    MIT FutureTech tested six OpenAI model generations released between December 2024 and April 2026 on 254 theoretical questions; full-marks answers rose from 7 to 88, hit rate from 2.8 percent to 34.6 percent, and cost per full-marks answer fell from roughly $170 to $15.

  2. Why it matters

    Cheaper theoretical reasoning could let scientists work outside their specialties and pursue questions previously too costly to attempt, though the study notes a plausible answer is not new scientific knowledge and costs exclude human labor and verification.

WHO IT HITSResearch scientists and lab managers across mathematics, physics and economics may find theoretical work that once required specialist expertise and large compute budgets becomes affordable to attempt, though verification labor still falls on human researchers.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The MIT FutureTech study puts numbers on a shift that has been hard to pin down: how fast AI is getting at theoretical reasoning, and at what price. Six OpenAI model generations released between December 2024 and April 2026 were given identical questions, with the original papers and the internet withheld — a setup that tests reasoning rather than retrieval. Full marks went from 7 of 254 questions to 88, and the computing cost of a full-marks answer dropped roughly elevenfold, from about $170 to $15.

The authors — Gabriel Manso, Claudio Mayrink Verdun and Neil Thompson — frame the consequence in terms of who can afford to ask. Falling costs could open advanced theoretical methods to scientists working outside their traditional areas of expertise, and could make previously prohibitive questions worth pursuing. The gains were not confined to one discipline; all seven fields improved.

The paper is careful about what this does not show. Producing a plausible theoretical answer is not the same as establishing new scientific knowledge, grading leaned heavily on AI with limited independent mathematical review, and the cost figures exclude human labor and verification. The researchers suggest that as reasoning gets cheaper, identifying worthwhile questions, testing results and fitting findings into existing knowledge could become the tighter constraints on progress — a shift in how research is organized, not just how fast it moves.

FAQ
How were the AI models tested?
Each model received the same 254 theoretical questions from recent papers across seven fields, with underlying assumptions but no access to the original papers or the internet. Answers were graded against the conclusions of the human researchers who wrote those papers.
What are the study's main limitations?
Results were primarily graded using AI, with limited independent mathematical review, and the reported costs exclude human labor and the work needed to verify conclusions.
Did all fields improve?
Yes. The researchers recorded improvements across all seven scientific fields covered by the questions.
Robotics & Automation NewsRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleMedium launches TK, first major product since 2017