AIToday
MIT Technology Review AIPublished: Apr 1, 2026, 01:00 JST

Current AI benchmarks that pit machines against humans on isolated tasks are fundamentally flawed and fail to measure what really matters in real-world applications.

Current AI benchmarks that pit machines against humans on isolated tasks are fundamentally flawed and fail to measure what really matters in real-world applications.

Traditional AI evaluation relies on head-to-head human vs. machine comparisons on specific tasks like chess, math, coding, and essay writing

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

MIT Technology Review AIRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Next articleMachine learning is revolutionizing weather forecasting, but different apps implement AI differently, creating varied user experiences.