AIモデルはもう十分賢い、ボトルネックは「評価」に　Databricks研究者

Key takeaway

• Databricks Chief AI Scientist Jonathan Frankle argues that today's AI models are intelligent enough; the real bottleneck for adoption is evaluating and governing AI outputs — not building smarter models.

• Unlike humans, who need one licensing exam, AI systems require orders of magnitude more rigorous checks because a single software flaw can affect thousands of users simultaneously.

• Frankle says defining what "good work" means and translating that into evaluation checklists is unexpectedly hard and may take over a decade to solve.

3 Key Points

FAQ

Why is AI evaluation harder than building better AI models?

A single flaw in AI software can cascade across many systems simultaneously (for example, in self-driving cars), whereas humans need only pass one test. This means AI requires orders of magnitude more rigorous evaluation than humans do. Additionally, turning implicit human standards for quality into detailed checklists is surprisingly difficult, and without a mind-reading machine, humans accurately describing their own expectations remains a near-term bottleneck.

What should companies do if their AI outputs are lower quality than expected?

Frankle suggests investing first in evaluation and governance rather than waiting for smarter models. By rigorously assessing whether AI outputs match instructions and avoiding harmful outputs, then adjusting prompts, harnesses, and context management based on those assessments, even lower-performing models can produce high-quality outputs. Users should define what "good work" means for their own use cases, since this cannot be dictated by model providers.

How long might it take to solve AI evaluation challenges?

Frankle believes AI evaluation is "far harder and more important than building the next massive model" and may take over 10 years to solve.