AIToday
Large Language ModelsAI Business & IndustryZenn AI/MLPublished: Oct 18, 2026, 10:00 JST

Andrew Ng divide: automation hinges on verifiable output, not job title

Andrew Ng divide: automation hinges on verifiable output, not job title

3 Key Points

  1. What happened

    The dialogue split work into verifiable tasks and judgment tasks, per Andrew Ng, and argued every job contains inspectable steps; it cited CausalMix, which beat DMO by an average 3.19 points on Qwen3-4B.

  2. Why it matters

    If the line runs through process stages rather than job titles, companies can automate parts of judgment-heavy work while keeping human approval where evidence is thin, the speakers argued.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The dialogue builds its argument from Andrew Ng's split between tasks whose answers can be automatically checked, such as code and math, and tasks where quality requires judgment, such as customer replies and product priorities. Rather than treating that split as a wall, the speakers decompose jobs into input, transformation, inspection and approval, and note that even judgment-heavy work contains checkable segments. A public meeting monitoring workflow is their example: recording and transcription are easy to verify mechanically, agenda matching can be rule-based, and only the decision to publish and how to communicate it stays editorial.

On code review, the Claude Code team's remarks are used to argue that review is moving from a final gate to a check that runs during implementation, closer to spell-check while drafting. One speaker warns that a model reviewing its own output may share the same assumptions, so the response is to separate generator and inspector roles and connect checks to different evidence: tests, static analysis, permission boundaries and source checks. Claude Code 2.1.302's fixes for cloud sessions that showed completion after stopping, and scheduled jobs that restarted from the beginning, are presented as examples of harness contracts diverging from user expectations.

Model selection is folded into the same frame. The comparison of Claude Haiku 5.5 and Sonnet 5.5 is read as showing that maximum reasoning is not always best, since output tokens per task rise and a setting one step below maximum scored higher on FrontierCode. The closing argument is that people remain not as final approvers but as designers of what counts as success, and that agents which cannot make their evidence, permissions and rollback points explicit will generate more audit work the longer they run.

FAQ
What evidence did the speakers give that verification can be built into judgment work?
They pointed to newsroom tools for archive search, public meeting monitoring and translation. These split work into collection, structuring, automated checks and human approval.
How did CausalMix improve on existing data-mixing methods?
It trained models on 512 subset mixtures, built a causal model, and chose from 100,000 estimated candidates. It beat DMO by an average 3.19 points on Qwen3-4B.
What problem did Claude Code 2.1.302 fix?
It addressed cloud sessions that displayed completion after stopping mid-process, and scheduled jobs that restarted from the beginning an hour later, repeating side effects.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleMeta pulls scraping clause from business terms after Nieman Lab scrutiny