AIToday
AI Coding AssistantsAI Business & IndustryZenn AI/MLPublished: Oct 17, 2026, 22:00 JST

Claude Code PRs doubled, reverts fell over 40%: Anthropic

Send on LINE
Claude Code PRs doubled, reverts fell over 40%: Anthropic

3 Key Points

  1. What happened

    In a claude.dev blog post, Addy Osmani, Morgan Westlee Lunt and Qing Wang described how Claude Code merged more than twice as many PRs from June to September while the revert rate fell over 40%; a three-round review cap lifted single-round merges from 65% to 78%.

  2. Why it matters

    The results suggest that reviewing code through layered automated checks can absorb far more volume without a higher revert rate, which the team uses as a guardrail alongside incident rate.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The post frames the change as a shift in what the team measures. Rather than asking whether a human read the code, it asks what could break and which check, automated or human, is right to catch it. Human time becomes the cost to minimize, but only if the revert rate and incident rate stay flat, so the team treats those as guardrails against simply moving work elsewhere.

The review process itself is organized as overlapping layers rather than one perfect gate, with rollback as the floor beneath them. Human approval is one layer among several and is assigned by the risk of the change, not by who wrote it. A separate rule keeps agent approvals from counting as human ones, and assigns responsibility to whoever directed the agent.

The most practical passage concerns convergence between AI reviewers. One CLI PR ran through more than 50 review-and-fix rounds overnight before the author stopped it, and git blame showed about 59% of the flagged issues were already present when the reviewer first saw the code. The fixes, including a three-round cap and diff-only re-review, raised single-round merges from 65% to 78% and cut the average number of review rounds from 2.08 to 1.32.

What remains with people is a narrower set of judgments: whether to build something at all, high-risk code, architecture, reading evidence, and owning the result. The team says it keeps human review for changes from outside the team specifically so someone can ask whether the work should be done at all. It also says no one holds a full mental model of Claude Code, and that people learn a slice on demand instead.

FAQ
How did the team stop agent-to-agent review from running endlessly?
It capped reviews at three rounds, re-reviewed only the diff after the first few rounds, flagged bug types rather than single lines, and stopped repeating earlier comments. A nightly agent was also added to catch existing bugs outside PRs.
Who approves a change under the risk tiers?
Low-risk changes such as docs and copy need zero human approvals if automated review and security are green. Medium-risk product changes need one, and the highest-risk code needs two.
What happened when the team introduced its research preview?
The share of internal PRs receiving substantive review comments rose from 16% to 54%, with PRs over 1,000 lines usually getting comments and small PRs usually getting none.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next article69.3% of children don't want parents 65+ using generative AI, SHIFT AI survey finds