AIToday
Large Language ModelsAI Coding AssistantsZenn AI/MLPublished: Oct 18, 2026, 22:00 JST

Claude Code review cap honored exactly; all-findings flag adds none

Claude Code review cap honored exactly; all-findings flag adds none

3 Key Points

  1. What happened

    Across 24 counted runs of /code-review on a 41-line shopping-cart file with six planted bugs, --max-findings 1, 2, and 3 returned exactly that many findings in all 11 runs, with zero over or under.

  2. Why it matters

    The cap appears to be applied at output time rather than being a request to the model, and the same defect (#1, last item left out of the total) came first in all 24 runs, so a lower limit seems to trim from the end rather than at random.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The test was deliberately built so the cap would have room to bite: a 41-line cart.py with six planted defects presented as a 34-line-addition, 2-line-deletion diff. Every run used the same model, claude-sonnet-5-5, on version 2.1.296, with one process per call and each condition run in a fresh copy of the test folder — except the check on whether the cap persists, which reused one folder.

The most interesting signal is not the exact count but where it comes from. Because the same defect led every run, and because a 20-finding cap still returned only the 8 findings that existed, the cap looks like a ceiling applied to the response rather than an instruction the model follows. Timing supports the same picture: the slowest capped runs topped out at 8,208 ms while the fastest uncapped runs started at 11,769 ms, with no overlap, and output length differed by an order of magnitude (366–446 characters versus 2,746–3,245).

The author also flags what the setup could not settle. The claim that the feature arrived in version 2.1.288 was not verified, since only 2.1.296 was tested. Whether the cap survives inside an interactive session, why line numbers drift by one to three lines after the first finding, and why the uncapped count wobbles between 7 and 8 all remain open. An attempt to measure a third-party plugin was dropped after a 403 on retrieval and an environment guard blocking external code.

FAQ
Does asking Claude Code's code review for all findings give more than the default?
No. All three --max-findings all runs returned 7 findings, and no-finding-flag runs returned 7 or 8, so 'all' never exceeded the default. Passing 20 also stopped at 8, the number actually found.
Does a lower finding limit make code review cheaper?
The test could not establish that. The highest cost at a 1-finding cap was $0.0432141, and the lowest with no cap was $0.0356350, so the ranges overlap.
What does the recurring permission_denials entry mean in this test?
All 27 recorded denials were for Bash commands containing @{upstream}, and the run succeeded on a second command. It reflects a brace-syntax restriction, not a permission problem.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOnlyFans creators question Meta's Muse sexting while Instagram restricts them