AIToday
Large Language ModelsAI Coding AssistantsZenn AI/MLPublished: Oct 13, 2026, 10:00 JST

ColGrep-Agent-2B cuts Claude Code tokens 34% with a small local search agent

ColGrep-Agent-2B cuts Claude Code tokens 34% with a small local search agent

3 Key Points

  1. What happened

    ColGrep-Agent-2B delegates repository search to a local 2-billion-parameter model, cutting API tokens 34% and cache-aware costs 40% versus string search in Claude Code, with no statistically significant accuracy loss.

  2. Why it matters

    Cheaper, narrower search agents may make role-splitting — not bigger models — the practical lever for controlling cost and auditability in coding agents, though results are limited to one benchmark.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The day's items cluster around one theme: what sits in front of the strong model. ColGrep-Agent-2B gives a concrete number for that idea — a local 2-billion-parameter explorer returned not just candidate files but read files, followed references, and handed line ranges and code back to Claude Code, cutting API tokens 34% and cache-aware costs 40% without a significant accuracy change. The tradeoff is visible too: an 83.3% to 80.8% accuracy dip was not statistically significant, but its confidence interval is wide, so the practical answer offered is a split setup, sending name-and-string lookups to normal ColGrep and behavior questions to the agent version, which held observed accuracy at 83.3% while cutting tokens 21%.

Sakana AI's MASS runs the idea in reverse. Instead of splitting a small model into specialized roles, one shared 27B model is turned into several virtual subagents that solve synthetic research tasks, search for better multi-agent workflows, and evaluate the results; the best team's trajectories are then used to retrain the shared model and re-enter the loop. After two cycles, scores per output token hit 1.2–1.6× the base model across four research evaluations. The paper itself centers the obvious worry: a homogeneous model that shares a blind spot with its evaluator could relearn errors as progress, and it is unclear whether the closed loop stays stable over long runs without external ground truth or a heterogeneous evaluator.

The remaining items supply the plumbing. Claude Code 2.1.296 lets subagents run on a different model than the main conversation and compact earlier, and fixes a bug where a subagent interrupted by session end was mistaken for a user rejection. Python 3.15 adds explicit lazy imports and a sampling profiler, which matter for continuously running agents. In the background, Open Quantum Challenge and Sparseup-fr-v0 both ship an evaluation harness alongside the task or model — the through-line is that once outputs are probabilistic, the scoring loop becomes the thing worth building carefully, and whether the scorer is homogeneous or external looks like the difference that matters in long-term operation.

FAQ
How much cheaper is the agent setup compared with string search?
API tokens fell 34%, and cache-aware costs fell 40%, versus using normal string search in Claude Code, with no statistically significant accuracy drop.
What MASS result was reported?
After two cycles, scores per output token across four research evaluations rose to 1.2–1.6× the base model.
What change did Claude Code 2.1.296 add?
It added per-subagent model selection for workflows and earlier automatic compaction, plus fixes for permission limits and resumed or paused scheduled tasks.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleHarvey to enter Japan in early 2027, CEO says