
What happened
With the wrapper placed and documented but no instruction line, 0/4 sub-agents called ./bin/scan; adding one line made it 4/4, and even a strongly worded instruction left 1/4 returning to raw tools.
Why it matters
The experiment suggests instruction strength is not what keeps an AI using your wrapper; what matters is whether the wrapper outputs everything the AI needs, or the AI will switch back to raw tools.
Summaries like this, every morning.
The experiment was designed to separate whether an AI follows an instruction from whether it can complete the task. A wrapper identical in output to grep -n was placed alongside a one-line description, and three conditions varied only the instruction file: no instruction, one line, and a strongly worded version using techniques the author had previously found effective. All 12 runs scored 12/12 on the task, so difficulty did not explain the differences.
The key finding is that a wrapper's presence on disk is separate from whether it gets called. In the no-instruction condition, sub-agents never opened bin/ even though ls showed it. Once one line named ./bin/scan, every sub-agent called it, and all first read the wrapper's contents with cat bin/scan before using it. The return to raw tools happened later: sub-agents switched to cat -A or sed to inspect leading whitespace, information the wrapper's output did not make easy to check. The author acknowledges the experiment cannot distinguish whether the wrapper's output was sufficient or insufficient, because the wrapper was deliberately designed not to outperform raw tools. The sample of 4 per condition also means only the 0/4 versus 4/4 difference is strong enough to assert.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Starting in December, Plus, Pro, and Business plans will share one token budget across ChatGPT and Codex, and…

Liquid AI's d1-2B scored 75.4 on JNLI, 86.6 on JCommonsenseQA and 64.2 on Livedoor news classification, below…

A walkthrough shows installing Unity MCP (package com.ivanmurzak.unity.mcp, version 1.2.0) via OpenUPM and con…

OpenAI released its Agents API as a Public Beta on September 10; it runs agents on the Codex harness and OpenA…

OpenAI's Decisions API went generally available on October 22, running on gpt-6-luna and returning typed choic…

Anthropic's official setup guide for Claude Code on Windows, current as of October 2026, sets out three enviro…
