AIToday
Large Language ModelsAI Coding AssistantsZenn AI/MLPublished: Oct 27, 2026, 01:00 JST

Claude Code user: CLAUDE.md tweaks are 'harness' work

Send on LINE
Claude Code user: CLAUDE.md tweaks are 'harness' work

3 Key Points

  1. What happened

    Writing on Zenn, a developer who uses Claude Code daily sorted his own CLAUDE.md rules, skills and hooks into four boxes — loop, tools, context, control — and concluded that adding a line to CLAUDE.md or writing a hook is always work on one of those boxes.

  2. Why it matters

    The piece frames these small, everyday fixes as a deliberate discipline rather than ad-hoc tinkering, which could change how other Claude Code users think about the time they spend on configuration.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The Zenn piece is written from the perspective of someone who had been improving his Claude Code setup without a name for it. He had added rules to CLAUDE.md, built skills, and used hooks to block dangerous edits, but could not explain what a 'harness' was when asked. His conclusion is that all of this is harness work, and he sorts it into four boxes: the loop, tools, context and control.

The fixes are then ranked by strength: asking the model in prose (CLAUDE.md, skills), watching with hooks that stop a bad action at the moment it happens, and removing the possibility of error through settings, lint and tests. Using his own examples, he shows that moving a warning from CLAUDE.md to a hook made it reliable even when the model forgets, though his first hook version also blocked ordinary commands and rejected the commit that fixed it. He also notes that OpenAI writes fixes into its lint error messages, calling this a good kind of prompt injection.

Beyond the ranking, he stresses timing (instructions are read at different moments), testing the same scenario before and after a fix with a subagent, and subtraction — Anthropic reportedly removed a handoff mechanism for Claude Sonnet 4.5 once Claude Opus 4.5 no longer showed the same habit. He cautions that most of the benchmark numbers come from parties with their own products, and that the Terminal-Bench paper itself concludes model choice usually matters more than the harness. Still, he argues the old habits of tests, lint and documentation now pay off more because the agent can read errors and retry until tests pass.

FAQ
What counts as the harness in this article?
The author defines it broadly as everything outside the model that works while the coding agent runs, including user-added CLAUDE.md files and hooks, organized into loop, tools, context and control.
Does changing only the harness actually change results?
Yes — LangChain reported raising its Terminal-Bench 2.0 solve rate from 52.8% to 66.5% by changing the system prompt and tools while keeping the model the same.
Can a better harness make things worse?
The author says yes, citing Anthropic's account that Claude Code quality dropped in spring 2026 due to three harness-side changes, including a lower default reasoning strength, not the model.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOracle launches 25 Claw-powered Agentic Applications