AIToday
Large Language ModelsAI Safety & AlignmentZenn AI/MLPublished: Sep 29, 2026, 10:00 JST

300字以内 vs write all: order and conflict rule shift LLM output

300字以内 vs write all: order and conflict rule shift LLM output

3 Key Points

  1. What happened

    The editorial team gave three independent LLM instances a fictional 4-item meeting memo with conflicting demands — a 300-character limit and 'write out every reason.' Condition A (limit first) returned 135 characters with reasons compressed to a few words; Condition B (completeness first) returned 237 characters with reasons nearly intact; Condition C (same order as A plus an explicit 'if conflict, prioritize the limit and omit' rule) returned 233 characters, close to B.

  2. Why it matters

    An explicit conflict-resolution rule appears to act not as permission to omit, but as a license to attempt both demands and trim only the overflow — the opposite of the simple 'later instructions get ignored' assumption.

  3. What to watch

    Each condition was run only once, so no statistical significance is claimed, and the explanation is a working hypothesis. The test also used only Claude-family models and a single fictional memo, so whether ChatGPT or Gemini would behave the same way is untested.

WHO IT HITSThis lands on anyone who writes prompts for AI tools as part of their job — editors, analysts, and operations staff drafting summaries or reports. It suggests they should state both length and completeness demands up front, with a rule for what to cut, rather than tacking on a 'also include...' at the end.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The test grew out of a common editing habit: writing a prompt, then remembering something else and appending it at the end. The team had a prior belief that such trailing additions carry less weight, and they also drew on the standard prompt-engineering advice to specify priority when constraints conflict. Their web search turned up reports of a primacy bias — roughly 73% of cases favored information at the start of a prompt — and a paper on incompatible instructions (PRIME: Evaluating Prompt Resolution Under Incompatible Instructions in LLMs, arXiv:2606.22470). Based on that, they expected Condition A, where the character limit came first, to be obeyed most strictly.

Condition A did stay well under the 300-character ceiling, but finished at 135 characters rather than using the full budget, which the team found notable. Condition B, with the completeness demand first, came in at 237 characters. The surprise was Condition C: identical word order to A, yet it produced 233 characters, nearly matching B. If simple position bias explained everything, C should have looked like A.

The team's reading is that the difference lies in the wording of the appended instruction. Condition A only demanded that no reason be omitted; Condition C added a conflict rule saying what to cut. In A, the model may have treated the two demands as simply incompatible and defaulted to the first constraint; in C, it may have read the rule as permission to attempt both. The practical implication they draw is to state both constraints together from the start and include the resolution step — though they caution this is a post-hoc explanation from one run per condition.

FAQ
What exactly was tested?
A fictional meeting memo with 4 decisions and their reasons was summarized under three prompt conditions that differed only in instruction order and whether a conflict-resolution rule was included. Each condition used a separate LLM instance with no shared conversation history.
Why did the explicit conflict rule produce more detail, not less?
The team's working hypothesis is that the rule worked as a scope permit — letting the model try to satisfy both demands and trim only the overflow — rather than as permission to omit. Condition C reached 233 characters, close to Condition B's 237.
Can the results be treated as statistically valid?
No. Each condition was run only once, the material was a single fictional memo, and only Claude-family models were used, so the team does not claim statistical significance.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleTiny AI Arena pits AI models in battle game; claude-sonnet-5 leads