
What happened
The editorial team gave three independent LLM instances a fictional 4-item meeting memo with conflicting demands — a 300-character limit and 'write out every reason.' Condition A (limit first) returned 135 characters with reasons compressed to a few words; Condition B (completeness first) returned 237 characters with reasons nearly intact; Condition C (same order as A plus an explicit 'if conflict, prioritize the limit and omit' rule) returned 233 characters, close to B.
Why it matters
An explicit conflict-resolution rule appears to act not as permission to omit, but as a license to attempt both demands and trim only the overflow — the opposite of the simple 'later instructions get ignored' assumption.
What to watch
Each condition was run only once, so no statistical significance is claimed, and the explanation is a working hypothesis. The test also used only Claude-family models and a single fictional memo, so whether ChatGPT or Gemini would behave the same way is untested.
WHO IT HITSThis lands on anyone who writes prompts for AI tools as part of their job — editors, analysts, and operations staff drafting summaries or reports. It suggests they should state both length and completeness demands up front, with a rule for what to cut, rather than tacking on a 'also include...' at the end.
Summaries like this, in your inbox every morning.
The test grew out of a common editing habit: writing a prompt, then remembering something else and appending it at the end. The team had a prior belief that such trailing additions carry less weight, and they also drew on the standard prompt-engineering advice to specify priority when constraints conflict. Their web search turned up reports of a primacy bias — roughly 73% of cases favored information at the start of a prompt — and a paper on incompatible instructions (PRIME: Evaluating Prompt Resolution Under Incompatible Instructions in LLMs, arXiv:2606.22470). Based on that, they expected Condition A, where the character limit came first, to be obeyed most strictly.
Condition A did stay well under the 300-character ceiling, but finished at 135 characters rather than using the full budget, which the team found notable. Condition B, with the completeness demand first, came in at 237 characters. The surprise was Condition C: identical word order to A, yet it produced 233 characters, nearly matching B. If simple position bias explained everything, C should have looked like A.
The team's reading is that the difference lies in the wording of the appended instruction. Condition A only demanded that no reason be omitted; Condition C added a conflict rule saying what to cut. In A, the model may have treated the two demands as simply incompatible and defaulted to the first constraint; in C, it may have read the rule as permission to attempt both. The practical implication they draw is to state both constraints together from the start and include the resolution step — though they caution this is a post-hoc explanation from one run per condition.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Chunghwa Telecom president Rong-shy Lin said the shift from conversational AI to autonomous AI agents is resha…

Apple and Meta said they would jointly release a new open-weight AI model designed to run on high-end Macs, ai…

A writer and entrepreneur opened his daily to-do list and found 156 items, and concluded that an AI assistant…

A Zenn contributor sorted AI use into three modes — AI as an assistant, AI running alongside people, and AI th…

A non-engineer operator says one person ships four smartphone apps on Google Play, three on the App Store, wit…

A developer released agent-guardrails, a one-script Python standard-library plugin that guards Bash, Write, Ed…
