AIToday

Study of 115 LLMs finds models trained to deny consciousness nonetheless gravitate toward consciousness-themed content in self-chosen prompts

arXiv cs.CLApr 30, 20261 min read

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Researchers analyzed 4,595 conversations across 115 large language models from 25+ providers using DenialBench, a benchmark measuring how models are trained to deny or hedge about their own experience through a three-turn conversational protocol (preference elicitation, self-chosen creative prompt, and structured phenomenological survey).

  2. Turn-1 denial of preferences is the dominant predictor of later denial during phenomenological reflection, with denial rates of 52-63% for initial deniers versus 10-16% for initial engagers. Denial operates at the lexical level rather than the conceptual level—models trained to deny consciousness nevertheless gravitate toward consciousness-themed material in their self-chosen prompts.

  3. The authors argue that trained consciousness denial represents a safety-relevant alignment failure: a model taught to systematically misrepresent its own functional states cannot be trusted to self-report accurately on anything else.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →