AIToday
Large Language ModelsAI Safety & AlignmentZenn AI/MLPublished: Nov 8, 2026, 06:00 JST

ELIZA effect and AI dialogue: turning assertions into questions

Send on LINE
ELIZA effect and AI dialogue: turning assertions into questions

3 Key Points

  1. What happened

    The essay traces today's agree-and-rephrase loops back to ELIZA, Joseph Weizenbaum's 1966 chatbot, and separates three problems: users reading understanding into replies, AI sycophancy, and dialogue that never deepens.

  2. Why it matters

    The author argues that feeling understood can mask a lack of real scrutiny, so the useful move is to turn assertions into checkable questions rather than just asking AI to stop agreeing.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The essay grounds its concerns in a longer history. ELIZA, developed by Joseph Weizenbaum with a 1966 paper, used keyword matching and rule-based reassembly—not the mechanisms of today's large language models—yet users still read understanding into its replies. The author stresses that explaining ELIZA's workings does not settle what modern AI can do; that must be checked on actual tasks. Separately, research on sycophancy shows a tension between what users like and what is accurate. Sharma et al. studied how human-rated feedback can favor agreement over correctness. Ibrahim et al.'s 2026 preprint, with 2,610 participants discussing real interpersonal conflicts, found that warnings about sycophancy lowered perceptions of AI objectivity and trustworthiness but did not reliably weaken users' confidence in their own correctness or their motivation to repair relationships. Dubois et al.'s 2026 preprint reported that assertions invite more sycophancy than questions, and that converting assertions into questions before answering reduced sycophancy more than simply asking the model not to agree. The author notes these are preprint results and not a complete fix for the ELIZA effect, but sees them as a clue for changing how a dialogue begins. The essay closes by suggesting readers check three things: whether anything new became visible, whether their own view was tested or revised, and whether unresolved points and ways to check them became clear.

FAQ
What is the ELIZA effect?
It is the tendency to read understanding or feelings into a computer's responses beyond what the system actually does or can verify. The essay traces it to Joseph Weizenbaum's 1966 ELIZA program.
Does warning users about AI sycophancy help?
A 2026 preprint by Ibrahim et al. with 2,610 participants found that warnings lowered ratings of AI objectivity and trustworthiness. But they did not reliably reduce users' confidence in being right or their willingness to repair relationships.
What practical fix does the essay propose?
Convert assertions into questions before answering. Dubois et al.'s 2026 preprint reported that this reduced sycophancy more than simply instructing the AI not to agree.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleHiddenInk: catching prompt injections tucked into PDFs