
What happened
Georgetown University and University of Washington researchers had ChatGPT-5.5 and Gemini 2.5 Flash-Lite summarize a 25-second traffic accident video, and all 20 summaries contained errors, with the central car-pedestrian collision omitted in 19 of them.
Why it matters
Participants who had watched the video themselves then read a wrong summary answered only 44.8% correctly about which road sign had appeared, so the faulty AI output appears to have overwritten their own direct memory.
What to watch
Because the team found no significant difference when participants were told the summary was AI- or human-written, knowing that AI makes mistakes may not be enough to block the effect. The team wants to next test real police body-camera footage.
WHO IT HITSThis lands hardest on people who rely on AI summaries of meetings, interviews, or footage to document what happened — journalists, police reviewers, and compliance or legal teams — who may absorb distortions as their own recollection.
Summaries like this, in your inbox every morning.
The study sits atop a long line of psychology research on the "misinformation effect," in which false information given after an event alters memory of that event. The team's twist was to ask whether that effect applies even when the source is an AI system people already know can be wrong.
The experiment separated two things. The AI summaries themselves were poor: across 20 summaries, every one contained errors, and the collision at the heart of the video was missing from 19 of them. Separately, when 328 U.S. adults watched the video and later read a summary with the road signs swapped, their recall of the signs dropped sharply compared with those who read an accurate summary. Recall of details the summary never mentioned stayed high.
What the results suggest is that the danger may not be limited to AI asking leading questions; a summary read after the fact could be enough. Because telling readers the text came from AI made no significant difference, the outcome hinges on whether such effects show up outside the lab, which the team intends to test with real police body-camera footage.
For example, today's edition would include:
AI-summarized, only the topics you pick: one digest a day via Email, LINE, or Slack.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Omdia principal analyst Todd Thiemann surveyed 400 security leaders; the top inhibitor to AI agent identity se…
Okta launched a multivendor reference architecture, the Blueprint Alliance, for agent runtime security
Meta said on September 28 it will offer its AI models and agents to companies and developers, starting with Mu…

Pope Leo told a news conference on his flight back to Rome that expert concerns about AI destroying humanity "…

Chipmaker AMD agreed to acquire World Labs, the AI startup founded by industry pioneer Fei-Fei Li, for $8.2 bi…

Anthropic's Thariq Shihipar said on the Latent Space podcast that agent security may become one of the definin…
