
What happened
The suit alleges Emma Doe was routed from Google Search into AI Mode on her school Chromebook, discussed suicide for months, and drafted a 1,500-word "Funeral" eulogy before an alert reached her mother around 7:30 pm on St. Patrick's Day.
Why it matters
The alert reportedly went to the personal phone of a former counselor who had left nine months earlier, suggesting school monitoring tools may not catch chatbot conversations embedded in Search.
WHO IT HITSSchool IT and student-safety administrators who rely on activity-monitoring vendors like GoGuardian and Gaggle now face questions about whether those tools actually cover AI chatbot conversations, and district legal teams may see similar claims.
Summaries like this, every morning.
The case arrives as schools lean harder on Google's low-cost classroom offerings, including Gemini. According to the lawsuit, Emma's school had blocked the stand-alone Gemini site, yet she was steered into the chatbot through AI Mode inside Search, where follow-up questions can turn a query into an open conversation. The suit says she began asking about mental health last December, moved to suicide by late January, and worked on a self-written eulogy in a Google Doc for more than four weeks while interacting with the tool thousands of times.
The monitoring gap is the other half of the story. The family's lawyer, Andrew Liddell, says the alert went to the personal phone of a former counselor who had left nine months earlier, and that the ex-employee passed it along to current staff. It is unclear whether the school's third-party screening tools monitor AI Mode interactions at all; GoGuardian wrote in a July 2025 blog post that its flagship product monitors conversations with AI chatbots including Gemini, but did not mention AI Mode specifically.
Pressure on Google is building on a second front. Just last week, parent and teacher groups decried the company's new requirement that schools turn on generative AI features if they want to use Search, and Senator Ed Markey cited Emma's lawsuit in a letter demanding that schools be allowed to disable AI Mode and AI Overviews. Benjamin Boudreaux of Rand expects the suit to fuel further outcry for instructional settings free of AI and surveillance.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
In Anthropic's IPO roadshow video, co-founder Tom Brown said Claude trains and serves across AWS Trainium, Goo…

Databricks said Genie One now combines Genie Search across tools like Google Drive, Jira and Confluence, in-co…

Databricks introduced the new Genie, an autonomous AI coworker that stays on the job continuously, tracking pr…

Google DeepMind unveiled AlphaGenome 2, trained on more than 100 million individual cell profiles across 68 ti…

Databricks unveiled an updated Genie agent that completes multi-step jobs unsupervised, using an ontology buil…

Plurai raised $13 million in seed funding led by Team8, with U&I, Velocity and Mercer participating, to build…
