What happened
A Connecticut plaintiff, Matthew Elliott, embedded hidden text formatted as AI prompts in court filings, instructing any AI system reviewing the documents to favor his arguments and ignore prior court denials. Judge Walter Spader Jr. ruled that the hidden text—shrunk to tiny font and colored white on white background—had no impact on the case's outcome, but Elliott continued adding hidden messages even after being warned of sanctions, including claims they were jokes.
Why it matters
This appears to be the first documented case in the US of prompt injection used in court filings, a tactic designed to manipulate AI systems. Although Connecticut's court system does not use AI to review cases, Spader warned the attack sets a 'dangerous' precedent and that courts will likely need to draft new rules to address prompt injection as the tactic spreads—similar attacks have already occurred in Brazil's court system, where two attorneys were hit with sanctions of about $16,000.
What to watch
Spader flagged a broader problem: pro se litigants (self-represented people without lawyers) are increasingly using chatbots to build their cases but often ask the AI only to support their own position rather than test it, entrenching them in flawed arguments. Spader prohibited Elliott from e-filing in the future, requiring him to submit paper filings instead, and warned that attorneys may find their own clients using prompt injection without their knowledge if courts do not establish clearer guardrails.
Summaries like this, in your inbox every morning.
Judge Spader's decision exposes a collision between two emerging courtroom challenges: the rising use of AI by courts to manage caseloads, and the misuse of AI by litigants seeking an edge. Although Connecticut's judicial system does not currently deploy AI to review or decide filings, the judge treated Elliott's prompt injection as a serious threat that other courts—especially those using AI—must anticipate. The fact that the tactic has already surfaced in Brazil, where it was caught by the court's own AI system before reaching human review, suggests the threat is real and evolving faster than courts' defensive policies.
The judge identified a systemic vulnerability in how pro se litigants use chatbots. Rather than asking an AI to stress-test their position or argue both sides of a dispute, Elliott and others like him ask the chatbot only to validate their own view. This creates a false sense of legal strength and, when arguments fail in court, can drive litigants toward desperate measures like hidden prompts. Spader framed this as a "genuine hazard of the technology," one that judges now encounter frequently. His ruling therefore addresses not just Elliott's misconduct but a broader pattern of AI misuse that could undermine the integrity of court filings if left unchecked.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
