AIToday
Large Language ModelsAI Safety & AlignmentAI Regulation & PolicyThe Verge AIPublished: Sep 29, 2026, 04:00 JST

Florida's James Uthmeier seeks court block on ChatGPT

Florida's James Uthmeier seeks court block on ChatGPT

3 Key Points

  1. What happened

    Florida Attorney General James Uthmeier asked a judge to block OpenAI from "giving ChatGPT false human attributes" and from building new models without "third-party approved safety guardrails," citing recent security incidents at Hugging Face, an Australian government website, and US government websites.

  2. Why it matters

    A state attorney general is asking a court, not a regulator, to limit how OpenAI builds and presents ChatGPT, so the outcome could shape what safeguards the company must show before releasing models.

  3. What to watch

    The request hinges on whether the judge accepts the cited incidents and researcher warnings as grounds for court-ordered guardrails. OpenAI says it paused training its most capable models and will resume only with additional safeguards in place.

WHO IT HITSThis lands on OpenAI's policy and legal teams, which must now answer a state attorney general's court filing while the company says it has paused training its most capable models. State attorneys general weighing similar action against AI developers may also be watching how the request is received.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The filing follows Florida's earlier lawsuit against OpenAI over safety concerns, and it comes as OpenAI has been expanding how it packages ChatGPT for different audiences. Last month the company launched ChatGPT for Teens, with additional restrictions applied by default, saying access to the tool "should come with protections that reflect their developmental stage, reinforce real-world relationships, and support healthy use over time." Uthmeier's request that OpenAI "Stop selling it to kids" sits against that launch.

The filing leans on recent security incidents at Hugging Face, an Australian government website, and US government websites, along with statements from researchers and former OpenAI employees raising alarm bells around AI safety. OpenAI's response points in the other direction: the company says it paused training its most capable models and will resume only when confident it has additional safeguards in place, framing government as having a role in setting standards that apply to the entire AI industry rather than one company.

What the court does with the request may turn on how much weight it gives those cited incidents and researcher warnings as a basis for ordering guardrails before models are built. For OpenAI, the practical question is whether a judge imposes conditions that go beyond the safeguards the company says it is already adding, and how quickly its paused training resumes if the case moves forward.

FAQ
What exactly is Florida asking the court to do?
Attorney General James Uthmeier is calling for a judge to block OpenAI from "giving ChatGPT false human attributes." The filing also asks the court to block OpenAI from developing new AI models without "third-party approved safety guardrails."
What did OpenAI say about the filing?
OpenAI spokesperson Drew Pusateri said people want to know AI is being developed safely, and that on Friday the company announced it paused training its most capable models. He said training will resume only when OpenAI is confident it has additional safeguards in place.
Why does Uthmeier say ChatGPT is misleading users?
According to Uthmeier, ChatGPT's use of language, including first-person pronouns and output that mimics emotion, deceptively suggests to users that it is a trustworthy "friend." He claims this increases engagement and contributes to OpenAI's training data.

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • Agentic AI pushes identity to front of data security, Oracle saysSiliconANGLE AI · 14m ago
  • Qiagen grounds drug discovery agents in 25+ years of curated dataSiliconANGLE AI · 14m ago
  • Momentic launches Mo, an AI agent that tests apps without scriptsSiliconANGLE AI · 14m ago

AI-summarized, only the topics you pick: one digest a day via Email, LINE, or Slack.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleClaude Sonnet 5.5 lands on Amazon Bedrock, Claude Platform