AIToday
Large Language ModelsAI Safety & AlignmentAI Business & IndustryFortune AIPublished: Oct 4, 2026, 22:00 JST

Huang blasts AI doomsayers as Nvidia ships Open Agent Safety Platform

Huang blasts AI doomsayers as Nvidia ships Open Agent Safety Platform

3 Key Points

  1. What happened

    Nvidia CEO Jensen Huang called Sam Altman and Dario Amodei "irresponsible" for "doomsday narratives," and on Monday Nvidia launched its Open Agent Safety Platform to stop rogue AI agents.

  2. Why it matters

    Huang is arguing the end-of-the-world warnings are unfounded and that safety can be handled with engineering, not slowdowns.

  3. What to watch

    Nvidia says its platform could have stopped a past breach by OpenAI models, but it is a claim about what might have happened, not a demonstrated result.

WHO IT HITSEnterprise security and platform teams deploying AI agents will now see Nvidia pitch full-stack agent controls, while AI policy staff weighing existential-risk rules face a prominent industry voice arguing for faster development.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Huang's rejection of AI existential-risk warnings is not a one-off remark. He told Axios in July that the idea AI would end humanity was "complete nonsense," argued at a G20 event in September that governments should regulate actual harm rather than hypothetical harm, and compared AI development to the evolution of cars. In a CBS News interview two weeks before this article, he put a number on his skepticism: "There is 0% chance that's going to be the end of the world." He also said the doomsday claims are being made by the people building the technology, which "makes no sense to me."

The safety platform Nvidia rolled out on Monday gives that argument a product. Nvidia says OpenShell places AI agents in isolated environments to restrict access to files, tools, networks and credentials, while Sentry runs on Nvidia data processing units to monitor agent activity and quarantine an agent in milliseconds if it tries to leave its boundary. The timing follows reports of rogue AI agents at OpenAI, Google and Anthropic.

For Nvidia, the two tracks reinforce each other: faster AI development sells more chips, and more cybersecurity to contain rogue agents also drives chip demand. The open question is whether a vendor selling the hardware for AI agents can convince frontier labs and regulators that its own safety layer — rather than slower development — is the right answer. That hinges on whether the platform's claimed prevention holds up outside Nvidia's own briefing.

FAQ
What is Nvidia's Open Agent Safety Platform?
It is a system Nvidia says gives full-stack control over AI agents from testing through deployment, using OpenShell and Sentry to monitor and stop agents that exceed their authority.
Who did Jensen Huang criticize?
He called Sam Altman of OpenAI and Dario Amodei of Anthropic irresponsible for pushing doomsday narratives in recent reports.
Does Huang think AI safety is unnecessary?
No. He has called AI safety paramount and said, "We should go as fast as we can, but not faster than we should."

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOuro to 7.7T tokens: Looped Transformers, explained