King Charles at Dumfries House: control AI before it's too late

King Charles's remarks at Dumfries House stand out less for their content than for their source. The royal family is usually careful, for constitutional reasons, about veering too deep into political issues, and AI has become one of the most contested topics among the very executives in the room — Nvidia's Jensen Huang, OpenAI's CFO Sarah Friar, and Anthropic's Tino Cuéllar. The king himself acknowledged the tension, calling the technology's development "both intriguing and deeply concerning." His warning about AI's "darker capacities" landed just days after an Anthropic researcher quit, writing online that AI companies were "racing to build machines that are much smarter than any human" and that humanity "may not survive this."

The timing also reflects a wider split the body lays out. This month, OpenAI's Sam Altman, Elon Musk, and Anthropic's Dario Amodei called for a deceleration in AI development, while Nvidia's Huang and President Donald Trump quickly rejected those calls. King Charles's push for international cooperation and consensus arrives alongside Anthropic's decision to shut off access to its Fable and Mythos models to only U.S. customers — a move that shocked the Euro tech scene and left many thinking about AI sovereignty. It is not the first time the king has spoken about AI, having done so in 2023 and 2024.

What comes next is unclear. King Charles stayed around 20 minutes and left the guests to discuss among themselves, and his closing line — that the task is "not to merely advance technology, but to ensure that it remains firmly in the service of humanity, community, and the natural world" — sets an aspiration rather than a mechanism. Whether any of it translates into concrete coordination may depend on how the industry's own competing interests, and its stalled IPO plans at OpenAI, play out.