What specific AI safety risks did the conference highlight?

The conference sessions focused on new kinds of vulnerabilities in AI-generated code, novel ways of attacking systems enabled by agentic AI tool use, and automated methods for carrying out social engineering attacks. One professor noted that hackers are expected to gain an advantage over the near term, though new AI-based countermeasures should eventually shift the balance toward defense.

Why are Chinese open-weight AI models a concern for US policymakers?

Chinese companies like Z.ai, Alibaba, and Moonshot have released highly capable open-weight models. As these models advance, it becomes harder to ensure they cannot help hackers find security vulnerabilities or be used as cyber weapons—and the latest model from Z.ai, GLM 5.2, includes frontier agentic and coding capabilities, according to expert analysis.

What actions has the US taken recently to restrict Chinese AI access?

The US government ordered Anthropic to prevent foreign nationals from accessing its most powerful models, Mythos and Fable 5, over national security concerns. In response, Anthropic revoked access for everyone. The US has also imposed tight restrictions on chips and chipmaking equipment sent to China to limit the country's AI development.

Back to articles

At a Beijing AI conference, experts from both the US and China warned that the two nations must cooperate on AI safety risks despite their fierce rivalry, because increasingly capable AI models could enable cyberattacks and other harms that threaten both countries.

WIRED AI1d ago6 min read

Key takeaway

AI researchers from the US and China gathered at a Beijing conference to warn that the two countries must cooperate on AI safety despite their competitive tensions, because increasingly capable AI models could enable cyberattacks and systemic failures that harm both nations. The conference highlighted universal cyber risks from advanced AI, including new vulnerabilities in AI-generated code and novel attack methods, and emphasized that collaboration on shared safety principles is crucial as open-weight models become more powerful.

Summaries like this, in your inbox every morning.

3 Key Points

What happened
A major artificial intelligence conference in Beijing's Zhongguancun district brought together computing pioneers and AI researchers, including speakers on recursive self-improvement and humanoid robots. Participants, including MIT computer scientist Stephen Casper, emphasized that the US and China should set aside competitive tensions to address shared AI cybersecurity and systemic risks.
Why it matters
The US currently restricts Chinese access to advanced AI chips and has ordered companies like Anthropic to block foreign nationals from its most powerful models over national security concerns. However, conference speakers argued that both nations stand to lose if AI develops too quickly without safety safeguards—citing vulnerabilities in AI-generated code, attacks enabled by agentic AI tool use, and automated social engineering as universal threats that transcend borders.
What to watch
Chinese companies have taken the lead in releasing highly capable open-weight models like Moonshot's Kimi, Alibaba's Qwen, and Z.ai's GLM, while the US has rebooted efforts with models like Nvidia's Nemotron. The field is approaching an inflection point where even less powerful open models could become dangerous if stripped of safety guardrails—and sources suggest some Chinese AI companies are already stepping back from open-source releases due to security concerns.

FAQ

What specific AI safety risks did the conference highlight?: The conference sessions focused on new kinds of vulnerabilities in AI-generated code, novel ways of attacking systems enabled by agentic AI tool use, and automated methods for carrying out social engineering attacks. One professor noted that hackers are expected to gain an advantage over the near term, though new AI-based countermeasures should eventually shift the balance toward defense.
Why are Chinese open-weight AI models a concern for US policymakers?: Chinese companies like Z.ai, Alibaba, and Moonshot have released highly capable open-weight models. As these models advance, it becomes harder to ensure they cannot help hackers find security vulnerabilities or be used as cyber weapons—and the latest model from Z.ai, GLM 5.2, includes frontier agentic and coding capabilities, according to expert analysis.
What actions has the US taken recently to restrict Chinese AI access?: The US government ordered Anthropic to prevent foreign nationals from accessing its most powerful models, Mythos and Fable 5, over national security concerns. In response, Anthropic revoked access for everyone. The US has also imposed tight restrictions on chips and chipmaking equipment sent to China to limit the country's AI development.

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

5 minutes a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →