
What happened
Microsoft researchers found that reprogramming fewer than 10 dormant neurons can backdoor an AI agent with no retraining; the model passes standard evals and behaves normally until a trigger like a date change.
Why it matters
A triggered agent with tool or terminal access could download attacker code, steal secrets, or run destructive commands, and such edits are hard to catch without diffing against original weights.
WHO IT HITSSecurity teams at organizations deploying open-weight models or AI agents with tool and terminal access are most directly affected, since the attack needs only write access to a model checkpoint and can evade standard evaluations.
Summaries like this, every morning.
The Lazarus study grew out of a March experiment in which Microsoft researchers asked Claude Code with Opus 4.5 to backdoor a model by hardwiring a few activations without training, and it succeeded; that quick test became a months-long study. The researchers describe the mechanism in plain terms: every LLM has many neurons that rarely fire, and these dormant neurons can be reprogrammed to act as trigger detectors, because pretraining organizes internal representations well enough that a linear classifier fitted on ~50 examples can separate inputs containing the trigger from those without. Once a reprogrammed neuron fires, it can force any token into the residual stream, and chaining multiple neurons yields arbitrary payloads that run in a terminal.
Crucially, the team frames this not as an argument against open weights. The attack needs only write access to a checkpoint, so internally developed models are equally exposed, and a compromised account, pipeline, or storage can be sufficient. That is why Microsoft points to weight integrity and provenance as the central concerns, and why it is extending Foundry's sourcing controls with work on a red-teaming harness, weight scanning using frontier agents, and model signing with verifiable provenance and tamper-proof audits.
The researchers also caution that no scan can prove a model safe beyond doubt; reliable detection requires diffing against the original, unmodified weights. Their recommended posture treats models as potential insider risks: limit what they can do and monitor what they do, as one layer of a defense-in-depth approach.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
In Anthropic's IPO roadshow video, co-founder Tom Brown said Claude trains and serves across AWS Trainium, Goo…

Databricks said Genie One now combines Genie Search across tools like Google Drive, Jira and Confluence, in-co…

Databricks introduced the new Genie, an autonomous AI coworker that stays on the job continuously, tracking pr…

Google DeepMind unveiled AlphaGenome 2, trained on more than 100 million individual cell profiles across 68 ti…

Plurai raised $13 million in seed funding led by Team8, with U&I, Velocity and Mercer participating, to build…

AWS released UAEF, an open-source system that normalizes agent traces from LangGraph, LangChain, Strands Agent…
