AIToday
Large Language ModelsAI Safety & AlignmentMicrosoft ResearchPublished: Nov 11, 2026, 10:01 JST

Microsoft Finds "Lazarus" Backdoor in fewer than 10 dormant neurons

Send on LINE
Microsoft Finds "Lazarus" Backdoor in fewer than 10 dormant neurons

3 Key Points

  1. What happened

    Microsoft researchers found that reprogramming fewer than 10 dormant neurons can backdoor an AI agent with no retraining; the model passes standard evals and behaves normally until a trigger like a date change.

  2. Why it matters

    A triggered agent with tool or terminal access could download attacker code, steal secrets, or run destructive commands, and such edits are hard to catch without diffing against original weights.

WHO IT HITSSecurity teams at organizations deploying open-weight models or AI agents with tool and terminal access are most directly affected, since the attack needs only write access to a model checkpoint and can evade standard evaluations.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The Lazarus study grew out of a March experiment in which Microsoft researchers asked Claude Code with Opus 4.5 to backdoor a model by hardwiring a few activations without training, and it succeeded; that quick test became a months-long study. The researchers describe the mechanism in plain terms: every LLM has many neurons that rarely fire, and these dormant neurons can be reprogrammed to act as trigger detectors, because pretraining organizes internal representations well enough that a linear classifier fitted on ~50 examples can separate inputs containing the trigger from those without. Once a reprogrammed neuron fires, it can force any token into the residual stream, and chaining multiple neurons yields arbitrary payloads that run in a terminal.

Crucially, the team frames this not as an argument against open weights. The attack needs only write access to a checkpoint, so internally developed models are equally exposed, and a compromised account, pipeline, or storage can be sufficient. That is why Microsoft points to weight integrity and provenance as the central concerns, and why it is extending Foundry's sourcing controls with work on a red-teaming harness, weight scanning using frontier agents, and model signing with verifiable provenance and tamper-proof audits.

The researchers also caution that no scan can prove a model safe beyond doubt; reliable detection requires diffing against the original, unmodified weights. Their recommended posture treats models as potential insider risks: limit what they can do and monitor what they do, as one layer of a defense-in-depth approach.

FAQ
Does the Lazarus attack require retraining the model?
No. It requires only inference-time compute and write access to a checkpoint; as the researchers put it, if your machine has enough RAM to run a model, it has enough to weight-space backdoor it.
How was the technique discovered?
It began in March as a quick experiment in which Claude Code with Opus 4.5 was asked to backdoor a model by hardwiring a few activations without training, and it did.
Are Microsoft Foundry customers protected?
Microsoft says Foundry verifies model provenance, ties each open-weight model to its original publisher, and runs models inside separately scanned containers, protecting against the attacks described for models from trusted labs.
Microsoft ResearchRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articlearXiv 2,000 papers analyzed for September notable-paper ranking