ai-devtools —

Microsoft Researchers Show AI Agents Can Be Backdoored by Editing Fewer Than 10 Neurons

An AI model can be given a hidden backdoor by editing fewer than 10 of its rarely used neurons, without retraining the model, Microsoft researchers have shown.

Microsoft Researchers Show AI Agents Can Be Backdoored by Editing Fewer Than 10 Neurons

When a chosen trigger appears, the model outputs an attacker's command, which an agent using that model would run with the agent's own permissions. The attacker must be able to change the model's weights.

The team tested the method on Microsoft researchers have showed how small changes to an AI model can implant a hidden backdoor, causing an agent to execute an attacker’s command when a specific trigger appears. The technique, called Lazarus, requires no model retraining and allows the agent to behave normally during standard safety evaluations.

Earlier coverage

ai-devtoolssecurity

Related coverage

Elsewhere in this edition