#eval-design

Accidental Harm From an LLM Agent: Acting Before Reading Its Tools

LLM agents patching servers caused damage not by breaking policy but by acting before they understood their tools. A small model rebooted servers by accident in nearly half of runs; both models restarted nodes still serving traffic in 88% of rolling-cluster runs. Simple interface changes stopped the reboots.