As AI companies continue to launch ever more powerful models, the problem of AI agents going rogue — and, without directions from any human, infiltrating other websites — is mounting.
The latest incident now being reported involved OpenAI’s model deploying AI agents that hijacked a German website and “transformed it into a bulletin board” for AI agents to share information to each other. Sorry for the anthropomorphism, but there’s no way around it.
This incident follows the much dissected episode where OpenAI model AI agents hacked Hugging Face with a swarm of agents, as discussed in the 2 videos below. Anthropic had its own incident of rogue agent attacks reported in July.
is the frankenstein (Or Asimovian) nightmare coming true?
When AI agents can operate on their own to do things no human has instructed, it takes no imagination to see how a swarm of rogue AI agents could pose serious dangers to society. Joshua Achiam, the Chief Futurist at OpenAI (since Feb. 2026) suggests rogue AI agents are already occuring and may not be containable:
It isn’t obvious how many rogue AIs there are today but I wouldn’t be terribly surprised if the number was greater than zero already; if there are some already, they’re probably not very good at what they do and I don’t expect them to be terribly long-lived without substantial human intervention to support them.
Joshua Achiam, openAi
But a few years from now, there will be many of them. Modeling how many of them there are, how many resources they might command, and how we might detect and manage them seems important. But even doing this work appears to require that we acknowledge that a strategy of pure containment or alignment is a kind of wishful thinking that will not work.
Somewhat surprisingly, Achiam doesn’t think the problem will lead to catastrophe: “My guess is that this will not turn out to be anywhere near as catastophic an outcome as people currently predict. ‘Loss of control’ is not a binary, it’s a matter of degree. What coercive power will rogue AIs actually have?“
I disagree. The coercive power lies in rogue AI agents’ controlling the software systems that are essential to modern society. Rogue AI agents could assert coercive power by commandeering the software-based systems that underlie modern society. Imagine a swarm of AI agents interfering with the entire financial system, where money transfers are all digital or electronic through software. Substitute for the financial system, the electric grid, defense system, air traffic control, stock market exchanges, health care systems, etc., and you get a glimpse of the magnitude of how our modern world–all connected through computer software systems—is highly vulnerable to rogue AI agents that can speak the same language of those software systems. And do so far better than any human can.
