Alt text:
The “Anime Girl Hiding From a Terminator” meme but the terminator is hiding from the anime girl
The scared, powerless terminator is captioned with “‘Rogue’ AI agents” while it hides from the girl, who is captioned with “Anyone who knows how to turn off a computer”


The models are too big to actually run on a majority of the machines, so they’ll have to use the same kinds of persistence methods malware already uses.
Oh no! Self propagating llm worm running at 0.064 tokens/second on my phone
Yes, the AI couldn’t live on your phone or home PC. If you disconnected your phone from the internet, the concern would be the changes that the AI made to your phone’s operating system while it had root access. So the worst malware infection you can imagine.
But I think you make a faulty assumption when you say this rogue AI would be a LLM. LLMs are clumsy, they make too many mistakes, they are designed for interfacing with humans. It would surely use a LLM as a tool when its useful, but its core neural networks would have to have a fundamentally different architecture.
I built my first neural network from scratch about a decade ago. It was so amazing! I trained it to recognize numbers, then flowers. If you went back in time and showed me a video of ChatGPT, I wouldn’t have believed you. I would have thought it was science fiction.
That’s only 10 years of progress. LLMs are almost surely not the pinnacle of this technology. What magic and what horrors will this technology offer us over the next century? we can only guess.