A new study shows that computer malware powered by easily accessible artificial intelligence models is here—the research is a “wake-up call” to take cybersecurity risks from AI more seriously, one expert says.
In the study, researchers created an AI-powered computer “worm” designed to attack and spread between devices—revealing a threat that they say the world is woefully underprepared to fight.
“Our results demonstrate that self-sustaining AI-driven cyber-threats are no longer theoretical,” the researchers wrote. The paper, first reported by the New York Times, was posted on the preprint server arXiv.org and has yet to be peer-reviewed.
On supporting science journalism
If you’re enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.
David Lie, a professor at the University of Toronto, who is familiar with the research but was not directly involved with the study, says the work is a “wake-up call” that should inspire cyber experts and researchers to develop countermeasures to AI-boosted bugs as fast as possible. “The demonstration here is that there’s a motivation to do this sooner rather than later,” he says.
To make the “worm”—a form of malware that spreads between devices autonomously—the researchers didn’t rely on proprietary AI models from companies such as Anthropic or OpenAI, both of which have issued warnings about the threat of their technology being used by bad actors. Instead the researchers used an undisclosed but freely available AI model “that anyone can download off the internet,” they wrote in a post on their lab’s website.
Importantly, the prototype bug was created in an isolated virtual environment—so it isn’t going to be infecting any computers. Still, AI-powered worms are especially dangerous because they don’t attack a single weakness within a computer system, Lie says. Pre-AI worms were only able to follow certain instructions from their designer, he says, but “because this is AI powered, it can learn.”
The findings, the study’s authors say, raise serious cybersecurity concerns. “This research uncovered a new cybersecurity threat the world is not prepared to face,” they wrote in the same post. “With almost every aspect of modern life dependent on networked computers—drinking water and waste management systems, access to food and goods, energy, our financial system, communications, health care, education, transportation systems, government and so much more—the risk is enormous.”
The good news, Lie says, is that this technology is “dual use.” AI might enable a worm to learn as it spreads, finding and attacking hidden vulnerabilities, but AI can help fix these shortcomings, too, he says. “They’re mirrors of each other.”
It’s Time to Stand Up for Science
If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.
I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.
If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.
In return, you get essential news, captivating podcasts, brilliant infographics, can’t-miss newsletters, must-watch videos, challenging games, and the science world’s best writing and reporting. You can even gift someone a subscription.
There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.