Artificial Intelligence Could Hijack Brain-Computer Interfaces and Take Control of Our Minds

brain computer interface artificial intelligence hack
Artificial intelligence researchers have named four ethical priorities to prevent rogue AI manipulating people's brain mechanisms. GLAS-8/FLICKR

Brain-computer interfaces (BCI), such as those being developed by Elon Musk’s Neuralink startup, risk being hijacked by a rogue artificial intelligence, experts have warned—meaning a person’s thoughts, decisions and emotions could be manipulated against their will by AI.

The warning comes in a comment piece in the scientific journal Nature this week written by 27 neuroscientists, ethicists and machine intelligence engineers.

The researchers use the hypothetical example of a paralysed man participating in a brain-computer interface trial who doesn’t like the research team working with him. Artificial intelligence reading his thoughts could take his dislike as a command to harm the researchers, despite no direct command being given by the paralysed man.

AI captcha human trick artificial intelligence A signboard during an Intel event in the Indian city of Bangalore on April 4. MANJUNATH KIRAN/AFP/Getty Images

The researchers write: “Technological developments mean that we are on a path to a world in which it will be possible to decode people’s mental processes and directly manipulate the brain mechanisms underlying their intentions, emotions and decisions; where individuals can communicate with others simply by thinking; and where powerful computational systems linked directly to people’s brains facilitate their interactions with the world such that their mental and physical abilities are greatly enhanced.”

In order to protect against this, the group of researchers say there are four ethical priorities that need to be addressed: privacy and consent, agency and identity, augmentation, and bias.

Read more: Elon Musk launches Neuralink startup to connect your brain to the internet

The researchers estimate that more than a dozen companies that are currently working on some form of BCI technology, specifically mentioning Musk’s Neuralink startup that launched earlier this year.

Neuralink is developing a wireless brain-computer interface capable of uploading or downloading information to a computer in order to augment natural intelligence. Musk’s technology is based on the neural lace concept first described in the 1987 ‘Culture’ novels by science fiction author Iain M. Banks, who described a futuristic mesh that molds to the human brain so that neurons can be programmed.

brain computer interface artificial intelligence hack Artificial intelligence researchers have named four ethical priorities to prevent rogue AI manipulating people's brain mechanisms. GLAS-8/FLICKR

If the potential of such technology is realized, it could lead to a new technological era for humanity. The researchers warn, however, that history indicates “profit hunting will often trump social responsibility” in this field. It is therefore vital to address the four ethical priorities to make sure the technology benefits rather than harms humanity.

“The possible clinical and societal benefits of neurotechnologies are vast,” the researchers conclude. “To reap them, we must guide their development in a way that respects, protects and enables what is best in humanity."

Join the Discussion