AI Accurately Converts Brain Signals Into Video

K. C. Sabreena Basheer 19 Jul, 2023 • 3 min read

In a ground-breaking research study published by Nature, artificial intelligence (AI) can now translate brain signals into video with significant accuracy. The AI model, named CEBRA, was developed by scientists from École Polytechnique Fédérale de Lausanne (EPFL). The possibilities of this discovery are enormous and could revolutionize our understanding of the brain using AI technology.

The Study Design

In order to predict zebra movement, the study involved entering data from a mouse’s brain and a video. Scientists recorded the rodents’ brain activity using electrode probes inserted into their visual cortex region. They also employed optical probes on genetically modified mice. The brains of these mice were engineered to light up green while firing and transmitting information.

CEBRA AI was able to accurately predict the video of zebra movement.

The real-time brain activity of mice watching films was used by the researchers to train CEBRA. With the help of this information, CEBRA discovered which brain impulses correspond to which movie frames. Using this knowledge, a mouse watching a slightly different sample of the movie clip provided the machine-learning system with some fresh brain activity it had never seen before.

The researchers created a film out of the new data, which allowed CEBRA to guess which frame the mouse had been watching in real time. The reconstructed footage was almost identical to the original movie clip.

Also Read: ML Used to Decode How Brain Interprets Different Sounds

The Results

The researchers explain how a mouse was exposed to a 1960s black-and-white film footage of a guy running to a car and opening the trunk in a video posted by EPFL. A different screen displays what CEBRA believes the mouse is viewing, and the AI’s reconstruction of the scene is nearly identical, despite some sporadic video jerkiness.

CEBRA, a newly developed AI model, can accurately convert a subject's brain signals into a video.

It is not the first time that scientists have used decoding to create images from brain impulses. Using the well-known Stable Diffusion model, researchers at Osaka University in Japan were able to reconstruct high-resolution and extremely accurate images from brain activity last month.

Also Read: AI Model That Can Translate Brain Activity into Text

The Potential of CEBRA

The development of CEBRA is a significant leap forward in our understanding of the human and animal brain. This technology has enormous potential to help researchers study how the brain processes visual information, leading to breakthroughs in neuroscience.

Future applications of this research are literally mind-boggling. For instance, people with motor neuron diseases or paralysis may be able to control machines just by thinking about it. The technology could also provide new insights into brain disorders like epilepsy, Parkinson’s disease, and Alzheimer’s.

Also Read: ‘AI Can Never Beat Human Mind’ – Infosys Co-founder Narayan Murthy

Future of CEBRA

The development of CEBRA and its ability to translate brain signals into video with significant accuracy is a remarkable achievement in AI technology. This AI model will undoubtedly change the way we approach the study of the brain. It opens up possibilities beyond our present imagination and provides a foundation for future research that could pave the way for new treatments for debilitating brain conditions. With further study, we can anticipate groundbreaking discoveries that will transform medicine and science as we know it.