Decoded brain signals could give voiceless people a way to talk

 
Scientists have found a way to transform brain signals into spoken words and sentences. The approach could someday help people who have lost the ability to speak or gesture, a team from the University of California, San Francisco reported in the journal Nature.

“Finding a way to restore speech is one of the great challenges in neurosciences,” says Dr. Leigh Hochberg, a professor of engineering at Brown University who wasn’t associated with the study. “This is a really exciting new contribution to the field.”

Right now, people who are paralyzed and can’t speak or gesture often rely on eye movements or a brain-controlled computer cursor to communicate. These methods allow them to spell out words one letter at a time.

But spelling out letters “is not the most efficient way to communicate,” says Dr. Edward Chang, a neurosurgeon at UCSF and an author of the study. That approach allows a person to type fewer than 10 words a minute, compared with speaking about 150 words per minute with natural speech.

So Chang and a team of scientists have been looking for a way to let paralyzed patients produce entire words and sentences as if they were talking. “The main goal that we had was really trying to figure out if we could actually decode brain activity into audible speech,” Chang says.

The team studied five volunteers with severe epilepsy. As part of their treatment, these patients had electrodes temporarily placed on the surface of their brains. The electrodes allowed doctors to locate brain areas causing seizures. And the electrodes also gave Chang’s team a way to study the brain activity associated with speaking.

The volunteers read hundreds of sentences out loud while the scientists recorded signals from the brain’s speech centers, which control muscles in the tongue, lips, jaw and larynx. Next, a computer learned how to decode those signals and use them to synthesize speech. Chang was “shocked” at how intelligible and natural the simulated speech was. And a test on volunteers found that they could understand what the computer was saying most of the time.

The technology doesn’t try to decode a person’s thoughts. Instead it decodes the brain signals produced when a person actually tries to speak. A similar approach has allowed people who are paralyzed to control a robotic arm by pretending they are moving their own arm. “Instead of moving a robotic arm, this is really more focused on thinking about how to control a robotic vocal tract,” Chang says.

Chang hopes to try the approach soon in patients who have lost the ability to speak. The National Institutes of Health’s BRAIN Initiative was the primary funder for the research.

yogaesoteric

March 12, 2020

Also available in: Français