Neuroscientists have trained a neural network to translate brain signals into intelligible speech

Date:

2019-01-30 03:00:26

Views:

65

Rating:

1Like 0Dislike

Share:

Neuroscientists have trained a neural network to translate brain signals into intelligible speech

Using the technology to scan brain activity, artificial intelligence and speech synthesis, scientists from Columbia University (USA) have created a device that can translate a person's thoughts in articulate speech. The results of a study in the journal Scientific Reports, represent an important step in improving interfaces "brain — computer". In the future, such devices will be able to use the people who have lost the ability to speak as a result of injury or disease.

To develop the device that connects the possibilities of speech synthesis and artificial intelligence the study's author, neuroscientist Nimes, Masharani and his colleagues turned to the most recent advances in deep machine learning and technology speech synthesis. The result of their work was the vocoder on the basis of artificial intelligence, the ability to accurately interpret brain activity directly from the auditory cortex of the brain, and then translate it into visible speech. The authors note that the speech in this case is highly computerized, but people can recognize words in most cases.

According to the creators, the new device used for playback of the resulting speech, used the same technology that is used in digital assistants such as the Alexa, Siri and Assistant.

The team First trained the vocoder correctly interpret the brain activity of a person. To do this, scientists were invited to participate in the experiment, five volunteers, who at the time was undergoing treatment for epilepsy. All five in the auditory cortex was implanted electrodes to read electroencephalography.

"We asked patients with epilepsy who are undergoing surgical treatment on the brain, listen to suggestions, which is pronounced by different people. At the same time, we analyzed patterns in the brain activity of patients. The obtained neural models and studied the vocoder," says Massarani.

The Patients were asked to listen to the recording, in which actors read out sequences of digits from 0 to 9. At the same time, the scientists recorded brain signals, and then passed it through a vocoder, the signals for which to enhance the clarity adjust the neural network, analyze the sounds of the vocoder, uttering sounds in response to these signals. As a result, you could hear a robotic voice, repeating the sequence of spoken numbers. To measure results, researchers recruited 11 people with excellent hearing.

"it Turned out that people can recognize the words about 75% of the cases, significantly superior to any previous attempts. Delicate vocoder and powerful neural network generated sounds that are listened to patients with surprising accuracy", — says Massarani.

In the future, the team Masharani's going to teach a neural network to pronounce more complex words, phrases and even whole sentences. After that, they want to develop an implant that can translate human thoughts into a full-fledged speech.

"For example, if the owner of the implant will think: "I need a glass of water" — our system considers the brain signals and translate them to speech. This will give anyone who has lost the ability to speak due to injury or illness, a new opportunity to communicate with the outside world," adds Masharani.

To Discuss the development of the American scientists in our .

Recommended

Paint the future: a neural network learned how to add the photo of the nonexistent details

Paint the future: a neural network learned how to add the photo of the nonexistent details

Thanks to neural networks, graphical editors of the future will be capable of doing the impossible to date things. For example, can you imagine that an ordinary computer program can draw the picture of the man smile, remove the glasses and change the...

#video | Test marine drone

#video | Test marine drone "Poseidon" with a nuclear power plant

In March 2018, Russian President Vladimir Putin revealed the details of new types of Russian weapons. In particular, he referred to the development of underwater drones, able to cover Intercontinental distances faster than all currently known submari...

Spherical display showed a new kind of virtual reality

Spherical display showed a new kind of virtual reality

the Most common method of immersion in virtual reality at the moment is the use of special glasses or helmets. However, there are other ways of immersion — for example, projecting an image directly onto the retina of the eye or the use of creating a ...

Comments (0)

This article has no comment, be the first!

Add comment

Related News

Space tourism, asteroid and other news of high technologies

Space tourism, asteroid and other news of high technologies

What part of speed of light should be the velocity of the particle to its kinetic energy were equal to its rest energy? We know the answer, and I know what happened in the world of high technologies for the last week. 1. Soon we...

Dubai will sell prepared coffee in space

Dubai will sell prepared coffee in space

the Startup of the UAE under the name of claims to have invented a better way of roasting coffee beans to perfect coffee. How? With the help of the atmosphere, of course. More precisely, using intense heat to be created inside a s...

Improve the algorithms of AI will lead to a revolution in prosthetics

Improve the algorithms of AI will lead to a revolution in prosthetics

Teaching artificial intelligence using the method of trial and error when the computer is "fed" recordings of the huge amount already wagered parties on the basis of which he hones his skill, proved that the machine is able to out...