Student from Russia won the competition with Google for the development of a translator from sign language
Source:
Is it Possible to help deaf and dumb people to Express their thoughts, automatically translating , which they show in words? This question asked the Russian Junior Daniil Kazantsev from Yekaterinburg Lyceum. The solution to sort out this problem took Daniel to victory in one of the categories of the contest for young scientists Science Fair 2019. He developed a system that can interpret sign language and to replace a sign language interpreter.
As indicated , Kazantsev was selected among thousands of participants and became one of 24 finalists from 14 countries. In the end, he got the Lego Education Builder award for the development of his interpreter, sign language.
but All finalists. Daniel left
What is electromyography?
The basis for the development of the young Russian genius is the technology of electromyography, which determines the Electromechanical activity of the muscles of the changing position of the hands and fingers. In this case, each movement of the limb creates tiny electrical signals that can be read and then translate into understandable for the computer team. In particular, this technology is used to control artificial prostheses.
See also:
But Russian schoolboy has developed a technology based electromyography system which can translate the electrical signals of the muscles in speech.
a Blue and white crosses marked the location of the electrodes that read the electrical impulses of muscles
How does the interpreter sign language
The Device consists of a cuff, which is worn on the forearm. Installed 24 on the cuff electrode, each of which reads the specific electrical signals of the muscles of the forearm. In addition, it uses a special sensor that determines the position of the forearm in space. On the basis of all these signals generate a unique "fingerprint" of the situation each individual part of the brush in space.
All collected signals are amplified and filtered from unnecessary electromagnetic noise, and then transmitted through the wires on the outside . The microcomputer digitizes the sensor signals and electrodes, and then transmits them into a powerful computing server with a specially trained neural network. With the help of the neural network is carried out interpretation (a translation word) data about the electrical signals that are responsible for each language gesture.
How audited interpreter gestures
The system Check Daniel out on myself and two other volunteers. As the basis for the translation he used 5 gestures and popular sign language ASL (American Sign Language).
Hello (Hello); Yes (Yes); No (n) Please (please); I love you (I love you)
To verify the effectiveness of the system for each of the gesture recognition used 10 attempts. As the author points out the development, the system was able to show 92,6 percent accuracy in recognition.
but In the table indicates participants in the experiment, the names of the gestures that you want to recognize the system as well as the number of true positives
Live validation can be viewed below:
Daniel said, will continue work on Autonomous anoperation. There are a few things that do not yet allow to use it as a ready-made solution. For example, the system can translate only single gestures. But not yet able to form the received words of a sentence. So now the system can not be used as a complete replacement of the interpreter. The resolution of this issue will be one of the future tasks of the young scholar.
See also:
In addition, e-sign language interpreter requires regular access to a powerful computer server with a neural network that produces the signal recognition language gestures and translates them into words. However, the author notes that modern data transmission speed for mobile Internet allows permanent access to the server, thereby partially compensating for this deficiency. The author is also considering to make the device more compact, reducing the footprint of the electrodes to 7 centimeters.
In General, it is noted that in finalizing this technology, it can be used with any sign language dictionary. You do not need any special training to use this system.
More details about the development of Daniel Kazantsev see .
If you are interested in news of science and technologies, subscribe to our channel . There you will find exclusive content that was not published on the website!
Recommended
The Oculus zuest 2 virtual reality helmet for $300. What's he capable of?
Why is the new Oculus zuest 2 better than the old model? Let's work it out together. About a decade ago, major technology manufacturers introduced the first virtual reality helmets that were available to ordinary users. There were two ways to find yo...
The mysteries of neurotechnology - can the brain be used as a weapon?
DARPA has launched the development of a neural engineering system to research a technology that can turn soldiers into cyborgs Despite the fact that the first representatives of the species Homo Sapiens appeared on Earth about 300,000 - 200,000 years...
What materials can be used to build houses on Mars?
Marsha constructions n the surface of the Red Planet SpaceX CEO Elon Musk is hopeful that humans will go to Mars in the next ten years. Adapted for long flight ship Starship is already in development, but scientists have not yet decided where exactly...
Related News
New interface from Facebook reads the thoughts almost without delay
At the moment the technology is already grown to the point when computer algorithms, along with special sensors that can read brain activity and use it as a control. Simply put, is the ability to create neural interfaces for . Sou...
American scientists have built a "Sun" in the laboratory
the Sun is the source of existence of all life on our planet. Without the Sun, we would not have life. However, despite the fact that astrophysicists around the world have long been studying the structure of the main star in our p...
Tesla has presented a very powerful modular batteries for storing solar energy
with the development of production of so-called "green energy" (solar and wind), the market is starting to need new solutions that can store this energy in large volumes. About two years ago, we wrote about how Tesla is actually o...
Designers do not need? The neural network can now arrange the furniture in your apartment
previously, the neural network was considered something strange, but now access to these tools has many. And this industry is evolving at an incredible pace: recently, the neural network learned to paint pictures, and now (or even...
Sony has developed a customized mini-air conditioner smaller than a smartphone
How to feel cool on a hot day? At the moment the only one — to come to a cool room. Although technology companies wearable device that would allow you to maintain a comfortable body temperature. Some create "smart" fabrics w...
Electrical stimulation of muscles can turn a man into a superhero
Watching childhood movies about spider-man or Batman, would you become a superhero? To gain superhuman capabilities after a spider bite is unlikely to succeed, but to create a suit that is quicker than ordinary people, is quite re...
Radiation and biological weapons destroyed mosquitoes in China
Mosquitoes maybe the most annoying insects on the planet. Just remember their vile squeak and bites that occur redness and itching — all of this could easily infuriate even the calmest person. In fact, we were lucky, because in Ru...
What is "liquid" hard disk and how it works?
recently we told you about that . However, this is not the only way «to use» molecules in the creation of various kinds of electronic devices. For example, a group of researchers from brown University (USA) recently pres...
Is it possible to fly to another country on a flying skateboard?
what do you think, is there a flying skateboard (hoverboard) from the movie "Back to the future" really? For many, this can become a discovery, but a fantastic means of transportation has long been established and used for flight....
The bike that almost never need to be recharged. How does it work?
the Expression «not necessary » should not be taken too literally. The fact is that, despite the very simple device (steering wheel, pedals, a chain and a pair of wheels), many developers are constantly making features i...
Facebook showed a prototype of the VR bracelet with tactile feedback
Modern or augmented reality may well have to show us a very decent quality graphics. Well, about sound quality and can not speak. However, in order to completely immerse themselves in virtual worlds we need a new method of managem...
It is a serious step towards the creation of a molecular computer
Since the creation of the very first computer technology began to develop as rapidly as may develop or any other branch. Now computers in the modern sense has come to the peak of its development and if we want to continue to devel...
Hyperloop passenger capsule set a new speed record
In 2013, the CEO of Tesla and SpaceX Elon musk has created yet another bold idea. He was eager to spend under the cities of the vacuum tube, inside of which, at speeds over 1000 kilometers per hour, will move the capsule with pass...
Who invented the computer password?
What you see when you turn on your computer, laptop or smartphone? If you're a family man, or you important the safety of personal data, most likely, before you open the screen with a field to enter the password from the computer....
Scientists have found a way to protect themselves from earthquakes — it will cost 6 billion rubles
Although seismic activity in Russia is mainly evident only in the South and East of the country, for other countries the problem of sudden occurrence of earthquakes is very important. Tremors can present a huge danger for the popu...
If AI is to assemble a Rubik's cube faster than a human?
the Rubik's Cube is to some extent unique puzzle. On the one hand, to understand the principle of how to assemble and disassemble the cube is quite simple. On the other hand, in collecting this puzzle endlessly. People worldwide c...
The Americans will conduct a full test of combat robots
today various types of unmanned and remote-controlled vehicles successfully used by armed forces around the world. While we are talking about reconnaissance planes and drones-drones. But the emergence of more advanced types of mil...
Want to know the date of his death? These watches will tell
Some people prefer not to reflect on duration of own life, and others that even go to "fortune tellers" and psychics. In the majority similar predictions appear false as to look in the future no one has yet learned, however, this ...
What happens when the satellite Internet from Elon musk
In may this year, a rocket launched SpaceX, a company founded by Elon Musk, launched into orbit a very large amount of payload. He was among the 60 satellites that will form the basis of the global Internet network . In the coming...
#video | In the United States began selling the flamethrower for drones
Invented in 1901 by a German scientist Richard Fiedler flamethrowers today mainly used in the agricultural industry. For example, it emits the fire, the farmers clear a huge field of weeds. Also, these fire weapons are used for de...
Comments (0)
This article has no comment, be the first!