In the US, created a glove that translates sign language into text (Video)
American scientists have created a glove-shaped device that accurately converts sign language to English and allows people who don’t know sign language to communicate directly with those who use it and also learn sign language on their own.
Bioengineers from the University of California have developed a glove-shaped device that real-time converts gestures of the American "silent" language into text that appears simultaneously on the smartphone screen.
The system consists of a pair of gloves with five thin sensors of electrically conductive filaments, which stretch with the movements of the fingers and fix the position of the brush, indicating a letter, number or whole phrase. The position of the fingers is converted into an electrical signal, which is transmitted wirelessly to a smartphone via a coin-sized card. The speed at which a gesture is translated into a word or phrase is about once per second.
American sign language also takes into account facial expressions. Therefore, engineers added sensors to the translation system that are installed on the face: between the eyebrows and around the mouth. Sensors capture facial expression for greater synchronization of translation.
In the testing of the device 4 people participated, using American sign language. Volunteers repeated each gesture 15 times. As a result, the system was able to recognize 660 characters, including all letters of the English alphabet, Arabic numerals from 0 to 9, and some phrases.
Previous similar systems were either limited in functionality: they could recognize only letters of the alphabet, or were too bulky and heavy. The new device is made of durable, lightweight and inexpensive polymers and allows you to communicate directly with people who use sign language without a translator. Also, the glove will be useful to those who study this method of communication on their own.
[video = "UcfdT_q1ikk"]
Bioengineers from the University of California have developed a glove-shaped device that real-time converts gestures of the American "silent" language into text that appears simultaneously on the smartphone screen.
The system consists of a pair of gloves with five thin sensors of electrically conductive filaments, which stretch with the movements of the fingers and fix the position of the brush, indicating a letter, number or whole phrase. The position of the fingers is converted into an electrical signal, which is transmitted wirelessly to a smartphone via a coin-sized card. The speed at which a gesture is translated into a word or phrase is about once per second.
American sign language also takes into account facial expressions. Therefore, engineers added sensors to the translation system that are installed on the face: between the eyebrows and around the mouth. Sensors capture facial expression for greater synchronization of translation.
In the testing of the device 4 people participated, using American sign language. Volunteers repeated each gesture 15 times. As a result, the system was able to recognize 660 characters, including all letters of the English alphabet, Arabic numerals from 0 to 9, and some phrases.
Previous similar systems were either limited in functionality: they could recognize only letters of the alphabet, or were too bulky and heavy. The new device is made of durable, lightweight and inexpensive polymers and allows you to communicate directly with people who use sign language without a translator. Also, the glove will be useful to those who study this method of communication on their own.
[video = "UcfdT_q1ikk"]
