Talking to a Computer Without Using Your Voice

Alter Ego

Researchers at MIT in the United States have pioneered a new computer interface that can accurately transcribe words that the user concentrates on, but which aren't actually vocalised.

Author Tristan Rayner, 05.24.18

Researchers at MIT in the United States have pioneered a new computer interface that can accurately transcribe words that the user concentrates on, but which aren’t actually vocalised.

The device, known as AlterEgo, consists of a wearable device, including electrodes and bone-conduction headphones, and an associated computing system. The electrodes amplify neuromuscular signals in the jaw and face which are activated as words are visualised in the brain of the user, but are not actually spoken. The signals are interpreted by a machine-learning system that is able to correlate signals for words. The headphones transmit vibrations as the system responds or conveys other information, making it possible to hold a two-way conversation without ever speaking or hearing audio-waves. 

The system has potential for a number of industry and professional uses, such as high-noise environments, however it could also find a strong use for disabled and medically injured people who are unable to speak clearly. Imagine Professor Stephen Hawking’s computer-based communication system, which tracked his eye movement, but without any necessary discernable input required from the subject.

In one experiment to test the device, subjects were able to play chess by passing on opponents’ moves in a match, and receive recommended counter-moves in a silent response.

 Pattie Maes, an author of the paper and professor of media arts and sciences, explained:

“We basically can’t live without our cellphones, our digital devices. But at the moment, the use of those devices is very disruptive. If I want to look something up that’s relevant to a conversation I’m having, I have to find my phone and type in the passcode and open an app and type in some search keyword, and the whole thing requires that I completely shift attention from my environment and the people that I’m with to the phone itself.

“So, my students and I have for a very long time been experimenting with new form factors and new types of experience that enable people to still benefit from all the wonderful knowledge and services that these devices give us, but do it in a way that lets them remain in the present.”

Using a wearable interface prototype, researchers found that their subjects, after completing just over 15 minutes of training, reported an accuracy of approximately 92 percent for a restricted vocabulary. The MIT researchers are hopeful of expanding the types and range of conversation to move towards full conversations in the not too distant future.

Research has been performed in this area for decades, with many of the limitations coming from needing to wear enormous head-gear to track brain-waves. One of the difficulties in the approach taken with AlterEgo is that each person is different, making a multi-user or user-independent system extremely difficult. Currently, each device must carefully track the individual’s unique physiology and requires training and customisation. 

How Glow-in-the-Dark Contact Lenses May Help Prevent Blindness

For hundreds of millions of sufferers of all types of diabetes, eye disease is one of the most damaging side effects. 

Pills On Wheels: Is This What Medical Checkups Will Look Like in the Future?

The Artefact Group from Seattle wants to revolutionise the healthcare system with the help of artificial intelligence. With a mobile, self-driving clinic on wheels that aims to take the heat of doctors and give patients quicker access to treatment.

A Medical Breakthrough Made of Paper and String

Centrifuging a blood sample without electricity is child’s play to a team of Stanford engineers. The researchers were inspired by a toy and developed paperfuge, a low-cost and low-tech centrifuge that could help diagnose diseases such as malaria and HIV in developing countries.

Can You Make an Eye-Movements-Controlled Wheelchair at the Age of 14? Yes, You Can.

A seemingly ordinary 14 year-old girl from Duisburg, whose hobbies include soldering, coding and building things, has come up with an extraordinary invention - a wheelchair that can be controlled through the eye movements of its user.

Affordable Braille Printers for All: Just Add LEGO and Stir

A twelve year old boy has put his ingenuity, and his LEGO collection, to good use to come up with the world's first affordable Braille printer.At an average two thousand US Dollar a pop, a Braille printer is an expensive piece of technology, making it simply out of reach for most people.

HIV Tests on Your Mobile: Could a Smartphone Save Your Life?

Scientists at Columbia University have developed an affordable and innovative device that plugs into smartphones and can test for both HIV and syphilis, delivering a diagnosis in as little as 15 minutes.