The archive · Product Ideas · Product decision · 2020
Google's Look To Speak turns eye movements into spoken words on Android phones
Google's Android app speaks pre-written phrases when users look at them, putting eye-controlled communication on phones millions of people already own
What it had to solve
Millions of people live with speech and motor impairments, yet the communication tools available to them are often prohibitively expensive, unreliable and non-portable. As mobile devices became ubiquitous and machine learning arrived built-in, Google asked how the phone itself could work as assistive technology.
How it works
Millions of people live with speech and motor impairments, and for many of them the communication tools that exist are out of reach: prohibitively expensive, unreliable or too bulky to carry. The gap is not just technological — it is a gap of access and portability.
Google's answer was to stop designing assistive hardware and look at the computer already in most pockets. With machine learning built into mobile devices, Google built Look To Speak, an Android app in which pre-written phrases appear on screen and the user picks one with their eyes; the phone then speaks the selection aloud.
Because it runs on ordinary phones, the app gives many people their first taste of eye-controlled communication without asking them to buy a dedicated device. The project's promise, as its own case describes it, is new possibilities for those who might now have access to this technology for the very first time, and D&AD later carried it in its awards archive.
Why it lands
- The constraint was the point: if it runs on a phone people already have, the access barrier drops to almost zero.
- Eye gaze is the interaction channel many users still control, so the whole interface was built around that single ability.
- Sitting inside Android put the assistive layer in the mainstream operating system rather than in a separate, expensive medical-device market.
- The brief's own terms — price, reliability, portability — were answered by the phone itself, not by a new product category.
What it did
The app created new possibilities especially for people who might now have access to eye-controlled communication for the very first time, on hardware they already owned rather than costly specialist equipment; D&AD later carried the project in its awards archive.
What you can take
Start from the device that is already everywhere: built-in cameras and machine learning let an accessibility product reach people that specialist hardware never would
Since then
Google released Look To Speak for Android in December 2020, and D&AD carried the project in its awards archive. Its lasting point is structural: the biggest accessibility win was choosing the device already in the room.
Sources
spotted an error? The archive wants to know.
Your turn
You just read one. Describe the brief you are staring at, and see who has been given the same problem.
Free account · 3 free questions · no card