Google's Guided Frame coaches blind users to frame a selfie — then shoots it

Guided Frame shipped with Google's Pixel 7 in October 2022 as a camera feature for people who are blind or have low vision. Instead of requiring a sighted helper, the phone talks the user through the shot: audio cues and haptics say whether to move the phone left, right, up, down, closer or farther, and high-contrast animations show the state on screen. When the face reaches the 'sweet spot,' the camera takes the picture itself.

The idea came out of a 2021 Pixel Camera hackathon, where the team first assumed the answer was telling users where the camera sits. After a study with three blind Googlers, Lingeng Wang and colleagues realized the feature had to give real-time feedback while users were actively framing. Testing stayed centered on blind and low-vision users throughout — including Victor Tsaran, who said it let him be confident the result would be good — and the team landed on audio cues, haptics and high-contrast elements, with the camera firing automatically so no one hunts for the shutter key.

On Pixel 8 in 2023, Guided Frame added rear-camera support and could recognize objects such as dogs and meals, describing what is in the frame using on-device AI. The feature then became the subject of Google's 2024 Super Bowl ad 'Javier in Frame,' directed by blind filmmaker Adam Morse, with the tagline 'Capture life, no matter how you experience it.'