The archive · Product Ideas · Product decision · 2023–2024
Apple Vision Pro (2023) replaces controllers with eyes, hands and voice
Apple's $3,499 spatial computer drops controllers: you look to aim, pinch to select, speak to dictate — on 23 million pixels with a 3D interface.
Apple
What it had to solve
Apple wanted a 'spatial computer' — a wearable that blends digital content with the physical world — not another VR headset. To feel natural, the interface had to work the way people already look, point and talk, so controllers were ruled out from the start.
How it works
On June 5, 2023 Apple announced Vision Pro, calling it the company's first spatial computer. The pitch was a computer you wear: apps appear around you in a three-dimensional interface that blends digital content with the physical room — not a VR headset, in Apple's framing.
The defining idea was input. visionOS introduced an entirely new input system controlled by eyes, hands and voice: users browse by looking, select by tapping their fingers together, scroll by flicking their wrist and dictate by speaking. High-speed cameras and a ring of LEDs track the eyes, while a new R1 chip processes 12 cameras, five sensors and six microphones and streams images in 12 milliseconds.
The hardware made the interface possible: two micro-OLED displays packing 23 million pixels, an M2 chip, ZEISS optical inserts for prescription wearers, and EyeSight — a front display that shows the wearer's eyes to people nearby. Announced at $3,499, it launched in the US on February 2, 2024.
Reviewers were split but impressed. The Verge called the hand and eye tracking 'a leap forward' and the display 'a technical marvel', while noting the price, the weight and the loneliness of wearing it. Whatever its sales, Vision Pro made 'spatial computing' and controller-free input the industry's next interface question.
Why it lands
- Removing the controller removed the learning curve: looking and pinching are gestures humans already use, so the interface feels like intention rather than commands.
- Putting the input system in dedicated silicon (R1) made tracking feel instant, which is what makes eye-and-hand control feel natural.
- A 3D interface that escapes display boundaries redefined the category as spatial computing rather than VR, changing how rivals positioned their own headsets.
- By shipping EyeSight, Apple treated the people around the wearer as part of the product, solving a social problem most headsets ignored.
What it did
The Verge called the hand and eye tracking 'a leap forward' and the display 'a technical marvel', while flagging the $3,499 price, weight and isolation as tradeoffs; Apple's controller-free input and 'spatial computer' framing became the benchmark for the headsets that followed.
What you can take
The radical move wasn't a new controller but none at all: eyes aim, fingers click, voice types. When a device reads intent directly, the interface stops being something you learn.
Since then
Vision Pro launched in the US on February 2, 2024 at $3,499 and expanded to more countries through 2024, with Apple positioning it as the start of spatial computing and continuing to evolve visionOS. Sales were never broken out publicly, but the eye-and-pinch interaction remained the product's defining and most-praised feature, and 'spatial computing' became the industry's shared vocabulary for controller-free headset interfaces.
Sources
- Introducing Apple Vision Pro: Apple's first spatial computer
- Apple Vision Pro hands-on, again, for the first time
- Apple Vision Pro review: magic, until it's not
- Vision Pro launching on February 2, pre-orders begin next week
spotted an error? The archive wants to know.
Your turn
You just read one. Describe the brief you are staring at, and see who has been given the same problem.
Free account · 3 free questions · no card