I'm Letting Siri See My Life on Vision Pro, and It's a Sign of Things to Come

Apple Vision Pro’s Siri has learned to see. The latest VisionOS 27 beta gives the headset’s digital assistant visual intelligence — the ability to interpret what its cameras capture in real time. An early test of the feature reveals a phase change in how we interact with AI, and a preview of camera-enabled wearables like glasses.

Apple is letting Siri look at your life. The VisionOS 27 update, currently in beta, introduces visual intelligence to the company’s spatial computer. Siri can now describe objects, read text from signs or documents, and understand scene context — all without a separate app. This is not just a software tweak; it’s a fundamental shift in Apple’s approach to ambient AI.

The update arrives as the tech industry races toward always-on camera assistants. Meta’s Ray-Ban Stories and Google’s Project Astra signal a similar direction. But Apple’s ecosystem — with its tight privacy narrative — faces unique scrutiny. On the Vision Pro, visual intelligence is opt-in and requires the user to activate Siri first. Still, the camera is physically there, and the line between passive and active sensing is blurring.

CNET’s early hands-on test showed that Siri can now identify plants, translate foreign text, and even suggest actions based on what it sees. For example, pointing the headset at a flyer prompted Siri to add the event to the calendar. This kind of contextual awareness is what makes Apple Vision Pro visual intelligence feel like a genuine leap forward — reminiscent of the leap from Siri’s voice-only origins.

The potential is enormous. Imagine walking into a meeting and having Siri silently surface relevant documents based on the whiteboard content. Or cooking a complex recipe while the Vision Pro reads out steps overlaid on the actual ingredients. These scenarios, once science fiction, are now technically feasible.

Yet the always-on camera raises familiar questions. Privacy advocates have long warned of “cameras in the sky” computing. Apple has counters: everything is processed on-device, and the camera never streams to cloud servers. But the psychological barrier remains. Users must trust that their headset doesn’t judge, share, or record their most vulnerable moments.

This is a preview of the next decade. Once visual intelligence becomes reliable and comfortable, Apple is expected to downscale it into glasses. The Vision Pro’s bulk and $3,500 price tag are temporary. The real prize is a lightweight wearable that sees the world on your behalf.

VisionOS 27’s visual intelligence marks the beginning of that journey. For now, the early testers are living the future — letting Siri see their life. It’s weird. It’s powerful. And it’s only getting started.