Hey Siri, You're the Framework for Apple's Smart Glasses Now
WWDC was all about Siri AI, but it certainly looks like a piece in the smart glasses puzzle. Vision Pro's new features are another big sign.
- Apple Intelligence, announced at WWDC 2024, brings on-device generative AI to Siri, enabling it to process screen context, personal data, and app actions — the core stack needed for hands-free smart glasses interaction.
- visionOS 2, unveiled at the same event, adds developer tools for spatial computing, including new gesture APIs and lower-level access to headset sensors, hinting at a future lightweight glasses form factor.
- Apple's approach mirrors its iPhone strategy: control the ecosystem (Siri + Apple Intelligence) before releasing dedicated hardware, with smart glasses rumored for a 2026–2027 launch window.
- Analyst Ming-Chi Kuo and Bloomberg's Mark Gurman have independently reported Apple's work on both a lower-cost Vision headset and a standalone AR glasses device, with Siri AI as the primary user interface.
- Meta's Ray-Ban Stories and Google's failed Glass project highlight the difficulty of smart glasses UX; Apple's on-device AI processing via its A18 and M4 chips offers a privacy-first, low-latency advantage.
Frequently Asked Questions
Apple announced Apple Intelligence, a suite of on-device generative AI features for Siri, along with visionOS 2 for the Vision Pro headset. These upgrades enable contextual awareness, multimodal input, and app orchestration — all essential for a hands-free smart glasses interface.
Apple is not expected to release consumer smart glasses before 2026–2027. Analysts like Ming-Chi Kuo and Bloomberg's Mark Gurman point to a lower-cost Vision headset first, followed by standalone AR glasses that rely on iPhone or a future processor.
Apple is building the software framework first by embedding AI into Siri and integrating it deeply with iOS, iPadOS, and macOS. This ecosystem lock-in makes smart glasses a natural extension rather than a separate gadget, unlike Meta's camera glasses or Google's discontinued Glass.
Siri, powered by Apple Intelligence, becomes the primary user interface for prospective smart glasses. It can understand screen content, personal context, and execute cross-app tasks via voice and minimal gestures — eliminating the need for a screen or physical controls.
Yes. visionOS 2 introduces developer tools and gesture frameworks that are likely to be adapted for lightweight glasses. Features like spatial personas and eye-tracking could be simplified for a glasses form factor.
Apple Intelligence is a generative AI system announced at WWDC 2024. It runs on-device using Apple's A18 and M4 chips, enabling Siri to process text, images, and app data privately. It powers semantic search, message summarization, and image generation, and is the foundation for future hands-free interaction.
Topics
Original source
www.cnet.com
Discussion
Join the discussion
Sign in to post a comment or reply.
No comments yet. Be the first to share your thoughts!