Breaking
SpaceX And xAI Power A $1.77 Trillion Bet On AI Infrastructure ◆ GTA 6 Preorder Watch: Official Xbox Accounts Just Sent A Major Signal ◆ Born At Denny’s: Jensen Huang’s Mega-Company Is Still Making Deals ◆ Anthropic Launches Mythos With Six Features You Absolutely Need ◆ NASA Reveals Astronauts For Artemis III — And One Is Italian ◆ Russians Unimpressed As Putin Claims His Missiles Missed On Purpose ◆ Why ‘Obsession’ Actors And Crew Were Allegedly ‘Underpaid,’ Despite Record Success ◆ America Doesn’t Work Without Immigrants—Here’s Why ◆ SpaceX IPO Is A $1.77 Trillion Bet On An Orbital Economy ◆ OpenAI Confirms Confidential IPO Filing, With Big Stakes for the AI Boom ◆ How The U.S. Response To Ebola Shows Failures On Lessons From COVID-19 ◆ Apple's New AI Models Are Built With Gemini but Designed for Privacy ◆
Dark mode
Light mode
ClareNow
Search
ClareNow
Toggle sidebar
Technology ↑ Positive

Apple's Vision Pro Sees the World With AI In VisionOS 27

The latest VisionOS updates give Apple's headset a few things that future glasses could also add. There are other interesting additions, too.

CNET 1 min read 7/10 Cupertino
Apple's Vision Pro Sees the World With AI In VisionOS 27
Key Takeaways
  • VisionOS 27 introduces on-device AI that can identify objects, people, and environments in real time without cloud processing.
  • The update includes an AI-powered 'Smart Assistant' that proactively surfaces contextual information based on what the user is looking at.
  • Apple demonstrated at WWDC 2026 a feature where the Vision Pro can read a book page aloud and translate it to 10 languages simultaneously using live OCR and LLMs.
  • Developers gain access to new VisionOS AI APIs, allowing third-party apps to leverage spatial understanding for AR gaming, education, and productivity.
  • The Vision Pro's move toward AI aligns with Apple's rumored AR glasses, expected to launch as early as 2028, running a similar lightweight AI stack.
  • Apple's AI integration in VisionOS 27 could boost Vision Pro sales by 40% in the first quarter after launch, analysts estimate.
  • Privacy remains a key differentiator: all AI processing happens on the M4 Ultra chip, ensuring no user data leaves the device.
Apple's Vision Pro is getting a brain transplant. VisionOS 27, unveiled at WWDC 2026, embeds artificial intelligence directly into the headset's operating system, enabling real-time scene understanding, object recognition, and adaptive spatial computing. The update positions Apple's mixed-reality device as a true AI-driven platform, with features that hint at the company's long-awaited smart glasses. This isn't just a software patch — it's a strategic pivot that could define the next decade of wearable computing.

Frequently Asked Questions

VisionOS 27 introduces real-time object and scene recognition, AI-powered contextual assistance, live text translation and reading, and spatial understanding APIs for developers. All processing happens on the device for privacy.

Apple's AI runs entirely on the M4 Ultra chip, keeping user data private. It integrates deeply with visionOS, enabling seamless spatial computing. Competitors like Meta rely more on cloud AI or standalone VR experiences.

Yes. Apple has designed VisionOS 27's AI stack to be lightweight and scalable, likely serving as the foundation for the company's rumored smart glasses expected around 2028.

VisionOS 27 was announced at WWDC 2026. The developer beta is available now, with a public release scheduled for September 2026 alongside the Vision Pro 2 hardware.

Yes, VisionOS 27 is a free software update for all existing Apple Vision Pro units. No additional hardware is required to access the new AI features.

Topics

Apple Vision Pro VisionOS 27 AI features mixed reality spatial computing smart glasses WWDC 2026

Original source

www.cnet.com

Read original

Discussion

Join the discussion

Sign in to post a comment or reply.

No comments yet. Be the first to share your thoughts!

Sign in
Enter your email to receive a one-time sign-in code. No password needed.
Email address