Apple's Vision Pro hardware, last updated in the fall with an M5 chip, is getting new software upgrades with the latest version of VisionOS announced at WWDC. A big one is Visual Intelligence, camera-aware AI, at long last.
The Vision-focused AI tools are what interest me most. They're part of Apple's new Siri-focused AI updates announced at this year's WWDC conference. Asking Siri will allow you to see things on apps you have open on VisionOS, but Siri will also be able to recognize things in the room.
This is the same type of camera-aware AI that Google and Samsung already have in the Samsung Galaxy XR headset, which arrived last fall.
Apple also announced a tool that converts panoramic photos in 3D spatial scenes, which can become new immersive backgrounds in VisionOS.
While many people have reported that the Vision Pro's life is ending in the face of a shift to smart glasses in the next few years, the Vision Pro's hardware can clearly do things no glasses could dream of anytime soon. I've been waiting for Apple's spatial computer to make the most of its processing power, sensors and high price tag. Maybe these updates will help.
This is a developing story, we'll update as more is announced.