Apple is releasing the first beta of visionOS 2.4 today, and it just might be the biggest update yet for Apple Vision Pro users. The update brings support for Apple Intelligence, major improvements to Guest Mode, a new Spatial Gallery app, an Apple Vision Pro app for iPhone, and more. Here’s everything you need to know…
“Apple Vision Pro is helping users communicate, collaborate, and experience entertainment in entirely new ways — and we’re continuing to push the boundaries of what’s possible in spatial computing with visionOS 2.4,” said Mike Rockwell, Apple’s vice president of the Vision Products Group. “With Apple Intelligence, Vision Pro users will be able to take their productivity and creativity to new heights using features like Writing Tools, Image Playground, and Genmoji. And we’re excited for users to discover and share incredible new experiences with Spatial Gallery.”
Apple Intelligence support
With visionOS 2.4, Vision Pro is adding support for Apple Intelligence, Apple’s suite of artificial intelligence features. When Apple Intelligence was introduced at WWDC last year, Apple told a clear story about the features on iPhone, iPad, and Mac. Apple Vision Pro, meanwhile, missed out on the fun. That’s changing now.
Genmoji on Apple Vision Pro lets you make custom emoji based on text descriptions and people in your Photos library. Genmoji is accessible directly from the keyboard in various Apple apps like Messages.
Image Playground allows you to create images based on concepts, text descriptions, and people from your Photos library. You can access Image Playground with a dedicated app that has been designed specifically to take advantage of Vision Pro’s spatial computing interface. Just like on other platforms, it’s also integrated right into Messages.
visionOS 2.4 also adds the familiar Writing Tools feature to Vision Pro. Writing Tools lets you easily proofread and rewrite your text, with built-in options for making your text friendlier, professional, and concise. You can also generate summaries, key points, lists, and tables based on your text. Writing Tools on Apple Vision Pro can also tap into ChatGPT to create text from scratch based on your prompts.
Smart Reply identifies what’s in an email or Messages thread and suggests relevant responses. The update also includes the memory movie feature in the Photos app to create custom memory movies based on your description. Apple Intelligence then finds the best photos and videos to craft a storyline. Natural language search in the Photos app is also now available.
A few more tidbits on Apple Intelligence in visionOS 2.4:
visionOS 2.4 also includes support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Center, and Notification Summaries. Apple Intelligence uses on-device processing to protect users’ privacy whenever possible. For requests that require even larger models, Private Cloud Compute extends the privacy and security of Apple products into the cloud to unlock even more intelligence. When using Private Cloud Compute, users’ data is never stored or shared with Apple; it is used only to fulfill the request. Independent experts can inspect the code that runs on Apple silicon servers to continuously verify this privacy promise, and are already doing so.
... continue reading