Exploring visionOS 2.4 Update: A Major Evolution for Apple Vision Pro
Recently, Apple previewed several new features coming in the important system update for Vision Pro - visionOS 2.4.
In brief, this upcoming 2.4 version includes the following updates:
- Apple Intelligence: In April's visionOS 2.4 system, Apple Vision Pro users will gain access to several AI features that launched on iOS last October: Writing Tools, Image Playground, Genmoji, and Memory Movie.
- Spatial Gallery: Apple has officially launched an app for users to browse spatial photos, spatial videos, and panoramic photos. It will feature works from Apple-invited content creators and behind-the-scenes stories of notable works.
- Apple Vision Pro app on iPhone: Users can now browse and download Apple Vision Pro apps and games directly from their iPhones.
- Guest Mode Launch from iPhone/iPad: iPhone/iPad can directly initiate Apple Vision Pro's guest mode and launch screen mirroring.
Apple Intelligence: A Simple Migration of AI Features
Although this sounds like the most significant update, this Apple Intelligence update is merely a migration, simply porting the existing image generation and text rewriting features from iOS to Apple Vision Pro.
Considering that most people aren't yet using Apple Vision Pro as a productivity tool (meaning wearing it with a keyboard and trackpad for work), this feature might not significantly impact current Apple Vision Pro users. Users might try it briefly before setting it aside, hoping future updates will better align with Vision Pro use cases.
However, Apple has placed considerable emphasis on these features in this update, even providing dedicated videos for some of them.
Image Playground
Image Playground allows users to easily create unique and fun images from themes, clothing, accessories, and scenes. Users can add their own text descriptions and even create images resembling family or friends using photos from their library. This experience is directly integrated into apps like Messages and Freeform, and is also available as a dedicated app on Apple Vision Pro.
It looks quite similar to Image Playground on iOS, just with a larger window.
Writing Tools
With Writing Tools, users can refine their words through rewriting, proofreading, and summarizing text, available almost anywhere they write, including mail, notes, and third-party apps. Using rewrite, users can adjust the tone of text to be more friendly, professional, or concise, or specify desired changes using descriptions. Proofread checks grammar, word choice, and sentence structure, offering suggestive edits. Users can also select text for summarization in various formats. With compose, users can ask ChatGPT to generate content for anything they're writing.
This scenario would feel more appropriate with a Magic Keyboard and Magic Trackpad on the desk.
Genmoji
Users will be able to create Genmoji by simply typing or speaking a description in the emoji keyboard. Genmoji can be added inline to messages, shared as stickers, or sent as Tapbacks.
Genmoji is also quite similar to its iOS counterpart, just with a larger window.
Memory Movie
Using Create a Memory Movie, users can simply input a description, and Apple Intelligence will select the best photos and videos, create chapters based on subjects recognized in photos, and arrange them into a movie with a narrative arc and soundtrack. Like all Apple Intelligence features, users' photos and videos remain private and are not shared with Apple or anyone else.
Similarly, this is not much different from Memory Movie on iOS, just with a larger window.
Spatial Gallery: Finally, an Official Platform for Spatial Video Content
Spatial Gallery showcases curated collections of spatial photos, spatial videos, and panoramas from renowned creators and brands — all curated by Apple. At launch, users can enjoy unique experiences from notable photographers like Fouad Zayed, exploration organizations like The Explorers, and brands such as Arc'teryx and HYBE.
This update is relatively more valuable because previously, except for apps like Fyta, SpatialStation, or Story, users had limited access to high-quality spatial video or immersive video content.
However, from Apple's description, this app won't allow users to upload their own content, featuring only works from Apple-invited content creators and behind-the-scenes stories of notable works. From the user interface, it appears more like a preview or portal to existing series on other apps like Apple TV and Red Bull TV.
iPhone Companion App: Apple Addresses the Pain Point JustSpatial Aimed to Solve!
Starting in April, Apple Vision Pro users will be able to queue up app and game downloads, discover new spatial content and experiences, easily find helpful tips, and quickly access information about their device using the new Apple Vision Pro app on their iPhone. The app will appear on Vision Pro users' devices when they update to iOS 18.4 and will also be available for download from the App Store.
The new Vision Pro iPhone app is a smart move. Managing Vision Pro app downloads and discovering new content through your phone was one of the key problems JustSpatial aimed to solve.
However, this also presents a bigger challenge for JustSpatial: how to do it better than the official solution? Let's wait and see.
Guest User Improvements: Sharing Apple Vision Pro Becomes More Convenient!
In visionOS 2.4, new Guest User enhancements allow users to initiate Guest User sessions using a nearby iPhone or iPad. When their device is unlocked, they can choose which apps are available to guests and launch view mirroring with AirPlay, making it easy to guide guests through the Vision Pro experience.
Finally, there's the Guest User feature upgrade. Launching guest mode through iPhone or iPad might seem like a simple improvement, but it solves a real problem. Previously, sharing Vision Pro experiences with friends required first putting on the Apple Vision Pro and going through some setup. Now, this process becomes more natural, requiring only the phone app to launch screen mirroring directly.
How to Try It Early?
Currently, these features are in Beta. If you want to experience them early, you can upgrade to visionOS 2.4 Beta version through Installing and Using Apple Beta.