visionOS 2.4 has officially launched, introducing Apple Intelligence to Vision Pro, a new Spatial Gallery application, an iPhone app for remote installations, and an enhanced guest flow for iPhone and iPad users. The previous notable update, visionOS 2.2, was released in December and included Wide and Ultrawide Mac Virtual Display options. Following that, visionOS 2.3 was primarily focused on bug fixes and security enhancements. The initial developer beta of visionOS 2.4 was made available in February, coinciding with Apple’s announcement of the update, and now the stable version is ready for all Apple Vision Pro users.
Apple Intelligence
The term “Apple Intelligence” refers to the company’s suite of generative AI capabilities. Certain functionalities operate directly on the device, while others leverage Apple’s Private Cloud Compute (PCC) servers. Additionally, some requests may connect to OpenAI’s ChatGPT, provided users grant permission. Apple Intelligence began rolling out to iPhones (15 Pro and later), iPads (M-series or A17 Pro chips only), and Macs (M-series chips only) late last year, but the company had not specified whether Vision Pro would receive these features. With the release of visionOS 2.4, the following Apple Intelligence functionalities are now available on Vision Pro:
- Priority Notifications
- Notification Summaries
- Smart Reply
- Memory Movie Creation
- Natural Language Search in Photos
- Priority Messages & Mail Summaries
- Writing Tools
- Image Wand in Notes
- Genmoji
- Image Playground
At its debut, Apple Intelligence on Vision Pro is limited to US English, with plans to introduce “additional languages” later this year.
Priority Notifications & Notification Summaries
Apple Intelligence intelligently identifies the most crucial notifications, such as messages from friends and family regarding upcoming events, and places them at the top of the notification list. For longer notifications, and groups of notifications from the same application, an AI-generated summary replaces the original content. While this feature has faced criticism for occasionally misinterpreting notification details, tapping on the summary reveals the full notification.
Smart Reply in Messages & Mail
The Smart Reply feature recognizes questions and suggests appropriate replies to messages and emails, allowing users to respond with just a few taps on Vision Pro. This functionality is particularly beneficial when a Bluetooth keyboard isn’t connected, especially since typing on floating virtual keyboards can be less efficient than traditional touchscreen keyboards.
Memory Movies & Natural Language Search in Photos
In the Photos app on visionOS, Apple Intelligence enables the creation of Memory Movies, alongside enhanced search capabilities. Users can type a description, and the technology will curate the best photos and videos, formulating a storyline with chapters based on recognized themes and arranging them into a movie complete with a narrative arc and soundtrack. The Natural Language Search feature allows users to find photos and videos by simply describing them.
Priority Messages & Mail Summaries in Mail
Similar to notifications, Apple Intelligence highlights the most important messages within the visionOS Mail app. Each email in the inbox features an AI-generated brief summary of its content instead of just the initial line, which is standard in traditional email clients. Additionally, when opening an email, users can generate a medium-length summary of its content using AI.
Writing Tools
The Writing Tools feature provides four types of utilities for “rewriting, proofreading, and summarizing” extensive text typed or dictated in visionOS, applicable in Mail, Notes, and various third-party applications. The available tools include:
- Proofread: Checks grammar, word choice, and sentence structure, offering suggested edits.
- Rewrite: Modifies the text’s tone to be more friendly, professional, or concise, or allows users to specify preferred changes.
- Summarize: Recaps the text, highlights key points, or converts it into a bullet point list or table.
- Compose: Utilizes OpenAI’s ChatGPT to generate any form of textual content.
Image Wand in Notes
The Image Wand feature in the visionOS Notes application allows users to “create images based on rough sketches” or generate entirely new images “from words and visuals in the surrounding area.”
Genmoji in iMessage
Genmoji is Apple’s tool for creating custom emojis within iMessage by typing or voicing a description. Users can incorporate these Genmoji into messages, share them as stickers, or send them as Tapbacks.
Image Playground
Image Playground enables users to AI-generate “unique and entertaining images” based on themes, costumes, accessories, and locations. According to Apple, “users can add their own text descriptions and can even create images resembling a family member or friend using photos from their library.” This feature is integrated into applications like Messages and Freeform and is also available as a standalone app on visionOS.
Spatial Gallery
Spatial Gallery is a newly introduced visionOS application from Apple that “features a curated collection of spatial photos, spatial videos, and panoramas from artists, filmmakers, photographers, and more.” At launch, it presents “remarkable perspectives from photographers like Jonpaul Douglass and Samba Diop; new stories and experiences from iconic brands including Cirque du Soleil, Red Bull, and Porsche; behind-the-scenes moments from Apple Originals like Disclaimer, Severance, and Shrinking; and special moments from top artists.” Unlike platforms such as YouTube or Vimeo, which added spatial video support in October, Apple’s Spatial Gallery appears to be a highly curated platform prioritizing quality over quantity. Spatial Gallery will be accessible in all regions where Apple Vision Pro is available, excluding mainland China.
Apple Vision Pro iPhone App
The newly introduced Apple Vision Pro app for iPhone allows users to remotely queue applications for download and installation to their headset, view device information, and explore curated recommendations for the best visionOS content. The My Vision Pro interface displays device tips, the current visionOS version, and the serial number. It also enables the setup of Personalized Spatial Audio by scanning the user’s face shape with the iPhone’s TrueDepth sensor.
The Discovery interface showcases “popular apps and games from the App Store; nearly 300 3D movies, Apple Immersive titles, and additional video content on the Apple TV app; and the latest spatial photos, spatial videos, and panoramas highlighted in the Spatial Gallery.” The Apple Vision Pro app is part of iOS 18.4 and is available for download from the iOS App Store.
iPhone/iPad-Driven Guest User Mode
Previously, activating Guest User mode on Vision Pro necessitated donning the headset and unlocking it first, which could lead to frustration if adjustments were needed after the guest put on the headset. With visionOS 2.4, Apple has introduced the capability to approve Guest User mode from a nearby iPhone or iPad signed into the same Apple Account. This interface allows users to choose which applications the guest can access and initiate View Mirroring via AirPlay.