Apple Vision Pro Gets A Major Upgrade With AI-Powered visionOS 2.4 Update: Here's What's New

With visionOS 2.4, Apple Vision Pro users gain access to Writing Tools, an AI-powered assistant designed to help with composing, summarising, and proofreading text.

Beyond AI capabilities, visionOS 2.4 brings several quality-of-life improvements.

Source : Apple

Apple has rolled out the visionOS 2.4 update for its mixed reality (MR) headset, Apple Vision Pro, introducing a suite of AI-driven features under its Apple Intelligence initiative. This update, considered a significant leap forward, enhances user experience with tools for text editing, image generation, and smarter search functionalities.

AI-Powered Writing and Image Creation Tools

With visionOS 2.4, Apple Vision Pro users gain access to Writing Tools, an AI-powered assistant designed to help with composing, summarising, and proofreading text. This feature can refine grammar, generate lists, and highlight key takeaways, making it easier for users to create polished documents effortlessly.

In addition, Apple has introduced Image Playground, a standalone app that leverages generative AI to create visuals from text-based descriptions. Users can even personalise their artwork by selecting a reference photo from their gallery and applying different artistic styles. The app also includes Genmoji, which allows users to generate custom emojis tailored to their messages.

Smarter Photo Search and Memory Movies

One of the standout features in this update is the enhanced search capability within the Photos app. With natural language search, users can find specific images by describing them in simple terms. Additionally, Apple Intelligence introduces the "Create a Memory Movie" tool, which automatically organises photos into thematic chapters, crafting a compelling visual narrative based on user prompts.

For seamless communication, the update also enhances Smart Reply in Mail and Messages, enabling users to generate contextually relevant responses instantly.

Enhanced Privacy and Additional Features

Beyond AI capabilities, visionOS 2.4 brings several quality-of-life improvements, including Priority Messages in Mail, Mail Summaries, Image Wand in Notes, and Priority Notifications.

Apple has underscored its commitment to privacy, ensuring that all media used in AI-driven processes remains on-device whenever possible. For tasks requiring more computational power, Apple’s Private Cloud Compute processes data securely without storing or sharing user information.

The visionOS 2.4 update is available now for Apple Vision Pro users with their device and Siri language set to English (US), marking another step in Apple’s mission to blend AI seamlessly into everyday experiences.