Meta Beats Apple In Bringing AI To VR Headsets As Llama Comes To Quest 3: All You Need To Know

Meta AI will enable Quest 3 headset to support AI-driven voice interactions and recognise objects in the user's environment.

Meta has announced its intention to integrate advanced AI vision capabilities into its Quest 3 headset, similar to the features found in its Meta Ray-Ban glasses. This move highlights Meta's focus on merging AI with extended reality (XR) technologies. In a recent update, Meta revealed that later this summer, users in the US and Canada will receive an update for the Quest 3 headset, introducing the 'Meta AI with Vision' feature.

How Will Llama 3 AI Work On Quest 3?

This enhancement will enable the Quest 3 headset to support AI-driven voice interactions and recognise objects in the user's environment. Users will be able to ask the AI general questions or inquire about specific items within their view. However, currently, the AI will only interpret real-world objects, with potential future updates possibly expanding this capability to include virtual content as well.

Notably, this new feature will not be available for the Quest 2 or older models, and it is uncertain whether the Quest Pro will receive it. Meta has confirmed that the 'Meta AI with Vision' feature relies on Bing AI, but details on whether the processing will occur on-device or in the cloud, as well as specifics on encryption and privacy, have not been fully disclosed.

Apple Yet To Bring AI To Wearables

Meanwhile, Apple has yet to confirm if its Apple Intelligence features will be available for its Vision Pro headset. Earlier this year, Apple announced that a suite of Apple Intelligence features would be introduced to iPhones, iPads, and Macs in the fall. Despite the unveiling of visionOS 2, there has been no confirmation regarding the integration of these AI features with Vision Pro. This uncertainty leaves Vision Pro users wondering if they will receive the updates concurrently with other Apple devices or if they will have to wait for subsequent versions of visionOS.

Apple has stated that many of its Apple Intelligence features will be processed on-device, with some requests requiring off-device processing. The company assures that off-device data is not stored, is used solely for user requests, and that the code for these processes will be available for privacy audits.

As Meta pushes forward with AI integration in its devices, the tech community eagerly awaits Apple's next move regarding the Vision Pro.