It’s been a big day for Meta. First, the tech giant launched several new features for Meta AI. And now, the same AI model is coming to Quest headsets next month.
According to the company's presentation video, Meta AI will function as a sort of personal assistant in the VR headset. You can ask it any question you have and it will respond in real time with information obtained through Bing. It can recite memorable verses from Shakespeare's plays or give short lectures on American history.
See in the
Thanks to Meta AI with Vision, the device can detect objects, people, and more in front of its cameras and then provide a contextual response to these queries. For example, users can tell the assistant to translate a text into another language, give fashion tips for the summer, or identify what's in front of it. The AI can even detect dogs, as shown in the video.
Meta AI on Quest is experimental software that is being released in a limited release in the United States and Canada. To try it out, you'll need to go into your headset's settings menu and select “Experimental.” You should see and be able to “toggle” [the] “features there.”
As this is an experimental release, users won't be able to enjoy the full capabilities of Meta AI. The Vision feature will be available via Passthrough on Quest 3 and Quest Pro headsets, but it won't work in VR mode. Meta states that “virtual objects are not recognized at this time,” though judging by the wording, this could change.
A Meta spokesperson confirmed that the Quest 2 will lack Vision “because it doesn't have color transfer.”
Additionally, to make room, the company claims that Meta AI will replace voice commands as the primary way for users to interact with the headset. Voice commands will be largely deprecated at some point in the future, though they will remain if you don’t test the AI model.
There are not many details about what will happen with voice commands at the moment. Meta's spokesperson did not provide any additional information.
While we're at it, check out TechRadar's list of the best VR headsets for 2024.
