With the introduction of visionOS 2.0 for Vision Pro at WWDC 24, Apple introduced many new features, but left my desire for open environments unfulfilled. Still, in addition to new display options for Mac Virtual Display and more control gestures, there's one feature that stands out from the rest.
When I reviewed the Vision Pro, I noticed how emotional the experience can be, especially viewing photos on it. When looking at photos of loved ones who have passed away or even reliving moments I frequently recall on my iPhone or iPad, there was something more about life-size or larger-than-life representations of the content. When shot correctly, the most engaging space videos and photos exude a real sense of intimacy and commitment.
The problem is that currently the only photos and videos that can be viewed this way are videos taken in Apple's spatial image format, and that's something you can only do on the 15 Pro or 15 Pro Max.
For photos, however, that will change with visionOS 2.
Make any photo more immersive
Photos you view in Vision Pro with the second generation of VisionOS can be displayed as spatial photos thanks to the power of machine learning. This will add a left and right side to the 2D image to create the impression of depth and allow the image to effectively “pop”. I can't wait to try it and I think it will give people a more impactful experience with Apple's 'space computer'.
I also really like Apple's approach here, as it won't automatically present each photo as a spatial image, which could lead to some strange looking shots, and there will also be photos that you'd prefer to leave in their original 2D form.
According to the visionOS 2.0 portion of Apple's keynote, the process is as simple as swiping across images within Photos and tapping a button to watch as machine learning activates, analyzes your photo, and adds elements of depth. The resulting images really pop and when viewed on a screen that could be as big as you want in the Vision Pro, the effect is striking.
I have already enjoyed looking at standard photographs of key memories of my life with friends and family who are still here and some who have passed away. Seeing it on that big stage is emotional, it makes you think and can be powerful. I'm hoping that this option to activate this 3D effect will make that impact even stronger.
It has the potential to greatly expand the Vision Pro owner's actual use of the Photos app, considering it's a great way to view large-scale images, whether it's a standard, ultra-wide-angle, portrait, or even panoramic shot. .
Mac Virtual Display expands and improves gestures
While 'space photos' was the new feature that caught my attention the most, it is joined by two other new features in visionOS 2.0. For starters, Mac Virtual Display will receive a big improvement: it will be able to increase the size of the screen, almost like a curved screen that wraps around, and will benefit from improved resolutions. That means more apps will work even better here.
Plus, you can do more with hand gestures. Instead of pressing the Digital Crown to open the Home screen, you can do a double-tap-like gesture to open that interface, while another gesture will give you easy access to the Control Center.
New forms of interaction are superimposed on your reality, in an immersive one for Apple, or on Tatooine if you are on Disney Plus.
