The upcoming iPhone Ultra model could have a key Apple Vision Pro feature: the ability to take “spatial photos and videos” using the phone’s camera.
At least, that’s what the latest rumors suggest. According to a recent report by Mac Rumorsthe spatial photo support could allow people to “capture immersive 3D content” using the smartphone’s “outward facing cameras”. The content could then theoretically be uploaded and viewed on the Vision Pro.
Judging by the rumours, coming from an unnamed Weibo account with a seemingly good track record of iPhone predictions, it doesn’t appear that the iPhone Ultra itself (or whatever the future device is called) will give you the spatial pictures will show. Instead, you need the headset to enjoy the ‘immersive’ content on a large floating VR screen.
The rumor is striking enough to say that this update will “prompt the market to rethink what kind of photos and videos a mobile phone should take.” But it may be a while before we find out if that’s the case Mark Gurman of Bloombergthe iPhone Ultra (which is expected to rank above its Pro models) is rumored to be out in 2024 at the earliest.
What are Spatial Cameras?
We first learned about spatial photos and videos on WWDC 2023 during the unveiling of the Vision Pro. The idea behind this technology is to allow people to relive important life moments; to make you feel like you’re there again.
For example, as Apple showed in its Vision Pro demos, you can relive your daughter’s birthday party or your kids playing in the backyard. The tech giant said spatial capture is such an important aspect of the Vision Pro experience “that the device (even) has a special mechanical button on the top to activate it.”
The main issue with recording video on a VR headset is the fact that you are recording video on a VR headset. The hardware is not exactly inconspicuous. In addition, there is a chance that it will be irreparably damaged if you take it outside.
But if you put the same technology on an iPhone or iPad, you don’t have that problem anymore. Now you can subtly record the high-quality content on a smartphone without having to take pictures with a VR headset, or worry about damaging your $3,499 hardware.
Analysis: Remain sceptical
As interesting as this rumor may be, we remain skeptical for several reasons.
First, the source is questionable in our opinion. MacRumors says it got the scoop from a supposedly reputable Weibo account. Apparently, this Weibo user has a “proven track record for disclosing information about Apple’s plans.” However, the site does not link to the original post, which we found odd.
The jury is also still in doubt whether or not there is enough space on an iPhone for a spatial camera setup. As the developers of 3D scanning apps told us back in June, you’ll probably need an additional camera far enough away from the main cameras (about the distance between our eyes) to get the necessary depth.
So are the developers behind the popular iPhone photography app Halide recently stated that smartphones “need a significant improvement in terms of processing power and sensor fidelity and quality” to capture good spatial shots. All this means it’s more likely that these next-generation camera setups will appear first on an iPad.
Finally the iPhone Ultra is a rumor in itself. The phone could potentially hit the market next year as the high-end option for the iPhone 16 line. But the problem is that there is no official confirmation that this model is even in the works.
So while spatial photos and videos are certainly a fascinating concept, it remains to be seen if the technology is even possible on a smartphone. For now, we recommend taking all this information with a large grain of salt.