Tag Archives: technology

Apple Vision Pro: Enabling Spatial Interaction

We have various terms for AR – like Mixed Reality, Metaverse, Spatial-ware, XR. Among these, Apple’s term “Spatial Computing” stands out for its emphasis on integrating physical space and digital interactivity. This resonates with me, as the concept of “Spatial” reflects how we model and interact with space in meaningful ways. Years ago, I made up a new term “SpatialIn”—an open-ended label where “In” simply means Spatial is “in.” Later, with advancements like ARKit, I extended this idea into “Spatial Interactive,” emphasizing the interactive potential of space around us behaving like a dynamic canvas. Vision Pro aligns perfectly with this vision. After testing Vision Pro , here are my key observations:

  1. Hands-Free Interaction

Vision Pro’s hands-free interaction feels intuitive. Manipulating virtual objects with gestures or gaze eliminates barriers and enhances usability. Fluent hand movements remind me of my Tai-Chi classes from years ago.

  1. From VR to True Mixed Reality Immersion

Unlike VR, Vision Pro allows safer navigation in real spaces while engaging with virtual elements. It maintains spatial awareness and visual contact with reality, making it both practical and immersive.

  1. Unmatched Persistence

Vision Pro’s capability to retain virtual object placement across sessions is impressive. This feature is critical for practical applications such as architectural design, where models need to stay precisely where placed for accurate spatial referencing, or in education, where persistent virtual setups can create consistent and engaging learning environments. I found a model I placed earlier in the day still standing on the lower floor of the building—exactly where I left it. This happens without explicit relocalization notification for the user, as the virtual model sticks to the physical space even across different floors. A must for advanced spatial computing design as virtual space must keep integrity similar to physical one.

  1. Feeling Rendering on My Hands – sort of

The wide field of view and detailed lighting ensure a natural integration of digital and physical environments. Soft shadows and consistency make virtual elements feel tangible. Fidelity is so high that it creates the illusion of tactile sensation when interacting with virtual models. While purely subjective, this visual illusion convincingly engages my sense of touch, making the experience feel remarkably real to me. This visual-feel integration adds a layer of immersion that goes beyond sight and sound, engaging the sense of presence in a way that feels almost instinctive.

Here is a little example – while using only flat browser with WebGL powered MapLibreGL there:

As there is no 3D map from Apple to test on the device by default, I had to convert a gltf to USDZ and send it to device for QuickLook to get experience of how 3D city would look like there.Here it goes: