How to view Immersity AI content in VR Headset

Immersity AI

For all the methods we will discuss, it all starts in Immersity AI.

Immersity AI Web Application

To view the content from Immersity AI in any other application, we need to first create it and then export it.
To create content follow these simple steps:

1. Sign in on Immersity AI

Immersity AI | Depth Animations

2. Upload an image from your device either by drag & drop or by pressing the upload button
3. Wait for image processing. Once complete a 3D animation will appear
4. Set Edge Dilation to zero:

5. Optional: Perform any depth map edits.



Hint: don’t worry about any other settings such as animation style, length, motion settings, focus at this stage as they relate to the animation you see on the screen. Feel free to play around with them, but be aware that information will be lost when exporting to a depth map and will not be relevant to our import into Blender.



Additionnal Info: To learn how to make adjustments to your depth maps prior to exporting see the General instructions for Immersity AI:

How to Use Immersity AI Features

To acquire the content needed for this tutorial, download a Full Package Export.

The sections below will outline how to process some of the files exported as part of the Full Package Export to view them in a VR Headset. Remember, you also have the choice to selectively download only the required file for a specific section without needing to download the entire Full Package if you are only interested in processing a particular section of this tutorial..

Facebook 3D Export

This is one of the simplest, quickest and also one of the most impacting methods to view your content.

Facebook VR

Step 1
Export

For this you will need to export the Depth Map from Immersity AI . Also take a copy of the Original image. Then rename these files as follows ensuring both files have the same filename except for the suffixes:

• original image use a filename and add a suffixed of “FB-3D”
  Example: image1_FB-3D.png
• depth map use same filename but use a suffix of “FB-3D_depth”
  Example: image1_FB-3D_depth.png

Step 2
Create Post

In Facebook, post 3D image from your computer to your Facebook feed:

1. Click Photo/Video at the top of your News Feed, a group or your Page.

2. Select the 2 files from Step 1 (the image and the depth map), then drag and drop your files onto your post.

3. You will then see some automated processing take place:

4. Add any other text or items to your post that you want included and then click Post

Step 3
Open Post on Quest Headset

In your VR headset use the Browser to open Facebook or use the Facebook (Beta) App directly and navigate to your post. Click View in VR.

Select “View in VR”

Step 4
Enjoy the View

Walking towards picture with VR headset on

Depth Map Export

We have already in another tutorial shown how you can export a depth map and sculpt a model with it in Blender:

Importing Depth Maps from Immersity AI to Blender

You can take this a step further by viewing this model in a VR headset directly from Blender. This is a free solution but does take a little more setup than the Facebook solution. It also has wider support as you are not restricted to a Quest headset here - this should work on any headset that supports OpenXR.

Blender + 3D View Add-On

Step 1
Create 3D model

Follow the steps in the previous tutorial here on how to import depth maps to Blender:



Importing Depth Maps from Immersity AI to Blender

Step 2
Install Add-On

In this step you will be installing an Add-On that comes pre-supplied with Blender called 3D View: VR Scene Inspection.

Enable the Add-On by navigating to Edit > Preferences > Add-Ons and selecting the "3D View: VR Scene Inspection" Add-On.

Step 3
Run OpenXR platform

Here you will need to run the OpenXR platform to connect your VR headset with your PC. Ensure that you have enabled an active OpenXR runtime. The method for this will vary depending on the platform used - refer to guidance below:



For guidance refer to Blender documentation here:

Configuring Peripherals - Blender Manuel

Step 4
Start VR session

The installation of the 3D View Add-On of step 2 creates a new interface. We need to navigate to this interface and then start the VR session.

1. Navigate to 3D Viewport > Sidebar > VR tab. Note that the sidebar can also be opened using “n” keyboard shortcut.
2. Press Start VR Session



For more information refer to Blender documentation here:

VR Scene Inspection — Blender Manual

Step 5
Enjoy the View

Put on VR headset and view the model interactively:



Hint: Use both controllers with triggers pressed to pinch zoom. Use one controller with trigger pressed to move around.

SBS Export

SBS (Side-by-Side) does not offer the same level of immersion compared to the aforementioned techniques. So far the methods facilitate viewing an object from various perspectives and incorporate stereoscopic viewing. In contrast, with an SBS image, your viewing perspective remains fixed. Nevertheless, you can still perceive the stereoscopic dimension of the 3D content.

We present 2 methods here each with different levels of features and cost:

• immerGallery: This is in our opinion the best option, but also carries a costly. It is the most feature rich for our purposes and is the simplest option to set up. It is dedicated software for the very purpose for which we are using it. Is is available for the Quest range of headsets (Meta Quest 2, Meta Quest Pro and Meta Quest 3)
• Virtual Desktop: This also is a paid version, but costs less. It however relies on a PC in addition to the VR headset. It is also not a dedicated solution, but a side feature that allows viewing in 3D of a mirrored PC screen. This solution works from a macOS host as well as from a Windows host.

In both of these methods, a preliminary step is needed before using them. This step involves exporting the image in Side-by-Side (SBS) format. In Immersity AI export the "SBS Parallel" file.

This file has two images on it, one for the left eye and one for the right eye. It is a full width SBS in that the aspect ratio in all directions is maintained from the original.

SBS Image