How to view Immersity AI content in VR Headset

Overview

Did you know you can view the creations you make in Immersity AI on a VR headset? There are various ways to bring these to life in the realm of the immersive and here we will detail a few of these. We will outline:

  • Viewing SBS image in stereo using a number of different methods
  • Viewing Facebook 3D image in native browser
  • Using Depth map in Blender with native VR functionality

These have all been tried on a Meta Quest 2, currently the most commonly used VR headset, but these methods should also work on other headsets where indicated.

Immersity AI

For all the methods we will discuss, it all starts in Immersity AI.

Immersity AI Web Application

To view the content from Immersity AI in any other application, we need to first create it and then export it.
To create content follow these simple steps:

1. Sign in on Immersity AI
Leia Inc.
Immersity AI | Depth Animations
2. Upload an image from your device either by drag & drop or by pressing the upload button
3. Wait for image processing. Once complete a 3D animation will appear
4. Set Edge Dilation to zero:
5. Optional: Perform any depth map edits.
Hint: don’t worry about any other settings such as animation style, length, motion settings, focus at this stage as they relate to the animation you see on the screen. Feel free to play around with them, but be aware that information will be lost when exporting to a depth map and will not be relevant to our import into Blender.
Additionnal Info: To learn how to make adjustments to your depth maps prior to exporting see the General instructions for Immersity AI:
Leia Inc.
How to Use Immersity AI Features

To acquire the content needed for this tutorial, download a Full Package Export.

The sections below will outline how to process some of the files exported as part of the Full Package Export to view them in a VR Headset. Remember, you also have the choice to selectively download only the required file for a specific section without needing to download the entire Full Package if you are only interested in processing a particular section of this tutorial..

Facebook 3D Export

This is one of the simplest, quickest and also one of the most impacting methods to view your content.

For this you will need:
Quest, Quest 2, Quest 3 or Quest Pro Headset

Facebook VR

Step 1
Export
For this you will need to export the Depth Map from Immersity AI . Also take a copy of the Original image. Then rename these files as follows ensuring both files have the same filename except for the suffixes:
  • original image use a filename and add a suffixed of “FB-3D”
    Example: image1_FB-3D.png
  • depth map use same filename but use a suffix of “FB-3D_depth”
    Example: image1_FB-3D_depth.png
Step 2
Create Post
In Facebook, post 3D image from your computer to your Facebook feed:

1. Click Photo/Video at the top of your News Feed, a group or your Page.
2. Select the 2 files from Step 1 (the image and the depth map), then drag and drop your files onto your post.
3. You will then see some automated processing take place:
4. Add any other text or items to your post that you want included and then click Post
Step 3
Open Post on Quest Headset
In your VR headset use the Browser to open Facebook or use the Facebook (Beta) App directly and navigate to your post. Click View in VR.
Select “View in VR”
Step 4
Enjoy the View
Walking towards picture with VR headset on

Depth Map Export

We have already in another tutorial shown how you can export a depth map and sculpt a model with it in Blender:

Leia Inc.
Importing Depth Maps from Immersity AI to Blender

You can take this a step further by viewing this model in a VR headset directly from Blender. This is a free solution but does take a little more setup than the Facebook solution. It also has wider support as you are not restricted to a Quest headset here - this should work on any headset that supports OpenXR.

For this you will need:
  • Headset with OpenXR support
  • OpenXR compatible platform (such as SteamVR, Meta, Vario, Microsoft Windows Mixed Reality).
  • PC running Blender (free)
  • 3D View: VR Scene Inspection Blender Addon (comes with Blender but needs enabling)

Blender + 3D View Add-On

Step 1
Create 3D model
Follow the steps in the previous tutorial here on how to import depth maps to Blender:
Importing Depth Maps from Immersity AI to Blender
Step 2
Install Add-On
In this step you will be installing an Add-On that comes pre-supplied with Blender called 3D View: VR Scene Inspection.

Enable the Add-On by navigating to Edit > Preferences > Add-Ons and selecting the "3D View: VR Scene Inspection" Add-On.
Step 3
Run OpenXR platform
Here you will need to run the OpenXR platform to connect your VR headset with your PC. Ensure that you have enabled an active OpenXR runtime. The method for this will vary depending on the platform used - refer to guidance below:
For guidance refer to Blender documentation here:
Blender
Configuring Peripherals - Blender Manuel
Step 4
Start VR session
The installation of the 3D View Add-On of step 2 creates a new interface. We need to navigate to this interface and then start the VR session.

1. Navigate to 3D Viewport > Sidebar > VR tab. Note that the sidebar can also be opened using “n” keyboard shortcut.
2. Press Start VR Session
For more information refer to Blender documentation here:
Blender
VR Scene Inspection — Blender Manual
Step 5
Enjoy the View
Put on VR headset and view the model interactively:
Hint: Use both controllers with triggers pressed to pinch zoom. Use one controller with trigger pressed to move around.

SBS Export

SBS (Side-by-Side) does not offer the same level of immersion compared to the aforementioned techniques. So far the methods facilitate viewing an object from various perspectives and incorporate stereoscopic viewing. In contrast, with an SBS image, your viewing perspective remains fixed. Nevertheless, you can still perceive the stereoscopic dimension of the 3D content.

We present 2 methods here each with different levels of features and cost:

  • immerGallery: This is in our opinion the best option, but also carries a costly. It is the most feature rich for our purposes and is the simplest option to set up. It is dedicated software for the very purpose for which we are using it. Is is available for the Quest range of headsets (Meta Quest 2, Meta Quest Pro and Meta Quest 3)
  • Virtual Desktop: This also is a paid version, but costs less. It however relies on a PC in addition to the VR headset. It is also not a dedicated solution, but a side feature that allows viewing in 3D of a mirrored PC screen. This solution works from a macOS host as well as from a Windows host.

In both of these methods, a preliminary step is needed before using them. This step involves exporting the image in Side-by-Side (SBS) format. In Immersity AI export the "SBS Parallel" file.

This file has two images on it, one for the left eye and one for the right eye. It is a full width SBS in that the aspect ratio in all directions is maintained from the original.

SBS Image

Method 1

immerGallery (paid solution)

Requirements
For this you will need:
  • Meta Quest 2, Meta Quest Pro or Meta Quest 3
  • immerGallery App for Quest device
Step 1
Install immerGallery
You can find the immerGallery download and install instruction here:
immerVR
immerGallery
Youtube
How to install immerGallery and immerGallery Demo for Meta Quest 2
Step 2
Transfer Files
Take the SBS file exported from Immersity AI and place it in the Pictures directory on your Quest 2 using standard file transfer methods. immerVR (the makers of immerGallery) provide guidance on how to do this in their video referenced below:
Youtube
Three Ways to Copy Your Images for immerGallery to your Quest 2
Step 3
Open the SBS file in headset
Open the immerGallery App and navigate to the Local Gallery on the left side menu. There you will find your images. Click on the image you placed in the Pictures directory.
Step 4
Enjoy the View
Put on VR headset and view the model interactively:
Stereo View of Image
Note: you will not see this in stereo here in this 2D video, but in the headset this is a stereo experience.
Step 4
Enjoy the View
Normally the image is automatically detected as 3D, but if this is not the case, you can manually set it to 3D as follows:

1. Navigate to Modify Image
2. Press “+” to go to Expert settings Override image format - Expert
3. Select 3D l/r to ensure that full width SBS image is recognized
Method 2

Virtual Desktop (paid) + Stereo Photo Maker (free) + Windows PC

Requirements
For this you will need:
  • Oculus Quest 1,2,3, Pro, Rift, Rift S
    HTC Vive, Vive Pro, Vive Cosmos, Vive Focus 3, XR Elite
    Pico Neo 3, Pico 4
  • Stereo Photo Maker free App for Windows
  • Virtual Desktop Streamer App running on PC
  • Virtual Desktop VR Headset App running on VR Headset
  • Windows or MacOS
Step 1
Virtual Desktop Setup
Virtual Desktop
You can find the Virtual Desktop Streamer download and install instruction here:
Home | Virtual Desktop
Ensure that this operates and that you can successfully mirror your desktop screen into your VR headset before proceeding.
Step 2
Stereo Photo Maker
Stereo Photo Maker
1. Download Stereo Photo Maker from here:
2. Extract contents from downloaded zip file

3. Click on the app logo and it will open to a blank screen.
Hint for MacOS users - you may encounter issues opening the file due to security settings. Refer to instructions provided by the maker of Stereo Photo Maker in this video for guidance:
Youtube
Downloaded application cannot be executed on Mac
4. Go to “File > Open Stereo Image …” and open the SBS image exported from Immersity AI. Ensure that you select Side-by-Side when opening:
5. Select Stereo > Side-by-Side > Side-by-Side in the menu (or press F9) to ensure that we are in full width SBS mode.

6. Move the Stereo Photo Maker window to the monitor that you will mirror to your Virtual Desktop app.

Stereo Photo Maker should now show something like this:
Step 3
Connect to PC
1. Open Virtual Desktop Streamer app on your PC or Mac
2. Open Virtual Desktop App on your VR Headset
3. Click on the computer you want to connect to
4. Switch monitor if required to select the monitor that has the Stereo Photo Maker window:
5. Enable your virtual keyboard:
6. Place Stereo Photo Maker into Full Screen mode from within your VR headset by selecting View > Full-Screen > Full Screen from the Stereo Photo Maker menu (using the virtual keyboard).
Hint: if you set Stereo Photo Maker into full screen mode prior to switching screens, sometimes only part of the screen appears to be shown.
7.. Place your screen into 3D mode by selecting the Full SBS mode:
Step 4
Enjoy the View
Hint: Using virtual keyboard you can
  • use spacebar / backspace to go next / previous image
  • click on screen then use joystick to zoom in / out
  • use left/right arrow keys to change the depth position
Share this tutorial:

Join our Discord community to connect with fellow Immersity AI users.

Discord