Garden: A mixed reality experience combining virtual reality and 3D reconstruction

KH Sing, W Xie - Proceedings of the 2016 CHI conference extended …, 2016 - dl.acm.org
KH Sing, W Xie
Proceedings of the 2016 CHI conference extended abstracts on human factors …, 2016dl.acm.org
Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and
Augmented Reality (AR), and lets players transform their environment into a virtual garden
they can play in. This is done by doing both stereoscopic rendering and 3D reconstruction
on Project Tango, a tablet with motion tracking and depth sensing capabilities made by
Google. During gameplay, we scan the environment in real-time and build a virtual voxel
world. We spawn virtual objects in the voxel world, and allow simple hand and leg …
Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D reconstruction on Project Tango, a tablet with motion tracking and depth sensing capabilities made by Google. During gameplay, we scan the environment in real-time and build a virtual voxel world. We spawn virtual objects in the voxel world, and allow simple hand and leg interactions. The tablet is mounted on the user's head using the Durovis Dive headset so that the user can see the world in VR. All this is done in ~60 fps for user comfort. With this approach, we have created a fully immersive, untethered experience where players can freely walk around large spaces in the real world and avoid obstacles, while interacting with a virtual environment.
ACM Digital Library