abstract

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction

Authors:

Keng Hua Sing,

Wei XieAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 180 - 183

https://doi.org/10.1145/2851581.2890370

Published: 07 May 2016 Publication History

Get Access

Abstract

Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D reconstruction on Project Tango, a tablet with motion tracking and depth sensing capabilities made by Google. During gameplay, we scan the environment in real-time and build a virtual voxel world. We spawn virtual objects in the voxel world, and allow simple hand and leg interactions. The tablet is mounted on the user's head using the Durovis Dive headset so that the user can see the world in VR. All this is done in ~60 fps for user comfort. With this approach, we have created a fully immersive, untethered experience where players can freely walk around large spaces in the real world and avoid obstacles, while interacting with a virtual environment.

Supplementary Material

suppl.mov (sgc127.m4v)

Supplemental video

Download
98.20 MB

References

[1]

Klingensmith, M., Dryanovski, I., Srinivasa, S., and Xiao, J. Chisel: Real Time Large Scale 3D Reconstruction Onboard a Mobile Device using Spatially Hashed Signed Distance Fields. Robotics: Science and Systems XI, (2015).

Google Scholar

[2]

Matterport 3D Models of Real Interior Spaces. Matterport Homepage Comments. http://matterport.com/.

Google Scholar

[3]

Miksik, O., Torr, P.H., Vineet, V., et al. The Semantic Paintbrush. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems CHI '15, (2015).

Digital Library

Google Scholar

[4]

Minecraft. Minecraft. http://minecraft.net/.

Google Scholar

[5]

Newcombe, R.A., Davison, A.J., Izadi, S., et al. KinectFusion: Real-time dense surface mapping and tracking. 2011 10th IEEE International Symposium on Mixed and Augmented Reality, (2011).

Digital Library

Google Scholar

[6]

Piekarski, W. and Thomas, B. ARQuake: the outdoor augmented reality gaming system. Communications of the ACM Commun. ACM 45, 1 (2002).

Digital Library

Google Scholar

[7]

A Plan to Navigate Virtual Reality and Reality Simultaneously | MIT Technology Review. MIT Technology Review, 2015. http://www.technologyreview.com/news/538336/h ow-to-avoid-real-objects-while-in-a-virtual-world/.

Google Scholar

Cited By

View all

Van Brummelen JUrwin LJohnston OSayed MBrostow G(2024)Don’t Look Now: Audio/Haptic Guidance for 3D Scanning of LandmarksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642271(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642271
Wu XHung HBabu SChuang J(2023)Novel Design and Evaluation of Redirection Controllers Using Optimized Alignment and Artificial Potential FieldIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332020829:11(4556-4566)Online publication date: Nov-2023
https://doi.org/10.1109/TVCG.2023.3320208
Ashfaq HJalal A(2023)3D Shape Estimation from RGB Data Using 2.5D Features and Deep Learning2023 4th International Conference on Advancements in Computational Sciences (ICACS)10.1109/ICACS55311.2023.10089663(1-7)Online publication date: 20-Feb-2023
https://doi.org/10.1109/ICACS55311.2023.10089663
Show More Cited By

Index Terms

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction

Recommendations

Garden: a mixed reality experience
SIGGRAPH '16: ACM SIGGRAPH 2016 VR Village

Garden is a mixed reality (MR) experience on the Project Tango mounted with the Durovis Dive headset. It allows the player to walk around freely in large spaces and avoid obstacles, while immersed in the virtual world. It achieves this using real-time ...
Through Tinted Eyeglasses

EIC Roy Want introduces the special issue on cross-reality environments and discusses alternate realities including virtual reality, augmented reality, embodied virtuality, cross-reality, and mixed reality.
A survey of visual, mixed, and augmented reality gaming
Theoretical and Practical Computer Applications in Entertainment

Visual mixed and augmented realities have historically been applied to the gaming application domain. This article provides a survey of visual mixed and augmented reality gaming in both the academic and commercial contexts. There is an exploration of ...

Comments

Information & Contributors

Information

Published In

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
832
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Van Brummelen JUrwin LJohnston OSayed MBrostow G(2024)Don’t Look Now: Audio/Haptic Guidance for 3D Scanning of LandmarksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642271(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642271
Wu XHung HBabu SChuang J(2023)Novel Design and Evaluation of Redirection Controllers Using Optimized Alignment and Artificial Potential FieldIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332020829:11(4556-4566)Online publication date: Nov-2023
https://doi.org/10.1109/TVCG.2023.3320208
Ashfaq HJalal A(2023)3D Shape Estimation from RGB Data Using 2.5D Features and Deep Learning2023 4th International Conference on Advancements in Computational Sciences (ICACS)10.1109/ICACS55311.2023.10089663(1-7)Online publication date: 20-Feb-2023
https://doi.org/10.1109/ICACS55311.2023.10089663
Yılmaz DKıraç F(2023)Illumination-guided inverse rendering benchmark: Learning real objects with few camerasComputers & Graphics10.1016/j.cag.2023.07.002115(107-121)Online publication date: Oct-2023
https://doi.org/10.1016/j.cag.2023.07.002
Kwon SJeon SHwang JCho YPark JLee I(2022)Infinite Virtual Space Exploration Using Space Tiling and Perceivable Reset at Fixed Positions2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00094(758-767)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00094
SAKATA NKANAMORI KTOMINAGA THIJIKATA YHARADA KKIYOKAWA K(2021)Presenting Walking Route for VR ZombieIEICE Transactions on Information and Systems10.1587/transinf.2020EDP7084E104.D:1(162-173)Online publication date: 1-Jan-2021
https://doi.org/10.1587/transinf.2020EDP7084
Zhang DXu FPun CYang YLan RWang LLi YGao H(2021)Virtual Reality Aided High-Quality 3D Reconstruction by Remote DronesACM Transactions on Internet Technology10.1145/345893022:1(1-20)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3458930
Gulay EKotnik TLucero AKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Exploring a Feedback-Oriented Design Process Through Curved FoldingProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445639(1-8)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445639
Regenbrecht HOtt CPark NDuncan SCollins J(2021)Voxelvideos for Entertainment, Education, and TrainingIEEE Access10.1109/ACCESS.2021.30764889(68185-68196)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3076488
Mao CChen C(2021)Augmented Reality of 3D Content Application in Common Operational Picture Training System for ArmyInternational Journal of Human–Computer Interaction10.1080/10447318.2021.191786537:20(1899-1915)Online publication date: 18-May-2021
https://doi.org/10.1080/10447318.2021.1917865
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Garden: a mixed reality experience

Through Tinted Eyeglasses

A survey of visual, mixed, and augmented reality gaming