research-article

Beyond Halo and Wedge: visualizing out-of-view objects on head-mounted virtual and augmented reality devices

Authors:

Uwe Gruenefeld,

Abdallah El Ali,

Wilko HeutenAuthors Info & Claims

MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 40, Pages 1 - 11

https://doi.org/10.1145/3229434.3229438

Published: 03 September 2018 Publication History

Abstract

Head-mounted devices (HMDs) for Virtual and Augmented Reality (VR/AR) enable us to alter our visual perception of the world. However, current devices suffer from a limited field of view (FOV), which becomes problematic when users need to locate out of view objects (e.g., locating points-of-interest during sightseeing). To address this, we developed and evaluated in two studies HaloVR, WedgeVR, HaloAR and WedgeAR, which are inspired by usable 2D off-screen object visualization techniques (Halo, Wedge). While our techniques resulted in overall high usability, we found the choice of AR or VR impacts mean search time (VR: 2.25s, AR: 3.92s) and mean direction estimation error (VR: 21.85°, AR: 32.91°). Moreover, while adding more out-of-view objects significantly affects search time across VR and AR, direction estimation performance remains unaffected. We provide implications and discuss the challenges of designing for VR and AR HMDs.

References

[1]

Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: A Technique for Visualizing Off-screen Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 481--488.

Digital Library

[2]

John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[3]

Stefano Burigat, Luca Chittaro, and Silvia Gabrielli. 2006. Visualizing Locations of Off-screen Objects on Mobile Devices: A Comparative Evaluation of Three Approaches. In Proceedings of the 8th Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '06). ACM, New York, NY, USA, 239--246.

Digital Library

[4]

Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2009. A Review of Overview+Detail, Zooming, and Focus+Context Interfaces. ACM Comput. Surv. 41, 1, Article 2 (Jan. 2009), 31 pages.

Digital Library

[5]

Uwe Gruenefeld, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2017a. Visualizing Out-of-view Objects in Head-mounted Augmented Reality. In Proceedings of the 19th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA.

Digital Library

[6]

Uwe Gruenefeld, Dag Ennenga, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2017b. EyeSee360: Designing a Visualization Technique for Out-of-view Objects in Head-mounted Augmented Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (SUI '17). ACM, New York, NY, USA, 109--118.

Digital Library

[7]

Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: Clutter-free Visualization of Off-screen Locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 787--796.

Digital Library

[8]

Sean G. Gustafson and Pourang P. Irani. 2007. Comparing Visualizations for Tracking Off-screen Moving Targets. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI EA '07). ACM, New York, NY, USA, 2399--2404.

Digital Library

[9]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52 (1988), 139 -- 183.

[10]

Niels Henze and Susanne Boll. 2010. Evaluation of an Off-screen Visualization for Magic Lens and Dynamic Peephole Interfaces. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 191--194.

Digital Library

[11]

Niels Henze, Benjamin Poppinga, and Susanne Boll. 2010. Experiments in the Wild: Public Evaluation of Off-screen Visualizations in the Android Market. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10). ACM, New York, NY, USA, 675--678.

Digital Library

[12]

James Kalat. 2015. Biological psychology. Nelson Education.

[13]

Yen-Chen Lin, Yung-Ju Chang, Hou-Ning Hu, Hsien-Tzu Cheng, Chi-Wen Huang, and Min Sun. 2017. Tell Me Where to Look: Investigating Ways for Assisting Focus in 360 Video. In Proc. CHI '17. ACM, New York, NY, USA, 2535--2545.

Digital Library

[14]

Kris Luyten, Donald Degraen, Gustavo Rovelo Ruiz, Sven Coppers, and Davy Vanacken. 2016. Hidden in Plain Sight: An Exploration of a Visual Language for Near-Eye Out-of-Focus Displays in the Peripheral View. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 487--497.

Digital Library

[15]

Albert Michotte, Georges Thines, George. Butterworth, and Alan. Costall. 1991. Michotte's experimental phenomenology of perception / edited by Georges Thines, Alan Costall, George Butterworth. L. Erlbaum Associates Hillsdale, N.J. xi, 258 p. : pages.

[16]

Takuro Nakuo and Kai Kunze. 2016. Smart Glasses with a Peripheral Vision Display. In Proc. UbiComp '16. ACM, New York, NY, USA, 341--344.

Digital Library

[17]

Leif Oppermann, Lisa Blum, and Marius Shekow. 2016. Playing on AREEF: Evaluation of an Underwater Augmented Reality Game for Kids. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 330--340.

Digital Library

[18]

P. Perea, D. Morand, and L. Nigay. 2017. {POSTER} Halo3D: A Technique for Visualizing Off-Screen Points of Interest in Mobile Augmented Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). 170--175.

[19]

Martin Pielot, Oliver Krull, and Susanne Boll. 2010. Where is My Team: Supporting Situation Awareness with Tactile Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1705--1714.

Digital Library

[20]

Manojit Sarkar and Marc H Brown. 1994. Graphical fisheye views. Commun. ACM 37, 12 (1994), 73--83.

Digital Library

[21]

Hans Strasburger, Ingo Rentschler, and Martin Jüttner. 2011. Peripheral vision and pattern recognition: A review. Journal of vision 11, 5 (2011), 13--13.

[22]

Robert Xiao and Hrvoje Benko. 2016. Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proc. CHI '16. ACM, New York, NY, USA, 1221--1232.

Digital Library

[23]

Polle T. Zellweger, Jock D. Mackinlay, Lance Good, Mark Stefik, and Patrick Baudisch. 2003. City Lights: Contextual Views in Minimal Space. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 838--839.

Digital Library

Cited By

Qin YSu JQin HTian Y(2024)Exploring the Role of Video Playback Visual Cues in Object Retrieval TasksSensors10.3390/s2410314724:10(3147)Online publication date: 15-May-2024
https://doi.org/10.3390/s24103147
Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Kelley BWickens CWarden AClegg BOrtega F(2024)2D and 3D Augmented Reality Attention Cueing Comparisons in 3D Target SearchProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126507768:1(1176-1180)Online publication date: 12-Aug-2024
https://doi.org/10.1177/10711813241265077
Show More Cited By

Recommendations

EyeSee360: designing a visualization technique for out-of-view objects in head-mounted augmented reality
SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

Head-mounted displays allow user to augment reality or dive into a virtual one. However, these 3D spaces often come with problems due to objects that may be out of view. Visualizing these out-of-view objects is useful under certain scenarios, such as ...
Visualizing out-of-view objects in head-mounted augmented reality
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

Various off-screen visualization techniques that point to off-screen objects have been developed for small screen devices. A similar problem arises with head-mounted Augmented Reality (AR) with respect to the human field-of-view, where objects may be ...
FlyingARrow: Pointing Towards Out-of-View Objects on Augmented Reality Devices
PerDis '18: Proceedings of the 7th ACM International Symposium on Pervasive Displays

Augmented Reality (AR) devices empower users to enrich their surroundings by pinning digital content onto real world objects. However, current AR devices suffer from having small fields of view, making the process of locating spatially distributed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2018

552 pages

ISBN:9781450358989

DOI:10.1145/3229434

General Chairs:
Lynne Bailie,
Nuria Oliver

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '18

Sponsor:

SIGCHI

MobileHCI '18: 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 3 - 6, 2018

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
757
Total Downloads

Downloads (Last 12 months)112
Downloads (Last 6 weeks)5

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Qin YSu JQin HTian Y(2024)Exploring the Role of Video Playback Visual Cues in Object Retrieval TasksSensors10.3390/s2410314724:10(3147)Online publication date: 15-May-2024
https://doi.org/10.3390/s24103147
Yangfu RZhiqiang LSonghai Z(2024)Survey of visualization methods for multiscene visual cue information in immersive environmentsJournal of Image and Graphics10.11834/jig.22114729:1(1-21)Online publication date: 2024
https://doi.org/10.11834/jig.221147
Kelley BWickens CWarden AClegg BOrtega F(2024)2D and 3D Augmented Reality Attention Cueing Comparisons in 3D Target SearchProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126507768:1(1176-1180)Online publication date: 12-Aug-2024
https://doi.org/10.1177/10711813241265077
Truillet CSerrano MDubois E(2024)Interaction with Physical Referents In and Around the Field of View of Optical See-Through Augmented-Reality HeadsetsProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649796(1-15)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649796
Franz RJunuzovic SMott M(2024)A Virtual Reality Scene Taxonomy: Identifying and Designing Accessible Scene-Viewing TechniquesACM Transactions on Computer-Human Interaction10.1145/363514231:2(1-44)Online publication date: 5-Feb-2024
https://dl.acm.org/doi/10.1145/3635142
Lee CKim JYi HLee W(2024)Viewer2Explorer: Designing a Map Interface for Spatial Navigation in Linear 360 Museum Exhibition VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642952(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642952
Kelley BWickens CClegg BWarden AOrtega F(2024)Guiding Gaze: Comparing Cues for Visual Search2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00323(1053-1054)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00323
Woodworth JKhokhar ARahman YKulshreshth ABorst C(2024)Attention Guidance In The Wild: An Experiment Testing Visual Guidance Cues for VR Field Trips at High Schools2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00035(173-179)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00035
Lee GLee DSu GManocha D(2024)“May I Speak?”: Multi-Modal Attention Guidance in Social VR Group ConversationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337211930:5(2287-2297)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372119
Woodworth JBorst C(2024)Visual cues in VR for guiding attention vs. restoring attention after a short distractionComputers and Graphics10.1016/j.cag.2023.12.008118:C(194-209)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.cag.2023.12.008
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents