skip to main content
10.1145/3313831.3376742acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Getting out of Out of Sight: Evaluation of AR Mechanisms for Awareness and Orientation Support in Occluded Multi-Room Settings

Published: 23 April 2020 Publication History

Abstract

Augmented Reality can provide orientation and awareness in situations in which objects or people are occluded by physical structures. This is relevant for many situations in the workplace, where objects are scattered across rooms and people are out of sight. While several AR mechanisms have been proposed to provide awareness and orientation in these situations, little is known about their effect on people's performance when searching objects and coordinating with each other. In this paper, we compare three AR based mechanisms (map, x-ray, compass) according to their utility, usability, social presence, task load and users' preferences. 48 participants had to work together in groups of four to find people and objects located around different rooms. Results show that map and x-ray performed best but provided least social presence among participants. We discuss these and other observations as well as potential impacts on designing AR awareness and orientation support.

References

[1]
Addlesee, M., Curwen, R., Hodges, S., Newman, J., Steggles, P., Ward, A. and Hopper, A. 2001. Implementing a sentient computing system. Computer. 34, 8 (Aug. 2001), 50--56.
[2]
Agrawal, A., Acharya, G., Balasubramanian, K., Agrawal, N. and Chaturvedi, R. 2016. A Review on the use of Augmented Reality to Generate Safety Awareness and Enhance Emergency Response. International Journal of Current Engineering and Technology. 6, 3 (Jun. 2016), 813--820.
[3]
Anthony J. de Belen, R., Nguyen, H., Filonik, D., Del Favero, D., Bednarz, T., 1 Expanded Perception and Interaction Centre (EPICentre), Faculty of Art & Design, University of New South Wales, Sydney, NSW 2021, Australia and 2 CSIRO Data61, Australian Technology Park, Eveleigh, NSW 2015, Astralia 2019. A systematic review of the current state of collaborative mixed reality technologies: 2013--2018. AIMS Electronics and Electrical Engineering. 3, 2 (2019), 181--223.
[4]
Azuma, R.T. 1997. A survey of augmented reality. Presence. 6, 4 (1997), 355--385.
[5]
Bacca, J., Baldiris, S., Fabregat, R., Graf, S. and Kinshuk 2014. Augmented reality trends in education: a systematic review of research and applications. Journal of Educational Technology & Society. 17, 4 (2014), 133.
[6]
Bane, R. and Hollerer, T. 2004. Interactive Tools for Virtual X-Ray Vision in Mobile Augmented Reality. Third IEEE and ACM International Symposium on Mixed and Augmented Reality (Arlington, VA, USA, 2004), 231--239.
[7]
Barnum, P., Sheikh, Y., Datta, A. and Kanade, T. 2009. Dynamic seethroughs: Synthesizing hidden views of moving objects. 2009 8th IEEE International Symposium on Mixed and Augmented Reality (2009), 111--114.
[8]
Barsom, E.Z., Graafland, M. and Schijven, M.P. 2016. Systematic review on the effectiveness of augmented reality applications in medical training. Surgical Endoscopy. 30, 10 (Oct. 2016), 4174--4183.
[9]
Baudisch, P. and Rosenholtz, R. 2003. Halo: a technique for visualizing off-screen objects. Proceedings of the SIGCHI conference on Human factors in computing systems (2003), 481--488.
[10]
Bell, B., Höllerer, T. and Feiner, S. 2002. An Annotated Situation-awareness Aid for Augmented Reality. Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (New York, NY, USA, 2002), 213--216.
[11]
Bhorkar, G. 2017. A Survey of Augmented Reality Navigation. arXiv:1708.05006 [cs]. (Aug. 2017).
[12]
Bier, E.A., Stone, M.C., Pier, K., Buxton, W. and DeRose, T.D. 1993. Toolglass and Magic Lenses: The See-Through Interface. (1993), 8.
[13]
Bimber, O. and Frohlich, B. 2002. Occlusion shadows: using projected light to generate realistic occlusion effects for view-dependent optical see-through displays. Proceedings. International Symposium on Mixed and Augmented Reality (Darmstadt, Germany, 2002), 186--319.
[14]
Biocca, F., Harms, C. and Gregg, J. 2001. The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. 4th annual international workshop on presence, Philadelphia, PA (2001), 1--9.
[15]
Biocca, F., Tang, A., Owen, C. and Xiao, F. 2006. Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms. Proceedings of the SIGCHI conference on Human Factors in computing systems (2006), 1115--1122.
[16]
Bork, F., Schnelzer, C., Eck, U. and Navab, N. 2018. Towards Efficient Visual Guidance in Limited Fieldof-View Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics. 24, 11 (Nov. 2018), 2983--2992.
[17]
Carey, M., Tony, B., Vlasti, B., Annette, S., Darren, G. and Weidong, H. 2017. Helping Hands: Using Augmented Reality to Provide Remote Guidance to Health Professionals. Studies in Health Technology and Informatics. (2017), 57--62.
[18]
Caudell, T.P. and Mizell, D.W. 1992. Augmented reality: an application of heads-up display technology to manual manufacturing processes. Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences (Kauai, HI, USA, 1992), 659--669 vol.2.
[19]
Chittaro, L. and Venkataraman, S. 2006. Navigation aids for multi-floor virtual buildings: A comparative evaluation of two approaches. (Nov. 2006), 9.
[20]
Datcu, D., Lukosch, S.G. and Lukosch, H.K. 2016. Handheld Augmented Reality for Distributed Collaborative Crime Scene Investigation. Proceedings of the 19th International Conference on Supporting Group Work (Sanibel Island, Florida, USA, 2016), 267--276.
[21]
Dey, A., Jarvis, G., Sandor, C., Wibowo, A.K. and Mattila, V.-V. 2011. An Evaluation of Augmented Reality X-Ray Vision for Outdoor Navigation. 21st International Conference on Artificial Reality and Telexistence (2011).
[22]
Dünser, A., Billinghurst, M., Wen, J., Lehtinen, V. and Nurminen, A. 2012. Exploring the use of handheld AR for outdoor navigation. Computers & Graphics. 36, 8 (Dec. 2012), 1084--1095.
[23]
Esengün, M. and Ince, G. 2016. Comparative Assessment of Mobile Navigation Applications using 2D Maps and Augmented Reality Interfaces. ACHI 2016 (2016).
[24]
Fakourfar, O., Ta, K., Tang, R., Bateman, S. and Tang, A. 2016. Stabilized Annotations for Mobile Remote Assistance. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2016), 1548--1560.
[25]
Feiner, S., MacIntyre, B., Höllerer, T. and Webster, A. 1997. A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment. (Dec. 1997), 8.
[26]
Fischer, J.E., Jiang, W., Kerne, A., Greenhalgh, C., Ramchurn, S.D., Reece, S., Pantidi, N. and Rodden, T. 2014. Supporting team coordination on the ground: requirements from a mixed reality game. COOP 2014Proceedings of the 11th International Conference on the Design of Cooperative Systems, 27--30 May 2014, Nice (France) (2014), 49--67.
[27]
Foyle, D.C., Andre, A.D. and Hooey, B.L. 2005. Situation Awareness in an Augmented Reality Cockpit: Design, Viewpoints and Cognitive Glue. A. D. (2005), 11.
[28]
Foyle, D.C., Andre, A.D., McCann, R.S., Wenzel, E.M., Begault, D.R. and Battiste, V. 1996. Taxiway Navigation and Situation Awareness (T-NASA) System: Problem, Design Philosophy, and Description of an Integrated Display Suite for Low-Visibility Airport Surface Operations. Technical Report #965551. SAE International.
[29]
French, G.A. and Schnell, T. 2003. Terrain awareness amp;amp; pathway guidance for head-up displays (tapguide); a simulator study of pilot performance. Digital Avionics Systems Conference, 2003. DASC '03. The 22nd (Oct. 2003), 9.C.4--9.1--7 vol.2.
[30]
Funk, M., Boldt, R., Pfleging, B., Pfeiffer, M., Henze, N. and Schmidt, A. 2014. Representing indoor location of objects on wearable computers with head-mounted displays. Proceedings of the 5th Augmented Human International Conference on - AH '14 (Kobe, Japan, 2014), 1--4.
[31]
Goldiez, B.F., Ahmad, A.M. and Hancock, P.A. 2007. Effects of Augmented Reality Display Settings on Human Wayfinding Performance.
[32]
Gruenefeld, U., Ali, A.E., Boll, S. and Heuten, W. 2018. Beyond Halo and Wedge: Visualizing Out-ofview Objects on Head-mounted Virtual and Augmented Reality Devices. Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (New York, NY, USA, 2018), 40:1--40:11.
[33]
Gruenefeld, U., Ali, A.E., Heuten, W. and Boll, S. 2017. Visualizing out-of-view objects in head-mounted augmented reality. Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services MobileHCI '17 (Vienna, Austria, 2017), 1--7.
[34]
Gruenefeld, U., Ennenga, D., Ali, A.E., Heuten, W. and Boll, S. 2017. EyeSee360: Designing a Visualization Technique for Out-of-view Objects in Head-mounted Augmented Reality. Proceedings of the 5th Symposium on Spatial User Interaction (New York, NY, USA, 2017), 109--118.
[35]
Hart, S.G. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 50, 9 (Oct. 2006), 904--908.
[36]
Henderson, S. and Feiner, S. 2011. Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair. IEEE Transactions on Visualization and Computer Graphics. 17, 10 (Oct. 2011), 1355--1368.
[37]
Holm, S. 1979. A Simple Sequentially Rejective Multiple Test Procedure. Scandinavian Journal of Statistics. 6, 2 (1979), 65--70.
[38]
Kim, K.-H. and Wohn, K.-Y. 2011. Effects on Productivity and Safety of Map and Augmented Reality Navigation Paradigms. IEICE Transactions on Information and Systems. E94-D, 5 (2011), 1051-- 1061.
[39]
Kim, S. and Dey, A.K. 2009. Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation. Proceedings of the 27th international conference on Human factors in computing systems - CHI 09 (Boston, MA, USA, 2009), 133.
[40]
Kort, de Y.A.W., IJsselsteijn, W.A., Poels, K., Moreno, L and Human Technology Interaction 2007. Digital games as social presence technology?: development of the social presence in gaming questionnaire (SPGQ). 10th Annual International Workshop on Presence (PRESENCE 2007), October 25--27, 2007, Barcelona, Spain (2007).
[41]
Li, M., Arning, K., Sack, O., Park, J., Kim, M.-H., Ziefle, M. and Kobbelt, L. 2014. Evaluation of a Mobile Projector-Based Indoor Navigation Interface. Interacting with Computers. 26, 6 (Nov. 2014), 595-- 613.
[42]
Li, R., Skopljak, B., He, S., Tang, P., Yilmaz, A. and Jiang, J. 2010. A Spatial Orientation and Information System for Indoor Spatial Awareness. Proceedings of the 2Nd ACM SIGSPATIAL International Workshop on Indoor Spatial Awareness (New York, NY, USA, 2010), 10--15.
[43]
Livingston, M.A., Ai, Z., Karsch, K. and Gibson, G.O. 2011. User interface design for military AR applications. Virtual Reality. 15, 2--3 (Jun. 2011), 175-- 184.
[44]
Livingston, M.A., Swan, J.E., Gabbard, J.L., Hollerer, T.H., Hix, D., Julier, S.J., Baillot, Y. and Brown, D. 2003. Resolving multiple occluded layers in augmented reality. The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings. (Tokyo, Japan, 2003), 56-- 65.
[45]
Morrison, A., Oulasvirta, A., Peltonen, P., Lemmela, S., Jacucci, G., Reitmayr, G., Näsänen, J. and Juustila, A. 2009. Like bees around the hive: a comparative study of a mobile augmented reality map. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2009), 1889--1898.
[46]
Mulloni, A., Dünser, A. and Schmalstieg, D. 2010. Zooming Interfaces for Augmented Reality Browsers. Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (New York, NY, USA, 2010), 161--170.
[47]
Narzt, W., Pomberger, G., Ferscha, A., Kolb, D., Müller, R., Wieghardt, J., Hörtner, H. and Lindinger, C. 2006. Augmented reality navigation systems. Universal Access in the Information Society. 4, 3 (Mar. 2006), 177--187.
[48]
Park, K.S., Kapoor, A. and Leigh, J. 2000. Lessons learned from employing multiple perspectives in a collaborative virtual environment for visualizing scientific data. Proceedings of the third international conference on Collaborative virtual environments CVE '00 (San Francisco, California, United States, 2000), 73--82.
[49]
Prilla, M., Janßen, M. and Kunzendorff, T. 2019. How to interact with AR Head Mounted Devices in care work? A study comparing handheld touch (hands-on) and gesture (hands-free) interaction. European Conference on Information Systems (ECIS 2019) (Stockholm, 2019).
[50]
Ramirez, L., Dyrks, T., Gerwinski, J., Betz, M., Scholz, M. and Wulf, V. 2012. Landmarke: an ad hoc deployable ubicomp infrastructure to support indoor navigation of firefighters. Personal and Ubiquitous Computing. 16, 8 (Dec. 2012), 1025--1038.
[51]
Reitmayr, G. and Schmalstieg, D. 2003. Location based Applications for Mobile Augmented Reality. AUIC (2003).
[52]
Renner, P. and Pfeiffer, T. 2017. Attention guiding techniques using peripheral vision and eye tracking for feedback in augmented-reality-based assistance systems. 2017 IEEE Symposium on 3D User Interfaces (3DUI) (2017), 186--194.
[53]
Riehle, T.H., Lichter, P. and Giudice, N.A. 2008. An indoor navigation system to support the visually impaired. 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Vancouver, BC, Aug. 2008), 4435--4438.
[54]
Schinke, T., Henze, N. and Boll, S. 2010. Visualization of off-screen objects in mobile augmented reality. Proceedings of the 12th international conference on Human computer interaction with mobile devices and services - MobileHCI '10 (Lisbon, Portugal, 2010), 313.
[55]
Schmalstieg, D. and Höllerer, T. 2016. Augmented reality: principles and practice. Addison-Wesley.
[56]
Schwerdtfeger, B. and Klinker, G. 2008. Supporting order picking with Augmented Reality. 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (Cambridge, UK, Sep. 2008), 91-- 94.
[57]
Shepard, R.N. and Metzler, J. 1971. Mental Rotation of Three-Dimensional Objects. Science. 171, 3972 (Feb. 1971), 701--703.
[58]
Siebert, J.N., Ehrler, F., Gervaix, A., Haddad, K., Lacroix, L., Schrurs, P., Sahin, A., Lovis, C. and Manzano, S. 2017. Adherence to AHA Guidelines When Adapted for Augmented Reality Glasses for Assisted Pediatric Cardiopulmonary Resuscitation: A Randomized Controlled Trial. Journal of Medical Internet Research. 19, 5 (May 2017), e183.
[59]
Suomela, R. and Lehikoinen, J. 2000. Context compass. Digest of Papers. Fourth International Symposium on Wearable Computers (Oct. 2000), 147-- 154.
[60]
Tang, A., Owen, C., Biocca, F. and Mou, W. 2003. Comparative effectiveness of augmented reality in object assembly. Proceedings of the conference on Human factors in computing systems - CHI '03 (Ft. Lauderdale, Florida, USA, 2003), 73.
[61]
Tsuda, T., Yamamoto, H., Kameda, Y. and Ohta, Y. 2006. Visualization Methods for Outdoor See-Through Vision. (2006), 10.
[62]
Wani, A.R., Shabir, S. and Naaz, R. 2014. Augmented Reality for Fire & Emergency Services. (2014).

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
10688 pages
ISBN:9781450367080
DOI:10.1145/3313831
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Check for updates

Author Tags

  1. ar
  2. awareness
  3. cooperation
  4. coordination
  5. occlusion
  6. orientation support
  7. social presence

Qualifiers

  • Research-article

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)61
  • Downloads (Last 6 weeks)3
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media