research-article

Interaction in Augmented Reality: Challenges to Enhance User Experience

Authors:

Yahya Ghazwani,

Shamus SmithAuthors Info & Claims

ICVARS '20: Proceedings of the 2020 4th International Conference on Virtual and Augmented Reality Simulations

Pages 39 - 44

https://doi.org/10.1145/3385378.3385384

Published: 18 May 2020 Publication History

Abstract

Augmented reality (AR) is an emerging technology that has yet to be a mature consumer product. Given that user experience plays a significant role in the success of new technologies, the development of appropriate AR user interfaces needed. As such, defining the challenges to current AR user interfaces is a steppingstone to enhancing user experience. There are three principal components of interaction in AR systems: the user, the user interface and the virtual content. Examples from the literature are provided to identify the challenges to each interaction component. Both the layout of the AR interaction component and the identified challenges aim to help and inform researchers and AR software developers to choose the AR interaction aspects that best serves their purpose, while also contributing to the enhancement of user experience.

References

[1]

Azuma, R. T. A survey of augmented reality. Presence: Teleoper. Virtual Environ., 6, 4 (1997), 355--385. DOI=https://doi.org/10.1162/pres.1997.6.4.355

Digital Library

[2]

Milgram, P. and Kishino, F. A taxonomy of mixed reality visual displays. IEICE Trans. Information Systems, vol. E77-D, no. 12(1994), 1321--1329.

[3]

Perkins, S. L., Lin, M. A., Srinivasan, S., Wheeler, A. J., Hargreaves, B. A. and Daniel, B. L. A mixed-reality system for breast surgical planning. Proc. IEEE Int. Symp. Mixed Augmented Reality (ISMAR-Adjunct), Oct. 2017, pp. 269--274. DOI=https://doi.org/10.1109/ISMAR-Adjunct.2017.92

[4]

Havard, V., Baudry, D., Louis, A. and Mazari, B. Augmented reality maintenance demonstrator and associated modelling. Proc. IEEE Virtual Reality (VR), Mar. 2015 pp. 329--330. DOI=https://doi.org/10.1109/VR.2015.7223429

[5]

Andrea, R., Lailiyah, S. R., Agus, F. and Ramadiani, R. "Magic Boosed" an elementary school geometry textbook with marker-based augmented reality. TELKOMNIKA Indonesian Journal of Electrical Engineering, 17 (2019), 1242--1249. DOI=http://dx.doi.org/10.12928/telkorrmika.v17i3.11559

[6]

Turkan, Y., Radkowski, R., Karabulut-Ilgu, A., Behzadan, A. H. and Chen, A. Mobile augmented reality for teaching structural analysis. Advanced Engineering Informatics, 34 (2017), 90--100

Digital Library

[7]

Kaufmann, H. and Schmalstieg, D. Mathematics and geometry education with collaborative augmented reality. Computers & Graphics, 27, 3 (2003), 339--345. DOI=https://doi.org/10.1016/S0097-8493(03)00028-1

[8]

Lorensen, W., Cline, H., Nafis, C., Kikinis, R., Altobelli, D. and Gleason, L. Enhancing reality in the operating room. Proc. Visualization in Biomedical Computing '93 (VBC'93), 1993. pp. 410--415. DOI=https://doi.org/10.1109/VISUAL.1993.398902

[9]

Gündüz, G. F. Instructional Techniques: Instructional Process and Concepts in Theory and Practice. Springer Singapore, 2016. pp. 147--232. DOI=https://doi.org/10.1007/978-981-10-2519-8_4

[10]

Rekimoto, J. and Nagao, K. The world through the computer: Computer augmented interaction with real world environments. Proc. ACM Symp. User Interface Software and Technology, 1995, pp. 29--36. DOI=https://doi.org/10.1145/215585.215639

Digital Library

[11]

Zillner, J., Mendez, E. and Wagner, D. Augmented reality remote collaboration with dense reconstruction. 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany, 2018, pp. 38--39. DOI= https://doi.org/10.1109/ISMAR-Adjunct.2018.00028

[12]

Feiner, S., MacIntyre, B., Hollerer, T. and Webster, A. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies, 1(4): 1997, pp. 208--217. DOI=https://doi.org/10.1007/BF01682023

[13]

Bajura, M., Fuchs, H. and Ohbuchi, R. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '92). ACM, New York, NY, USA, 203--210.

Digital Library

[14]

Wagner, D. and Barakonyi, I. Augmented reality kanji learning. The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings., Tokyo, Japan, 2003, pp. 335--336. DOI=https://doi.org/10.1109/ISMAR.2003.1240747

[15]

Choi, J., Yoon, B., Jung, C. and Woo, W. ARClassNote: Augmented reality based remote education solution with tag recognition and shared hand-written note. 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, 2017, pp. 303--309. DOI=https://doi.org/10.1109/ISMAR-Adjunct.2017.94

[16]

Billinghurst, M., Clark, A. and Lee, G. A survey of augmented reality. Found. Trends Hum.-Comput. Interact., 8, 2-3 (2015), 73--272. DOI=https://doi.org/10.1561/1100000049

Digital Library

[17]

Bowman, D. A., Coquillart, S., Froehlich, B., Hirose, M., Kitamura, Y., Kiyokawa, K. and Stuerzlinger, W. 3D user interfaces: New directions and perspectives. IEEE Computer Graphics and Applications, 28, 6 (2008), 20--36. DOI=https://doi.org/10.1109/MCG.2008.109

Digital Library

[18]

Bowman, D. A., Kruijff, E., LaViola, J. J. and Poupyrev, I. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., 2004.

Digital Library

[19]

Schmalstieg, D., Fuhrmann, A. and Hesina, G. Bridging multiple user interface dimensions with augmented reality. In ISAR '00, pp. 20--29, 2000. DOI=https://doi.org/10.1109/ISAR.2000.880919

[20]

Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K. and Tachibana, K. Virtual object manipulation on a table-top AR environment. Proceedings IEEE and ACM International Symposium on Augmented Reality, Munich, Germany, 2000, pp. 111--119. DOI=https://doi.org/10.1109/ISAR.2000.880934

[21]

Lee, J. Y., Rhee, G. W. and Seo, D. W. Hand gesture-based tangible interactions for manipulating virtual objects in a mixed reality environment. The International Journal of Advanced Manufacturing Technology, 51, 9 (2010), 1069--1082. DOI=https://doi.org/10.1007/s00170-010-2671-x

[22]

Lee, G. A., Billinghurst, M. and Kim, G. J. Occlusion based interaction methods for tangible augmented reality environments. Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry (Singapore, 2004). ACM, pp. 419--426. DOI= https://doi.org/10.1145/1044588.1044680

Digital Library

[23]

Hilliges, O., Kim, D., Izadi, S., Weiss, M. and Wilson, A. HoloDesk: Direct 3d interactions with a situated see-through display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2421--2430. DOI=https://doi.org/10.1145/2207676.2208405

Digital Library

[24]

Nabiyouni, M., Saktheeswaran, A., Bowman, D. A. and Karanth, A. Comparing the performance of natural, semi-natural, and non-natural locomotion techniques in virtual reality. 2015 IEEE Symposium on 3D User Interfaces (3DUI), Arles, 2015, pp. 3--10. DOI=https://doi.org/10.1109/3DUI.2015.7131717

[25]

Olwal, A., Benko, H. and Feiner, S. SenseShapes: Using statistical geometry for object selection in a multimodal augmented reality system. The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003, Tokyo, Japan, 2003, pp. 300--301. DOI=https://doi.org/10.1109/ISMAR.2003.1240730

[26]

Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Li, X., Cohen, P. and Feiner, S. Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality. Proc. ICMI 2003 (Fifth Int. Conf. on Multimodal Interfaces), 2003, pp. 12--19. DOI=http://dx.doi.org/10.1145/958432.958438

Digital Library

Cited By

Javaheri HGhamarnejad OLukowicz PStavrou GKarolus JKostakos VKay JHoang T(2024)ARAS: LLM-Supported Augmented Reality Assistance System for Pancreatic SurgeryCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677543(176-180)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677543
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Albeedan MKolivanda HHammady R(2024)Designing and evaluation of a mixed reality system for crime scene investigation training: a hybrid approachVirtual Reality10.1007/s10055-024-01018-828:3Online publication date: 25-Jun-2024
https://doi.org/10.1007/s10055-024-01018-8
Show More Cited By

Index Terms

Interaction in Augmented Reality: Challenges to Enhance User Experience
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
An Interaction Design Model for Information Visualization in Immersive Augmented Reality platform
MoMM2019: Proceedings of the 17th International Conference on Advances in Mobile Computing & Multimedia

Recent advances in immersive technologies such as Augmented Reality (AR) provide new opportunities to explore, analyze and present data through Immersive Analytics (IA). This study presents a thorough overview of current research in immersive AR and ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICVARS '20: Proceedings of the 2020 4th International Conference on Virtual and Augmented Reality Simulations

February 2020

82 pages

ISBN:9781450376945

DOI:10.1145/3385378

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

The University of Western Australia, Department of Electronic Engineering, University of Western Australia
Northumbria University: University of Northumbria at Newcastle
Macquarie University-Sydney

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 May 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICVARS 2020

ICVARS 2020: 2020 4th International Conference on Virtual and Augmented Reality Simulations

February 14 - 16, 2020

NSW, Sydney, Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
2,445
Total Downloads

Downloads (Last 12 months)420
Downloads (Last 6 weeks)20

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Javaheri HGhamarnejad OLukowicz PStavrou GKarolus JKostakos VKay JHoang T(2024)ARAS: LLM-Supported Augmented Reality Assistance System for Pancreatic SurgeryCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677543(176-180)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677543
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Albeedan MKolivanda HHammady R(2024)Designing and evaluation of a mixed reality system for crime scene investigation training: a hybrid approachVirtual Reality10.1007/s10055-024-01018-828:3Online publication date: 25-Jun-2024
https://doi.org/10.1007/s10055-024-01018-8
Abdallah MSawalhi GMazhar AAlRifaee M(2024)Factors Influencing the Quality of Augmented Reality Applications: a Conceptual FrameworkExtended Reality10.1007/978-3-031-71707-9_24(293-301)Online publication date: 11-Sep-2024
https://doi.org/10.1007/978-3-031-71707-9_24
Shidende DKessel TTreydte AMoebs S(2024)A Personalized Captioning Strategy for the Deaf and Hard-of-Hearing Users in an Augmented Reality EnvironmentExtended Reality10.1007/978-3-031-71704-8_1(3-21)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-71704-8_1
Hai-Jew S(2023)Getting Started With Augmented Reality (AR) in Inclusive Online Teaching and Learning in Higher EducationNavigating Virtual Worlds and the Metaverse for Enhanced E-Learning10.4018/979-8-3693-1034-2.ch003(20-83)Online publication date: 24-Nov-2023
https://doi.org/10.4018/979-8-3693-1034-2.ch003
Gutiérrez LSamper JJabba DNieto WGuerrero CBetts MLópez-Ospina H(2023)Combined Framework of Multicriteria Methods to Identify Quality Attributes in Augmented Reality ApplicationsMathematics10.3390/math1113283411:13(2834)Online publication date: 24-Jun-2023
https://doi.org/10.3390/math11132834
Logothetis ISfyrakis MVidakis N(2023)EduARdo—Unity Components for Augmented Reality EnvironmentsInformation10.3390/info1404025214:4(252)Online publication date: 21-Apr-2023
https://doi.org/10.3390/info14040252
Alpatova MRudyak Y(2023)Optimal 2D Placement of Virtual Objects in Physical Space for Augmented Reality ApplicationsAdvanced Engineering Research (Rostov-on-Don)10.23947/2687-1653-2023-23-4-410-42123:4(410-421)Online publication date: 27-Dec-2023
https://doi.org/10.23947/2687-1653-2023-23-4-410-421
Zhao YPang SLv ZMiao SEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)Augmented Digital Twins for Predictive Automatic Regulation and Fault Alarm in Sewage PlanProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613778(8495-8503)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3613778
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten