skip to main content
10.1145/3365921.3365939acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmommConference Proceedingsconference-collections
research-article

An Interaction Design Model for Information Visualization in Immersive Augmented Reality platform

Published: 22 February 2020 Publication History

Abstract

Recent advances in immersive technologies such as Augmented Reality (AR) provide new opportunities to explore, analyze and present data through Immersive Analytics (IA). This study presents a thorough overview of current research in immersive AR and further proposes a preliminary model for design of immersive AR applications. The goal is to present data in AR settings where users can rely on familiar perceptions to draw in-depth conclusions on the data. This will be achieved by developing a tangible AR system for information visualization in future. The results obtained from this study will help researchers and designers in the field of Information Visualization, immersive Analytics, Virtual Reality (VR), Augmented Reality (AR), HCI, and Natural User Interfaces (NUI).

References

[1]
Ali Alaraj, Fady T Charbel, Daniel Birk, Mathew Tobin, Cristian Luciano, Pat P Banerjee, Silvio Rizzi, Jeff Sorenson, Kevin Foley, Konstantin Slavin, et al. 2013. Role of cranial and spinal virtual and augmented reality simulation using immersive touch modules in neurosurgical training. Neurosurgery 72, suppl_1 (2013), A115--A123.
[2]
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and Blair MacIntyre. 2001. Recent advances in augmented reality. Computer Graphics and Applications, IEEE 21, 6 (Nov 2001), 34--47.
[3]
Benjamin Bach, Maxime Cordeil, Tim Dwyer, Bongshin Lee, Bahador Saket, Alex Endert, Christopher Collins, and Sheelagh Carpendale. 2017. Immersive analytics: Exploring future visualization and interaction technologies for data analytics. In IEEE VIS, Accepted Workshop.
[4]
Benjamin Bach, Ronell Sicat, Johanna Beyer, Maxime Cordeil, and Hanspeter Pfister. 2018. The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality? IEEE transactions on visualization and computer graphics 24, 1 (2018), 457--467.
[5]
Huidong Bai, Gun A Lee, Mukundan Ramakrishnan, and Mark Billinghurst. 2014. 3D gesture interaction for handheld augmented reality. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications. ACM, 7.
[6]
Rebecca Bennett, David J Zielinski, and Regis Kopper. 2014. Comparison of interactive environments for the archaeological exploration of 3D landscape data. In 3DVis (3DVis), 2014 IEEE VIS International Workshop on. IEEE, 67--71.
[7]
Maged N Kamel Boulos, Lee Hetherington, and Steve Wheeler. 2007. Second Life: an overview of the potential of 3-D virtual worlds in medical and health education. Health Information & Libraries Journal 24, 4 (2007), 233--245.
[8]
Doug A Bowman and Ryan P McMahan. 2007. Virtual reality: how much immersion is enough? Computer 40, 7 (2007).
[9]
Frederick P Brooks. 1999. What's real about virtual reality? IEEE Computer graphics and applications 19, 6 (1999), 16--27.
[10]
Josep Maria Brunetti, Sören Auer, Roberto García, Jakub Klímek, and Martin Nečasky. 2013. Formal linked data visualization model. In Proceedings of International Conference on Information Integration and Web-based Applications & Services. ACM, 309.
[11]
Steve Bryson. 1996. Virtual reality in scientific visualization. Commun. ACM 39, 5 (1996), 62--71.
[12]
Peter WS Butcher, Jonathan C Roberts, and Panagiotis D Ritsos. 2016. Immersive Analytics with WebVR and Google Cardboard. Posters of IEEE VIS (2016).
[13]
T. Chandler, M. Cordeil, T. Czauderna, T. Dwyer, J. Glowacki, C. Goncu, M. Klapperstueck, K. Klein, K. Marriott, F. Schreiber, and E. Wilson. 2015. Immersive Analytics. In 2015 Big Data Visual Analytics (BDVA). 1--8.
[14]
Min Chen, Shiwen Mao, and Yunhao Liu. 2014. Big data: A survey. Mobile Networks and Applications 19, 2 (2014), 171--209.
[15]
Xin Chen, Jessica Zeitz Self, Leanna House, and Chris North. 2016. Be the data: A new approach for lmmersive analytics. In Immersive Analytics (IA), 2016 Workshop on. IEEE, 32--37.
[16]
Ed Huai-hsin Chi. 2000. A taxonomy of visualization techniques using the data state reference model. In Information Visualization, 2000. InfoVis 2000. IEEE Symposium on. IEEE, 69--75.
[17]
Derek Johnde Solla Price, Derek John de Solla Price, Derek John de Solla Price, and Derek John de Solla Price. 1986. Little science, big science... and beyond. Columbia University Press New York.
[18]
Kelly L Dempski. 2006. Arbitrary object tracking augmented reality applications. US Patent 7,050,078.
[19]
Ciro Donalek, S George Djorgovski, Alex Cioc, Anwell Wang, Jerry Zhang, Elizabeth Lawler, Stacy Yeh, Ashish Mahabal, Matthew Graham, Andrew Drake, et al. 2014. Immersive and collaborative data visualization using virtual reality platforms. In Big Data (Big Data), 2014 IEEE International Conference on. IEEE, 609--614.
[20]
David Drascic and Paul Milgram. 1996. Perceptual issues in augmented reality. In Electronic Imaging: Science & Technology. International Society for Optics and Photonics, 123--134.
[21]
HB-L Duh, Jian Ma, and Mark Billinghurst. 2006. Human factors issues in augmented reality. (2006).
[22]
Alessandro Febretti, Arthur Nishimoto, Terrance Thigpen, Jonas Talandis, Lance Long, JD Pirtle, Tom Peterka, Alan Verlo, Maxine Brown, Dana Plepys, et al. 2013. CAVE2: a hybrid reality environment for immersive simulation and information analysis. In Is&t/spie electronic imaging. International Society for Optics and Photonics, 864903--864903.
[23]
Robert B Haber and David A McNabb. 1990. Visualization idioms: A conceptual model for scientific visualization systems. Visualization in scientific computing 74 (1990), 93.
[24]
Claudia Hänel, Benjamin Weyers, Bernd Hentschel, and Torsten W Kuhlen. 2014. Interactive volume rendering for immersive virtual environments. In 3DVis (3DVis), 2014 IEEE VIS International Workshop on. IEEE, 73--74.
[25]
Anders Henrysson. 2007. Bringing augmented reality to mobile phones. (2007).
[26]
Tobias Höllerer and Steve Feiner. 2004. Mobile augmented reality. Telegeoin-formatics: Location-Based Computing and Services. Taylor and Francis Books Ltd., London, UK 21 (2004).
[27]
Yi-Jheng Huang, Takanori Fujiwara, Yun-Xuan Lin, Wen-Chieh Lin, and Kwan-Liu Ma. 2017. A gesture system for graph visualization in virtual reality environments. In Pacific Visualization Symposium (PacificVis), 2017 IEEE. IEEE, 41--45.
[28]
Wolfgang Hurst and Casper van Wezel. 2013. Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools and Applications 62, 1 (2013), 233--258. https://doi.org/10.1007/s11042-011-0983-y
[29]
Rachel Kizony, Noomi Katz, et al. 2003. Adapting an immersive virtual reality system for rehabilitation. Computer Animation and Virtual Worlds 14, 5 (2003), 261--268.
[30]
Oh-Hyun Kwon, Chris Muelder, Kyungwon Lee, and Kwan-Liu Ma. 2016. A study of layout, rendering, and interaction methods for immersive graph visualization. IEEE transactions on visualization and computer graphics 22, 7 (2016), 1802--1815.
[31]
Steve LaValle, Eric Lesser, Rebecca Shockley, Michael S Hopkins, and Nina Kr-uschwitz. 2011. Big data, analytics and the path from in sights to value. MIT sloan management review 52, 2 (2011), 21.
[32]
Jae Yeol Lee, Dong Woo Seo, and Guewon Rhee. 2008. Visualization and interaction of pervasive services using context-aware augmented reality. Expert Systems with Applications 35, 4 (2008), 1873--1882.
[33]
Nai Li and Henry Been-Lirn Duh. 2013. Cognitive issues in mobile augmented reality: an embodied perspective. In Human factors in augmented reality environments. Springer, 109--135.
[34]
Jack M. Loomis. 2016. Presence in Virtual Reality and Everyday Life: Immersion within a World of Representation. Presence: Teleoperators and Virtual Environments 25, 2 (2016), 169--174.
[35]
Martin Luboschik, Philip Berger, and Oliver Staadt. 2016. On spatial perception issues in augmented reality based immersive analytics. In Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces. ACM, 47--53.
[36]
Clifford Lynch. 2008. Big data: How do your data grow? Nature 455, 7209 (2008), 28--29.
[37]
Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Photonics for Industrial Applications. International Society for Optics and Photonics, 282--292.
[38]
Koosha Mirhosseini, Qi Sun, Krishna C Gurijala, Bireswar Laha, and Arie E Kaufman. 2014. Benefits of 3D immersion for virtual colonoscopy. In 3DVis (3DVis), 2014 IEEE VIS International Workshop on. IEEE, 75--79.
[39]
Andrew Moran et al. 2016. Improving big data visual analytics with interactive virtual reality. Ph.D. Dissertation. Massachusetts Institute of Technology.
[40]
Ekaterina Olshannikova, Aleksandr Ometov, Yevgeni Koucheryavy, and Thomas Olsson. 2015. Visualizing Big Data with augmented and virtual reality: challenges and research agenda. Journal of Big Data 2, 1 (01 Oct 2015), 22.
[41]
Callum Parker and Martin Tomitsch. 2014. Data Visualisation Trends in Mobile Augmented Reality Applications. In Proceedings of the 7th International Symposium on Visual Information Communication and Interaction (VINCI '14). ACM, New York, NY, USA, Article 228, 4 pages.
[42]
Cristina Portalés, José Luis Lerma, and Santiago Navarro. 2010. Augmented reality and photogrammetry: A synergy to visualize physical and virtual city environments. ISPRS Journal of Photogrammetry and Remote Sensing 65, 1 (2010), 134--142.
[43]
Gerhard Reitmayr and Tom W Drummond. 2006. Going out: robust model-based tracking for outdoor augmented reality. In Mixed and Augmented Reality, 2006. ISMAR 2006. IEEE/ACM International Symposium on. IEEE, 109--118.
[44]
Seref Sagiroglu and Duygu Sinanc. 2013. Big data: A review. In Collaboration Technologies and Systems (CTS), 2013 International Conference on. IEEE, 42--47.
[45]
Mel Slater and Sylvia Wilbur. 1997. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators and virtual environments 6, 6 (1997), 603--616.
[46]
Jed Tan and Steve Kim. 2016. Applied Data Visualization in Virtual Reality. (2016).
[47]
Andries Van Dam, Andrew S Forsberg, David H Laidlaw, Joseph J LaViola, and Rosemary M Simpson. 2000. Immersive VR for scientific visualization: A progress report. IEEE Computer Graphics and Applications 20, 6 (2000), 26--52.
[48]
Wang, Lidong, Wang, Guanghui, Alexander, and Cheryl Ann. 2015. Big Data and Visualization: Methods, Challenges and Technology Progress. Digital Technologies 1, 1 (2015), 33--38.
[49]
Wesley Willett, Yvonne Jansen, and Pierre Dragicevic. 2017. Embedded data representations. IEEE transactions on visualization and computer graphics 23, 1 (2017), 461--470.
[50]
Feng Zhou, Henry Been-Lirn Duh, and Mark Billinghurst. 2008. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, 193--202.

Cited By

View all

Index Terms

  1. An Interaction Design Model for Information Visualization in Immersive Augmented Reality platform

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MoMM2019: Proceedings of the 17th International Conference on Advances in Mobile Computing & Multimedia
    December 2019
    266 pages
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Johannes Kepler University, Linz, Austria
    • @WAS: International Organization of Information Integration and Web-based Applications and Services

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 February 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Augmented Reality
    2. Human Computer Interaction
    3. Interaction
    4. Mobile Augmented Reality
    5. User Experience
    6. User Studies
    7. information Visualization
    8. model design

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    MoMM2019

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)59
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 01 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media