research-article

Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal Cues

Authors:

Carlos Bermejo,

David Przewozny,

Pan HuiAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 5, Issue EICS

Article No.: 194, Pages 1 - 26

https://doi.org/10.1145/3457141

Published: 29 May 2021 Publication History

Abstract

The continued advancement in user interfaces comes to the era of virtual reality that requires a better understanding of how users will interact with 3D buttons in mid-air. Although virtual reality owns high levels of expressiveness and demonstrates the ability to simulate the daily objects in the physical environment, the most fundamental issue of designing virtual buttons is surprisingly ignored. To this end, this paper presents four variants of virtual buttons, considering two design dimensions of key representations and multi-modal cues (audio, visual, haptic). We conduct two multi-metric assessments to evaluate the four virtual variants and the baselines of physical variants. Our results indicate that the 3D-lookalike buttons help users with more refined and subtle mid-air interactions (i.e. lesser press depth) when haptic cues are available; while the users with 2D-lookalike buttons unintuitively achieve better keystroke performance than the 3D counterparts. We summarize the findings, and accordingly, suggest the design choices of virtual reality buttons among the two proposed design dimensions.

References

[1]

Jindvrich Adolf, Peter Kán, Benjamin Outram, Hannes Kaufmann, Jarom'ir Dolevzal, and Lenka Lhotská. 2019. Juggling in VR: Advantages of Immersive Virtual Reality in Juggling Learning. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST '19). Association for Computing Machinery, New York, NY, USA, Article 31, 5 pages. https://doi.org/10.1145/3359996.3364246

Digital Library

[2]

Faisal Arafsha, Longyu Zhang, Haiwei Dong, and Abdulmotaleb El Saddik. 2015. Contactless haptic feedback: State of the art. 2015 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2015 - Proceedings (2015). https://doi.org/10.1109/HAVE.2015.7359447

[3]

Gerd Berget and Frode Eika Sandnes. 2015. On the Understandability of Public Domain Icons: Effects of Gender and Age. In Universal Access in Human-Computer Interaction. Access to Today's Technologies, Margherita Antona and Constantine Stephanidis (Eds.). Springer International Publishing, Cham, 387--396.

[4]

Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics, Vol. 7, 2 (2002), 256--263.

[5]

Sara Bouzit, Gaëlle Calvary, Denis Chêne, and Jean Vanderdonckt. 2016. A design space for engineering graphical adaptive menus. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. 239--244.

Digital Library

[6]

Doug A Bowman, Ryan P McMahan, and Eric D Ragan. 2012. Questioning naturalism in 3D user interfaces. Commun. ACM, Vol. 55, 9 (2012), 78--88.

Digital Library

[7]

Doug A Bowman, Christopher J Rhoton, and Marcio S Pinho. 2002. Text input techniques for immersive virtual environments: An empirical comparison. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 46. SAGE Publications Sage CA: Los Angeles, CA, 2154--2158.

[8]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013a. UltraHaptics : Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. (2013).

[9]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013b. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 505--514.

Digital Library

[10]

Andy Cockburn and Stephen Brewster. 2005. Multimodal feedback for the acquisition of small targets. Ergonomics, Vol. 48, 9 (2005), 1129--1150.

[11]

Gennaro Costagliola, Vittorio Fuccella, and Michele Di Capua. 2011. Text Entry with KeyScretch. In Proceedings of the 16th International Conference on Intelligent User Interfaces (Palo Alto, CA, USA) (IUI '11). Association for Computing Machinery, New York, NY, USA, 277--286. https://doi.org/10.1145/1943403.1943445

Digital Library

[12]

Xiaowei Dai, Jiawei Gu, Xiang Cao, J Edward Colgate, and Hong Tan. 2012. SlickFeel: sliding and clicking haptic feedback on a touchscreen. In Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology. 21--22.

Digital Library

[13]

C Doerrer and R Werthschuetzky. 2002. Simulating push-buttons using a haptic display: Requirements on force resolution and force-displacement curve. In Proc. EuroHaptics. 41--46.

[14]

Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text entry in virtual reality: A comprehensive review of the literature. In International Conference on Human-Computer Interaction. Springer, 419--437.

[15]

John Dudley, Hrvoje Benko, Daniel Wigdor, and Per Ola Kristensson. 2019. Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 289--300.

[16]

Elham Ebrahimi, Sabarish V Babu, Christopher C Pagano, and Sophie Jörg. 2016. An empirical evaluation of visuo-haptic feedback on physical reaching behaviors during 3D interaction in real and immersive virtual environments. ACM Transactions on Applied Perception (TAP), Vol. 13, 4 (2016), 1--21.

Digital Library

[17]

Adam Faeth and Chris Harding. 2014. Emergent effects in multimodal feedback from virtual buttons. ACM Transactions on Computer-Human Interaction (TOCHI), Vol. 21, 1 (2014), 3.

Digital Library

[18]

Massimiliano Gabardi, Massimiliano Solazzi, Daniele Leonardis, and Antonio Frisoli. 2016. A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features. IEEE Haptics Symposium, HAPTICS, Vol. 2016-April (2016), 140--146. https://doi.org/10.1109/HAPTICS.2016.7463168

[19]

Gabriel González, José P Molina, Arturo S Garc'ia, Diego Mart'inez, and Pascual González. 2009. Evaluation of text input techniques in immersive virtual environments. In New Trends on Human-Computer Interaction. Springer, 109--118.

[20]

Mitchell L Gordon and Shumin Zhai. 2019. Touchscreen Haptic Augmentation Effects on Tapping, Drag and Drop, and Path Following. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12.

Digital Library

[21]

Jay Henderson, Jeff Avery, Laurent Grisoni, and Edward Lank. 2019. Leveraging Distal Vibrotactile Feedback for Target Acquisition. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--11.

Digital Library

[22]

Jeong Ho, Lovenoor Aulck, Michael C Bartha, Christy A Harper, and Peter W Johnson. 2014. Differences in typing forces, muscle activity, comfort, and typing performance among virtual, notebook, and desktop keyboards. Applied Ergonomics, Vol. 45, 6 (2014), 1406--1413. https://doi.org/10.1016/j.apergo.2014.04.001

[23]

Eve Hoggan, Stephen A. Brewster, and Jody Johnston. 2008. Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). Association for Computing Machinery, New York, NY, USA, 1573--1582. https://doi.org/10.1145/1357054.1357300

Digital Library

[24]

Takayuki Hoshi. 2011. Development of aerial-input and aerial-tactile-feedback system. In 2011 IEEE World Haptics Conference. IEEE, 569--573.

[25]

HyunKi In, Kyu-Jin Cho, KyuRi Kim, and BumSuk Lee. 2011. Jointless structure and under-actuation mechanism for compact hand exoskeleton. In Rehabilitation Robotics (ICORR), 2011 IEEE International Conference on. IEEE, 1--6.

[26]

Thalmic Labs Inc. 2017 (accessed August 6, 2017) a. Myo. https://www.myo.com/.

[27]

Thalmic Labs Inc. 2017 (accessed August 6, 2017) b. Unity - Game Engine. https://unity3d.com/.

[28]

Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). Association for Computing Machinery, New York, NY, USA, 201--210. https://doi.org/10.1145/1357054.1357089

Digital Library

[29]

Lars-Erik Janlert. 2014. The Ubiquitous Button. Interactions, Vol. 21, 3 (May 2014), 26--33. https://doi.org/10.1145/2592234

Digital Library

[30]

Nikolaos Kaklanis, Juan González Calleros, Jean Vanderdonckt, and Dimitrios Tzovaras. 2008. A haptic rendering engine of web pages for blind users. In Proceedings of the working conference on Advanced visual interfaces. 437--440.

Digital Library

[31]

Akriti Kaur and Pradeep G Yammiyavar. 2017. A comparative study of 2D and 3D mobile keypad user interaction preferences in virtual reality graphic user interfaces. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 1--2.

Digital Library

[32]

Cédric Kervegant, Félix Raymond, Delphine Graeff, and Julien Castet. 2017. Touch hologram in mid-air. In ACM SIGGRAPH 2017 Emerging Technologies. ACM, 23.

Digital Library

[33]

Wolf Kienzle and Ken Hinckley. 2014. LightRing: always-available 2D input on any surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 157--160.

Digital Library

[34]

Hwan Kim, Minhwan Kim, and Woohun Lee. 2016a. HapThimble : A Wearable Haptic Device towards Usable Virtual Touch Screen. Chi '16 (2016), 3694--3705. https://doi.org/10.1145/2858036.2858196

Digital Library

[35]

Hwan Kim, Minhwan Kim, and Woohun Lee. 2016b. Hapthimble: A wearable haptic device towards usable virtual touch screen. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3694--3705.

Digital Library

[36]

Sangyeon Kim and Sangwon Lee. 2020. Touch Digitality: Affordance Effects of Visual Properties on Gesture Selection. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems Extended Abstracts (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3382914

Digital Library

[37]

Pascal Knierim, Valentin Schwind, Anna Maria Feit, Florian Nieuwenhuizen, and Niels Henze. 2018. Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 345.

Digital Library

[38]

Akemi Kobayashi, Ryosuke Aoki, Norimichi Kitagawa, Toshitaka Kimura, Youichi Takashima, and Tomohiro Yamada. 2016. Towards Enhancing Force-Input Interaction by Visual-Auditory Feedback as an Introduction of First Use. In International Conference on Human-Computer Interaction. Springer, 180--191.

Digital Library

[39]

Laurens R Krol, Dzmitry Aliakseyeu, and Sriram Subramanian. 2009. Haptic feedback in remote pointing. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. 3763--3768.

Digital Library

[40]

Falko Kuester, Michelle Chen, Mark E Phair, and Carsten Mehring. 2005. Towards keyboard independent touch typing in VR. In Proceedings of the ACM symposium on Virtual reality software and technology. ACM, 86--95.

Digital Library

[41]

Markos Kyritsis, Stephen R Gulliver, Sonali Morar, and Robert Stevens. 2013. Issues and benefits of using 3D interfaces: visual and verbal tasks. In Proceedings of the Fifth International Conference on Management of Emergent Digital EcoSystems. 241--245.

Digital Library

[42]

Anatole Lécuyer, J-M Burkhardt, Sabine Coquillart, and Philippe Coiffet. 2001. " Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system. In Proceedings IEEE Virtual Reality 2001. IEEE, 115--122.

Digital Library

[43]

Hojin Lee, Hojun Cha, Junsuk Park, Seungmoon Choi, Hyung-Sik Kim, and Soon-Cheol Chung. 2016. LaserStroke. Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16 Adjunct (2016), 73--74. https://doi.org/10.1145/2984751.2985708

Digital Library

[44]

Ju-Hwan Lee and Charles Spence. 2008. Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions. In Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction-Volume 1. British Computer Society, 185--192.

Digital Library

[45]

L.H. Lee and P. Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access, Vol. 6 (2018), 28712--28732.

[46]

L.H. Lee, K.Y. Lam, T. Li, T. Braud, X. Su, and P. Hui. 2019. Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 3, 3, Article 94 (Sept. 2019), 27 pages. https://doi.org/10.1145/3351252

Digital Library

[47]

L.H. Lee, Y. Zhu, Y.P. Yau, T. Braud, X. SU, and P. Hui. 2020. One-thumb Text Acquisition on Force-assisted Miniature Interfaces for Mobile Headsets. In 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10.

[48]

L. H. Lee, K. Yung Lam, Y. P. Yau, T. Braud, and P. Hui. 2019. HIBEY: Hide the Keyboard in Augmented Reality. In 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10. https://doi.org/10.1109/PERCOM.2019.8767420

[49]

Minkyung Lee, Woontack Woo, et al. 2003. ARKB: 3D vision-based Augmented Reality Keyboard. In ICAT.

[50]

Seungyon Lee and Shumin Zhai. 2009. The performance of touch screen soft buttons. In Proceedings of the SIGCHI conference on human factors in computing systems. 309--318.

Digital Library

[51]

Wei Li, Xuan Zhang, and Yi Shen Zhang. 2018. How Animation Improve Children's Cognition in User Interface: A Study of the Kids VOD Application. In Design, User Experience, and Usability: Users, Contexts and Case Studies, Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, Cham, 196--217.

[52]

Robert W Lindeman, John L Sibert, and James K Hahn. 1999. Towards usable VR: an empirical study of user interfaces for immersive virtual environments. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 64--71.

Digital Library

[53]

Zhaoyuan Ma, Darren Edge, Leah Findlater, and Hong Z. Tan. 2015. Haptic keyclick feedback improves typing speed and reduces typing errors on a flat keyboard. IEEE World Haptics Conference, WHC 2015 (2015), 220--227. https://doi.org/10.1109/WHC.2015.7177717

[54]

I Scott MacKenzie. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-computer interaction, Vol. 7, 1 (1992), 91--139.

Digital Library

[55]

Anders Markussen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2014. Vulture: a mid-air word-gesture keyboard. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 1073--1082.

Digital Library

[56]

Sven Mayer, Valentin Schwind, Robin Schweigert, and Niels Henze. 2018. The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 653.

Digital Library

[57]

Lorna McKnight and Janet C. Read. 2009. Designing the "record" Button: Using Children's Understanding of Icons to Inform the Design of a Musical Interface. In Proceedings of the 8th International Conference on Interaction Design and Children (Como, Italy) (IDC '09). Association for Computing Machinery, New York, NY, USA, 258--261. https://doi.org/10.1145/1551788.1551847

Digital Library

[58]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1994. Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and Telepresence Technologies, Vol. 2351 (01 1994). https://doi.org/10.1117/12.197321

[59]

Y Nam, M Park, and R Yamane. 2007. Smart glove: hand master using magnetorheological fluid actuators. In Proc. SPIE, Vol. 6794. 679434--1.

[60]

Tao Ni, Doug Bowman, and Chris North. 2011. AirStroke: bringing unistroke text entry to freehand gesture interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2473--2476.

Digital Library

[61]

Yoichi Ochiai, Kota Kumagai, Takayuki Hoshi, Satoshi Hasegawa, and Yoshio Hayasaki. 2016. Cross-Field Aerial Haptics : Rendering Haptic Feedback in Air with Light and Acoustic Fields. Chi '16 (2016), 3238--3247. https://doi.org/10.1145/2858036.2858489

Digital Library

[62]

Taihei Ogitani, Yoshitaka Arahori, Yusuke Shinyama, and Katsuhiko Gondow. 2018. Space saving text input method for head mounted display with virtual 12-key keyboard. In 2018 IEEE 32nd International Conference on Advanced Information Networking and Applications (AINA). IEEE, 342--349.

[63]

Kseniia Palin, Anna Maria Feit, Sunjun Kim, Per Ola Kristensson, and Antti Oulasvirta. 2019. How do people type on mobile devices? Observations from a study with 37,000 volunteers. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--12.

Digital Library

[64]

Evan Pezent, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nick Colonnese. 2019. Tasbi: Multisensory squeeze and vibrotactile wrist haptics for augmented and virtual reality. In 2019 IEEE World Haptics Conference (WHC). IEEE, 1--6.

[65]

Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, and Cesare Parise. 2019. Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300550

Digital Library

[66]

Roy Shilkrot, Jochen Huber, Jürgen Steimle, Suranga Nanayakkara, and Pattie Maes. 2015. Digital digits: A comprehensive survey of finger augmentation devices. ACM Computing Surveys (CSUR), Vol. 48, 2 (2015), 30.

Digital Library

[67]

Rajinder Sodhi, Ivan Poupyrev, Matthew Glisson, and Ali Israr. 2013. AIREAL: interactive tactile experiences in free air. ACM Transactions on Graphics (TOG), Vol. 32, 4 (2013), 134.

Digital Library

[68]

Marco Speicher, Jan Ehrlich, Vito Gentile, Donald Degraen, Salvatore Sorce, and Antonio Krüger. 2019. Pseudo-haptic Controls for Mid-air Finger-based Menu Interaction. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1--6.

Digital Library

[69]

Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 647.

Digital Library

[70]

Patrick L. Strandholt, Oana A. Dogaru, Niels C. Nilsson, Rolf Nordahl, and Stefania Serafin. 2020. Knock on Wood: Combining Redirected Touching and Physical Props for Tool-Based Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376303

Digital Library

[71]

Ke Sun, Wei Wang, Alex X. Liu, and Haipeng Dai. 2018. Depth Aware Finger Tapping on Virtual Displays. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (Munich, Germany) (MobiSys '18). Association for Computing Machinery, New York, NY, USA, 283--295. https://doi.org/10.1145/3210240.3210315

Digital Library

[72]

CyberGlove Systems. 2020. CyberTouch. http://www.cyberglovesystems.com/cybertouch.

[73]

Jennifer L Tennison and Jenna L Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Transactions on Applied Perception (TAP), Vol. 16, 1 (2019), 1--19.

Digital Library

[74]

Andries van Dam. 1997. Post-WIMP User Interfaces. Commun. ACM, Vol. 40, 2 (Feb. 1997), 63--67. https://doi.org/10.1145/253671.253708

Digital Library

[75]

Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y Chen. 2015. PalmType: Using palms as keyboards for smart glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 153--160.

Digital Library

[76]

Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment. Virtual Reality, Vol. 21, 1 (2017), 19--29.

Digital Library

[77]

Yi Yang, Yuru Zhang, Zhu Hou, and Betty Lemaire-Semail. 2011. Adding haptic feedback to touch screens at the right time. In Proceedings of the 13th international conference on multimodal interfaces. 73--80.

Digital Library

[78]

Hui-Shyong Yeo, Xiao-Shen Phang, Taejin Ha, Woontack Woo, and Aaron Quigley. 2017. TiTAN: exploring midair text entry using freehand input. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3041--3049.

Digital Library

[79]

Hui-Shyong Yeo and Aaron Quigley. 2017. Radar Sensing in Human-Computer Interaction. Interactions, Vol. 25, 1 (Dec. 2017), 70--73. https://doi.org/10.1145/3159651

Digital Library

[80]

Xu Zhao, Takehiro Niikura, and Takashi Komuro. 2014. Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces. 299--304.

Digital Library

Cited By

Yinjie LKai XYulan GXin YYuwei WWei HJiaqi YHanyun W(2024)Comprehensive survey on 3D visual-language understanding techniquesJournal of Image and Graphics10.11834/jig.24002929:6(1747-1764)Online publication date: 2024
https://doi.org/10.11834/jig.240029
Frata Furlan Peres FNunes FTeixeira JMaurício CConceição KYoshida L(2024)Methods for Evaluating Immersive 3D Virtual Environments: a Systematic Literature ReviewProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691595(140-151)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691595
Akhoroz MYildirim C(2024)Poke Typing: Effects of Hand-Tracking Input and Key Representation on Mid-Air Text Entry Performance in Virtual RealityProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685734(293-301)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685734
Show More Cited By

Index Terms

Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal Cues
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual Reality
TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

Free-hand mid-air Qwerty enables entering text in virtual reality without the use of controllers. However, it is much slower and more error prone than its physical counterpart, primarily due to the absence of haptic feedback and reduced spatial ...
Extended Mid-air Ultrasound Haptics for Virtual Reality

Mid-air haptics allow bare-hand tactile stimulation; however, it has a constrained workspace, making it unsuitable for room-scale haptics. We present a novel approach to rendering mid-air haptic sensations in a large rendering volume by turning a static ...
Multi-sensorial virtual reality and augmented human food interaction
MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction

In the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue EICS

EICS

June 2021

546 pages

EISSN:2573-0142

DOI:10.1145/3468527

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 May 2021

Published in PACMHCI Volume 5, Issue EICS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Research Grants Council of Hong Kongand the 5GEAR and FIT projects from Academy of Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
870
Total Downloads

Downloads (Last 12 months)276
Downloads (Last 6 weeks)24

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yinjie LKai XYulan GXin YYuwei WWei HJiaqi YHanyun W(2024)Comprehensive survey on 3D visual-language understanding techniquesJournal of Image and Graphics10.11834/jig.24002929:6(1747-1764)Online publication date: 2024
https://doi.org/10.11834/jig.240029
Frata Furlan Peres FNunes FTeixeira JMaurício CConceição KYoshida L(2024)Methods for Evaluating Immersive 3D Virtual Environments: a Systematic Literature ReviewProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691595(140-151)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691595
Akhoroz MYildirim C(2024)Poke Typing: Effects of Hand-Tracking Input and Key Representation on Mid-Air Text Entry Performance in Virtual RealityProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685734(293-301)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685734
Krasner AGabbard J(2024)MusiKeys: Exploring Haptic-to-Auditory Sensory Substitution to Improve Mid-Air Text-EntryIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337206530:5(2247-2256)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372065
Normand EPacchierotti CMarchand EMarchal M(2024)Visuo-Haptic Rendering of the Hand during 3D Manipulation in Augmented RealityIEEE Transactions on Haptics10.1109/TOH.2024.335891017:2(277-291)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1109/TOH.2024.3358910
Chen XTang XChen YHuang TLiu QYang JQi WWang X(2024)Enhancing Fixation and Pursuit: Optimizing Field of View and Number of Targets for Selection Performance in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2313888(1-13)Online publication date: 15-Feb-2024
https://doi.org/10.1080/10447318.2024.2313888
Lee LHosio SBraud TZhou P(2024)A Roadmap Toward Metaversity: Recent Developments and Perspectives in EducationApplication of the Metaverse in Education10.1007/978-981-97-1298-4_5(73-95)Online publication date: 8-May-2024
https://doi.org/10.1007/978-981-97-1298-4_5
Kopel MWalczyński MWyrostek P(2024)Testing Usability of Different Implementations for VR Interaction MethodsAdvances in Computational Collective Intelligence10.1007/978-3-031-70259-4_22(287-300)Online publication date: 9-Sep-2024
https://doi.org/10.1007/978-3-031-70259-4_22
Paananen VKiarostami MLik-Hang LBraud THosio S(2023)From Digital Media to Empathic Spaces: A Systematic Review of Empathy Research in Extended Reality EnvironmentsACM Computing Surveys10.1145/362651856:5(1-40)Online publication date: 25-Nov-2023
https://dl.acm.org/doi/10.1145/3626518
Kounalaki MSimou IKomninos A(2023)Pseudo-haptic and Self-haptic Feedback During VR Text EntryProceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter10.1145/3609987.3610002(1-8)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3609987.3610002
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents