Cited By
View all- Severitt BCastner NWahl S(2024)Bi-Directional Gaze-Based Communication: A ReviewMultimodal Technologies and Interaction10.3390/mti81201088:12(108)Online publication date: 4-Dec-2024
Keep Your Eyes on the Target: Enhancing Immersion and Usability by Designing Natural Object Throwing with Gaze-based Targeting
Article No.: 14, Pages 1 - 7
Abstract
While controllers can support many generic 3D interactions in virtual reality (VR), it alone may fall short of eliciting the core experience for certain actions. One such task is the “object throwing’’, ubiquitous in many sports contents, involving intricately timed actions of aiming, arm swinging, and object releasing. With the increasing availability of eye tracking, we propose to combine gaze-based targeting with the controller swing gesture to model the object throw. The target is aimed/locked by gaze, and the throw is enacted by the controller swing/button press with the object let-gone by the button release. We compare and evaluate the proposed interface against the conventional controller-only based interaction through two typical baseball tasks – Pitcher and Outfielder. The findings indicated that the task accuracy was similar, but the gaze-based targeting allowed for faster completion. More importantly, the gaze-based method showed significantly higher usability and richer VR experience.
Supplemental Material
MP4 File
Experimental video and demographic questionnaire
- Download
- 70.52 MB
PDF File
Experimental video and demographic questionnaire
- Download
- 43.94 KB
References
[1]
Isayas Berhe Adhanom, Paul MacNeilage, and Eelke Folmer. 2023. Eye Tracking in virtual reality: A broad review of applications and challenges. Virtual Reality (2023), 1–25.
[2]
Kunjal Ahir, Kajal Govani, Rutvik Gajera, and Manan Shah. 2020. Application on virtual reality for enhanced education learning, military training and sports. Augmented Human Research 5 (2020), 1–9.
[3]
Ferran Argelaguet and Carlos Andujar. 2013. A survey of 3D object selection techniques for virtual environments. Computers & Graphics 37, 3 (2013), 121–136.
[4]
Marc Baloup, Thomas Pietrzak, and Géry Casiez. 2019. Raycursor: A 3d pointing facilitation technique based on raycasting. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
[5]
Nils Ove Beese, René Reinhard, and Thomas Lachmann. 2022. The right tools for the job: towards preference and performance considerations in the design of virtual reality interactions. In Proceedings of the 33rd European Conference on Cognitive Ergonomics. 1–5.
[6]
Oloff C Biermann, Daniel Ajisafe, and Dongwook Yoon. 2022. Interaction Design for VR Applications: Understanding Needs for University Curricula. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
[7]
Costas Boletsis. 2017. The New Era of Virtual Reality Locomotion: A Systematic Literature Review of Techniques and a Proposed Typology. Multimodal Technologies and Interaction 1, 4 (2017). https://doi.org/10.3390/mti1040024
[8]
John Brooke. 1996. Sus: a “quick and dirty’usability. Usability evaluation in industry 189, 3 (1996), 189–194.
[9]
Di Laura Chen, Marcello Giordano, Hrvoje Benko, Tovi Grossman, and Stephanie Santosa. 2023. GazeRayCursor: Facilitating Virtual Reality Target Selection by Blending Gaze and Controller Raycasting. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology(VRST ’23). Association for Computing Machinery, New York, NY, USA, Article 19, 11 pages. https://doi.org/10.1145/3611659.3615693
[10]
J Douglas Crawford, W Pieter Medendorp, and Jonathan J Marotta. 2004. Spatial transformations for eye–hand coordination. Journal of neurophysiology (2004).
[11]
Dena Crozier, Zhaoran Zhang, Se-Woong Park, and Dagmar Sternad. 2019. Gender Differences in Throwing Revisited: Sensorimotor Coordination in a Virtual Ball Aiming Task. Frontiers in Human Neuroscience 13 (2019). https://doi.org/10.3389/fnhum.2019.00231
[12]
Guilherme Gonçalves, Miguel Melo, José Vasconcelos-Raposo, and Maximino Bessa. 2019. Impact of different sensory stimuli on presence in credible virtual environments. IEEE transactions on visualization and computer graphics 26, 11 (2019), 3231–3240.
[13]
Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.
[14]
Sungchul Jung, Andrew L Wood, Simon Hoermann, Pramuditha L Abhayawardhana, and Robert W Lindeman. 2020. The impact of multi-sensory stimuli on confidence levels for perceptual-cognitive tasks in vr. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 463–472.
[15]
Hind Kharoub, Mohammed Lataifeh, and Naveed Ahmed. 2019. 3D user interface design and usability for immersive VR. Applied sciences 9, 22 (2019), 4861.
[16]
Jack A Kincaid, Fengchen Gong, Tianjie Jia, Hong Z Tan, Casey Kohr, and Gary Bertoline. 2021. A Study on VR Training of Baseball Athletes. In International Conference on Human-Computer Interaction. Springer, 187–204.
[17]
Lorraine Lin, Aline Normoyle, Alexandra Adkins, Yu Sun, Andrew Robb, Yuting Ye, Massimiliano Di Luca, and Sophie Jörg. 2019. The effect of hand size and interaction modality on the virtual hand illusion. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 510–518.
[18]
Sony Interactive Entertainment LLC.2023. MLB The Show. https://theshow.com/ Accessed: 2024-01-24.
[19]
Xiaolong Lou, Qinping Zhao, Yan Shi, and Preben Hansen. 2022. Arm posture changes and influences on hand controller interaction evaluation in virtual reality. Applied Sciences 12, 5 (2022), 2585.
[20]
Christos Lougiakis, Akrivi Katifori, Maria Roussou, and Ioannis-Panagiotis Ioannidis. 2020. Effects of virtual hand representation on interaction and embodiment in HMD-based virtual environments using controllers. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 510–518.
[21]
Tiffany Luong, Yi Fei Cheng, Max Möbus, Andreas Fender, and Christian Holz. 2023. Controllers or Bare Hands? A Controlled Evaluation of Input Techniques on Interaction Performance and Exertion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics (2023).
[22]
Francisco Lopez Luro and Veronica Sundstedt. 2019. A comparative study of eye tracking and hand controller for aiming tasks in virtual reality. In Proceedings of the 11th ACM Symposium on eye tracking research & applications. 1–9.
[23]
Mathias N Lystbæk, Ken Pfeuffer, Jens Emil Sloth Grønbæk, and Hans Gellersen. 2022a. Exploring gaze for assisting freehand selection-based text entry in ar. Proceedings of the ACM on Human-Computer Interaction 6, ETRA (2022), 1–16.
[24]
Mathias N Lystbæk, Peter Rosenberg, Ken Pfeuffer, Jens Emil Grønbæk, and Hans Gellersen. 2022b. Gaze-hand alignment: Combining eye gaze and mid-air pointing for interacting with menus in augmented reality. Proceedings of the ACM on Human-Computer Interaction 6, ETRA (2022), 1–18.
[25]
Pallavi Mohan, Wooi Boon Goh, Chi-Wing Fu, and Sai-Kit Yeung. 2018. DualGaze: Addressing the midas touch problem in gaze mediated VR interaction. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 79–84.
[26]
Cameron Moore and Wallace S Lages. 2023. Planning Locomotion Techniques for Virtual Reality Games. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology(VRST ’23). Association for Computing Machinery, New York, NY, USA, Article 1, 10 pages. https://doi.org/10.1145/3611659.3615711
[27]
Muhanna A Muhanna. 2015. Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions. Journal of King Saud University-Computer and Information Sciences 27, 3 (2015), 344–361.
[28]
Nintendo. 2006. Wii Sports. https://www.nintendo.co.jp/wii/rspj/index.html Accessed: 2024-01-24.
[29]
Mojtaba Noghabaei and Kevin Han. 2021. Object manipulation in immersive virtual environments: Hand Motion tracking technology and snap-to-fit function. Automation in Construction 124 (2021), 103594.
[30]
Ken Pfeuffer, Lukas Mecke, Sarah Delgado Rodriguez, Mariam Hassib, Hannah Maier, and Florian Alt. 2020. Empirical evaluation of gaze-enhanced menus in virtual reality. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology. 1–11.
[31]
Joseph Piccione, James Collett, and Alexander De Foe. 2019. Virtual skills training: the role of presence and agency. Heliyon 5, 11 (2019).
[32]
Sophia Ppali, Vali Lalioti, Boyd Branch, Chee Siang Ang, Andrew J Thomas, Bea S Wohl, and Alexandra Covaci. 2022. Keep the VRhythm going: A musician-centred study investigating how Virtual Reality can support creative musical practice. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19.
[33]
Jussi Rantala, Jari Kangas, Olli Koskinen, Tomi Nukarinen, and Roope Raisamo. 2021. Comparison of controller-based locomotion techniques for visual observation in virtual reality. Multimodal Technologies and Interaction 5, 7 (2021), 31.
[34]
Sebastian Rings, Susanne Schmidt, Thereza Schmelter, Maximilian Brosius, and Frank Steinicke. 2023. Gaze Assistance for Older Adults during Throwing in Virtual Reality and its Effects on Performance and Motivation. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology(VRST ’23). Association for Computing Machinery, New York, NY, USA, Article 18, 11 pages. https://doi.org/10.1145/3611659.3615706
[35]
Albert A Rizzo, Ken Graap, Robert N Mclay, Karen Perlman, Barbara O Rothbaum, Greg Reger, Thomas Parsons, JoAnn Difede, and Jarrell Pair. 2007. Virtual Iraq: Initial case reports from a VR exposure therapy application for combat-related post traumatic stress disorder. In 2007 Virtual Rehabilitation. IEEE, 124–130.
[36]
Maria V Sanchez-Vives and Mel Slater. 2005. From presence to consciousness through virtual reality. Nature reviews neuroscience 6, 4 (2005), 332–339.
[37]
Thomas Schubert, Frank Friedmann, and Holger Regenbrecht. 2001. The experience of presence: Factor analytic insights. Presence: Teleoperators & Virtual Environments 10, 3 (2001), 266–281.
[38]
Robin Schweigert, Valentin Schwind, and Sven Mayer. 2019. EyePointing: A Gaze-Based Selection Technique. In Mensch und Computer 2019 - Tagungsband. ACM, New York. https://doi.org/10.1145/3340764.3344897
[39]
Ludwig Sidenmark and Hans Gellersen. 2019. Eye&head: Synergetic eye and head movement for gaze pointing and selection. In Proceedings of the 32nd annual ACM symposium on user interface software and technology. 1161–1174.
[40]
Chun-Miao Tseng, Po-Yu Chen, Shih Chin Lin, Yu-Wei Wang, Yu-Hsin Lin, Mu-An Kuo, Neng-Hao Yu, and Mike Y. Chen. 2022. HeadWind: Enhancing Teleportation Experience in VR by Simulating Air Drag during Rapid Motion. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 518, 11 pages. https://doi.org/10.1145/3491102.3501890
[41]
Jacinto Vasconcelos-Raposo, Maximino Bessa, Miguel Melo, Luis Barbosa, Rui Rodrigues, Carla Maria Teixeira, Luciana Cabral, and António Augusto Sousa. 2016. Adaptation and validation of the Igroup Presence Questionnaire (IPQ) in a Portuguese sample. Presence 25, 3 (2016), 191–203.
[42]
Jorge Wagner, Wolfgang Stuerzlinger, and Luciana Nedel. 2021. Comparing and combining virtual hand and virtual ray pointer interactions for data manipulation in immersive analytics. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2513–2523.
[43]
Uta Wagner, Mathias N Lystbæk, Pavel Manakhov, Jens Emil Sloth Grønbæk, Ken Pfeuffer, and Hans Gellersen. 2023. A fitts’ law study of gaze-hand alignment for selection in 3d user interfaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–15.
[44]
Difeng Yu, Xueshi Lu, Rongkai Shi, Hai-Ning Liang, Tilman Dingler, Eduardo Velloso, and Jorge Goncalves. 2021. Gaze-supported 3d object manipulation in virtual reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
[45]
Ben Zhang, Yu-Hsiang Chen, Claire Tuna, Achal Dave, Yang Li, Edward Lee, and Björn Hartmann. 2014. HOBS: head orientation-based selection in physical spaces. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (Honolulu, Hawaii, USA) (SUI ’14). Association for Computing Machinery, New York, NY, USA, 17–25. https://doi.org/10.1145/2659766.2659773
[46]
Tim Zindulka, Myroslav Bachynskyi, and Jörg Müller. 2020. Performance and experience of throwing in virtual reality. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–8.
Index Terms
- Keep Your Eyes on the Target: Enhancing Immersion and Usability by Designing Natural Object Throwing with Gaze-based Targeting
Recommendations
RPG: Rotation Technique in VR Locomotion using Peripheral Gaze
ETRALocomotion is an important task in many virtual reality (VR) applications. Locomotion requires two different directional settings for: (1) translation to a target, and (2) body rotation. Conventional locomotion methods mostly make use of the hand-held ...
Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsHead-mounted displays let users explore virtual environments through a viewport that is coupled with head movement. In this work, we investigate gaze as an alternative modality for viewport control, enabling exploration of virtual worlds with less head ...
BimodalGaze: Seamlessly Refined Pointing with Gaze and Filtered Gestural Head Movement
ETRA '20 Full Papers: ACM Symposium on Eye Tracking Research and ApplicationsEye gaze is a fast and ergonomic modality for pointing but limited in precision and accuracy. In this work, we introduce BimodalGaze, a novel technique for seamless head-based refinement of a gaze cursor. The technique leverages eye-head coordination ...
Comments
Information & Contributors
Information
Published In
June 2024
525 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Korea Electronics Association (KEA)
- National Research Foundation (NRF)
- Institute of Information and Communication Technology Planning and Evaluation (IITP)
Conference
ETRA '24: The 2024 Symposium on Eye Tracking Research and Applications
June 4 - 7, 2024
Glasgow, United Kingdom
Acceptance Rates
Overall Acceptance Rate 69 of 137 submissions, 50%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 228Total Downloads
- Downloads (Last 12 months)228
- Downloads (Last 6 weeks)48
Reflects downloads up to 06 Jan 2025
Other Metrics
Citations
Cited By
View all- Severitt BCastner NWahl S(2024)Bi-Directional Gaze-Based Communication: A ReviewMultimodal Technologies and Interaction10.3390/mti81201088:12(108)Online publication date: 4-Dec-2024
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in