research-article

Gaze tracking and non-touch gesture based interaction method for mobile 3D virtual spaces

Authors:

Leena ArhippainenAuthors Info & Claims

OzCHI '12: Proceedings of the 24th Australian Computer-Human Interaction Conference

Pages 505 - 512

https://doi.org/10.1145/2414536.2414614

Published: 26 November 2012 Publication History

Abstract

This paper introduces a continuous gaze tracking and non-touch gesture recognition based interaction method for 3D virtual spaces on tablet devices. The user can turn his/her viewpoint, select objects with gaze and grab and manipulate objects with non-touch hand gestures. The interaction method does not require the use of a mouse or a keyboard. We created a test scenario with an object manipulation task and measured the completion times of a combined gaze tracking and non-touch gesture interaction method, with a touch screen only input method. Short interviews were conducted with 13 test subjects and data was gathered through questionnaires. The touch screen method was generally faster than or as fast as the combined gaze and non-touch gesture method. The users thought, however, that gaze tracking was more interesting and showed potential. The gaze tracking would however require more stability to be suitable for use with mobile devices.

References

[1]

Alatalo, T. An Entity-Component Model for Extensible Virtual Worlds, IEEE Internet Computing, vol. 15, no. 5 (2011) 30--37.

Digital Library

[2]

Bowman, D. A., Johnson, D. B. and Hodges, L. F. Testbed evaluation of virtual environment interaction techniques, Proc. VRST (1999), 26--33.

Digital Library

[3]

Castellina, E. and Corno, F. Multimodal gaze interaction in 3D virtual environments", Proc. COGAIN 2008: Communication, Environment and Mobility Control by Gaze, (2008), 33--37.

[4]

Dang, N. T., Tavanti, M., Rankin, I. and Cooper, M. A comparison of different input devices for a 3D environment. Proc. ECCE'07, ACM Press (2007), 153--160.

Digital Library

[5]

Francone, J. and Nigay, L. Using the user's point of view for interaction on mobile devices. Proc. IHM 2011. ACM Press (2011), New York, NY, USA.

Digital Library

[6]

Hand, C. A Survey of 3D Interaction Techniques", Computer Graphics Forum, vol. 16, no. 5 (1997), 269--281.

[7]

Hansen, D. W. and Ji, Q. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze", IEEE Trans. Pattern Analysis and Machine. Intelligence, vol. 32, no. 3 (2010), 478--500.

Digital Library

[8]

Hyrskykari, A., Majaranta, P. and Räihä, K. From Gaze Control to Attentive Interfaces. Proc. HCII 2005

[9]

Istance, H., Vickers, S. and Hyrskykari, A. Gaze-based interaction with massively multiplayer on-line games. Extended abstracts CHI 2009, ACM Press (2009), 4381--4386.

Digital Library

[10]

Jacob, R. J. K. The use of eye movements in human-computer interaction techniques: What you look at is what you get. ACM Transactions on Information Systems, vol. 9, (1991), 152--169.

Digital Library

[11]

Kela, J., Korpipää, P., Mäntyjärvi, J., Kallio, S., Savino, G., Jozzo, L. and Marca, D. Accelerometer-based gesture control for a design environment. Personal Ubiquitous Comput., vol. 10, no. 5, (2006),. 285--299.

Digital Library

[12]

Kratz, S. and Rohs, M. Protractor3D: a closed-form solution to rotation-invariant 3D gestures. Proc. IUI 2011, ACM Press (2011), 371--374.

Digital Library

[13]

Kratz, S. and Rohs, M. The $3 recognizer: simple 3D gesture recognition on mobile devices. Proc. IUI'10, ACM (2010), 419--420.

Digital Library

[14]

LaViola, J. J. and Keefe, D. F. 3D spatial interaction: applications for art, design, and science. ACM SIGGRAPH 2011 Courses, ACM Press (2011), 75 p.

Digital Library

[15]

Miluzzo, E., Wang, T. and Campbell, A. T. EyePhone: activating mobile phones with your eyes. Proc. MobiHeld'10, ACM Press (2010), 15--20.

Digital Library

[16]

Smith, J. D. and Graham, T. C. N. Use of eye movements for video game control. Proc. ACE'06, ACM Press (2006).

Digital Library

[17]

Stellmach, S. and Dachselt, R. Look & Touch: Gaze-supported Target Acquisition. Proc. CHI 2012, ACM Press (2012), 2981--2990.

Digital Library

[18]

Stellmach, S., Stober, S., Nûrnberger, A. and Dachselt, R. Designing gaze-supported multimodal interactions for the exploration of large image collections. Proc. NGCA'11, Press (2011).

Digital Library

[19]

van der Kamp, J. and Sundstedt, V. Gaze and voice controlled drawing. Proc. NGCA'11, ACM Press (2011).

Digital Library

[20]

Yoo, B., Han, J., Choi, C., Yi, K., Suh, S., Park, D. and Kim, C. 3D user interface combining gaze and hand gestures for large-scale display. Proc. Extended Abstracts CHI'10, ACM Press (2010), 3709--3714.

Digital Library

Cited By

Tian JWang YYu KXu LXie JLi FNiu YFan M(2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642884
Niu HVan Leeuwen CHao JWang GLachmann T(2022)Multimodal Natural Human–Computer Interfaces for Computer-Aided Design: A Review PaperApplied Sciences10.3390/app1213651012:13(6510)Online publication date: 27-Jun-2022
https://doi.org/10.3390/app12136510
Pandey LArif A(2022)Design and Evaluation of a Silent Speech-Based Selection Method for Eye-Gaze PointingProceedings of the ACM on Human-Computer Interaction10.1145/35677236:ISS(328-353)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567723
Show More Cited By

Index Terms

Gaze tracking and non-touch gesture based interaction method for mobile 3D virtual spaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Gliding and saccadic gaze gesture recognition in real time

Eye movements can be consciously controlled by humans to the extent of performing sequences of predefined movement patterns, or 'gaze gestures'. Gaze gestures can be tracked noninvasively employing a video-based eye tracking system. Gaze gestures hold ...
Bimanual Interaction with Interscopic Multi-Touch Surfaces
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Multi-touch interaction has received considerable attention in the last few years, in particular for natural two-dimensional (2D) interaction. However, many application areas deal with three-dimensional (3D) data and require intuitive 3D interaction ...
Gaze and Touch Interaction on Tablets
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

We explore how gaze can support touch interaction on tablets. When holding the device, the free thumb is normally limited in reach, but can provide an opportunity for indirect touch input. Here we propose gaze and touch input, where touches redirect to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '12: Proceedings of the 24th Australian Computer-Human Interaction Conference

November 2012

692 pages

ISBN:9781450314381

DOI:10.1145/2414536

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

New Zealand Chapter of ACM SIGCHI
Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

OzCHI '12

Sponsor:

Human Factors & Ergonomics Soc

OzCHI '12: The 24th Australian Computer-Human Interaction Conference

November 26 - 30, 2012

Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
602
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tian JWang YYu KXu LXie JLi FNiu YFan M(2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642884
Niu HVan Leeuwen CHao JWang GLachmann T(2022)Multimodal Natural Human–Computer Interfaces for Computer-Aided Design: A Review PaperApplied Sciences10.3390/app1213651012:13(6510)Online publication date: 27-Jun-2022
https://doi.org/10.3390/app12136510
Pandey LArif A(2022)Design and Evaluation of a Silent Speech-Based Selection Method for Eye-Gaze PointingProceedings of the ACM on Human-Computer Interaction10.1145/35677236:ISS(328-353)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567723
Yu DLu XShi RLiang HDingler TVelloso EGoncalves JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Gaze-Supported 3D Object Manipulation in Virtual RealityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445343(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445343
Pfeuffer KMecke LDelgado Rodriguez SHassib MMaier HAlt F(2020)Empirical Evaluation of Gaze-enhanced Menus in Virtual RealityProceedings of the 26th ACM Symposium on Virtual Reality Software and Technology10.1145/3385956.3418962(1-11)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3385956.3418962
Lee JPark J(2020)3D Mirrored Object Selection for Occluded Objects in Virtual EnvironmentsIEEE Access10.1109/ACCESS.2020.30353768(200259-200274)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3035376
Xu JTang ZZhao HZhang J(2019)Hand Gesture-Based Virtual Reality Training Simulator for Collaboration Rescue of a Railway AccidentInteracting with Computers10.1093/iwc/iwz037Online publication date: 12-Dec-2019
https://doi.org/10.1093/iwc/iwz037
Ryu KLee JPark J(2019)GG Interaction: a gaze–grasp pose interaction for 3D virtual object selectionJournal on Multimodal User Interfaces10.1007/s12193-019-00305-yOnline publication date: 19-Jul-2019
https://doi.org/10.1007/s12193-019-00305-y
Lahiani HKherallah MNeji M(2018)Hand Pose Estimation System Based on a Cascade Approach for Mobile DevicesIntelligent Systems Design and Applications10.1007/978-3-319-76348-4_60(619-629)Online publication date: 22-Mar-2018
https://doi.org/10.1007/978-3-319-76348-4_60
Deng SJiang NChang JGuo SZhang J(2017)Understanding the impact of multimodal interaction using gaze informed mid-air gesture control in 3D virtual objects manipulationInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2017.04.002105(68-80)Online publication date: Sep-2017
https://doi.org/10.1016/j.ijhcs.2017.04.002
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents