research-article

On the Applicability of Computer Vision based Gaze Tracking in Mobile Scenarios

Authors:

Oliver Hohlfeld,

Jó Ágila Bitsch Link,

Dennis GuseAuthors Info & Claims

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

Pages 427 - 434

https://doi.org/10.1145/2785830.2785869

Published: 24 August 2015 Publication History

Abstract

Gaze tracking is a common technique to study user interaction but is also increasingly used as input modality. In this regard, computer vision based systems provide a promising low-cost realization of gaze tracking on mobile devices. This paper complements related work focusing on algorithmic designs by conducting two users studies aiming to i) independently evaluate EyeTab as promising gaze tracking approach and ii) by providing the first independent use case driven evaluation of its applicability in mobile scenarios. Our evaluation elucidates the current state of mobile computer vision based gaze tracking and aims to pave the way for improved algorithms. In this regard, we aim to further foster the development by releasing our source data as reference database open to the public.

References

[1]

EyetrackingDB. http://eyetrackingdb.github.io/ or http://eyetrackingdb.ohohlfeld.com.

[2]

Gaze Tracking Framework. https://github.com/eyetrackingDB/GazeTrackingFramework.

[3]

NormMaker. https://github.com/eyetrackingDB/NormMaker.

[4]

Andrienko, G., Andrienko, N., Burch, M., and Weiskopf, D. Visual analytics methodology for eye movement studies. IEEE Transactions on Visualization and Computer Graphics 18, 12 (Dec 2012), 2889--2898.

Digital Library

[5]

Brown, A., Evans, M., Jay, C., Glancy, M., Jones, R., and Harper, S. Hci over multiple screens. In CHI Extended Abstracts (2014).

Digital Library

[6]

Bulling, A., and Gellersen, H. Toward mobile eye-based human-computer interaction. IEEE Pervasive Computing 9, 4 (Oct. 2010), 8--12.

Digital Library

[7]

Bulling, A., Roggen, D., and Tröster, G. Wearable EOG Goggles: Eye-based interaction in everyday environments. In CHI Extended Abstracts (2009).

Digital Library

[8]

Drewes, H., De Luca, A., and Schmidt, A. Eye-gaze interaction for mobile phones. In Mobility (2007).

Digital Library

[9]

Heim, S., Pape-Neumann, J., van Ermingen-Marbach, M., Brinkhaus, M., and Grande, M. Shared vs. specific brain activation changes in dyslexia after training of phonology, attention, or reading. Brain Structure and Function (2014), 1--17.

[10]

Hillen, R., Günther, T., Kohlen, C., Eckers, C., van Ermingen-Marbach, M., Sass, K., Scharke, W., Vollmar, J., Radach, R., and Heim, S. Identifying brain systems for gaze orienting during reading: fmri investigation of the landolt paradigm. Frontiers in Human Neuroscience 7 (2013), 384.

[11]

Holland, C., Garza, A., Kurtova, E., Cruz, J., and Komogortsev, O. Usability evaluation of eye tracking on an unmodified common tablet. In CHI Extended Abstracts (2013).

Digital Library

[12]

Holland, C., and Komogortsev, O. Eye tracking on unmodified common tablets: Challenges and solutions. In Symposium on Eye-Tracking Research & Applications (2012).

Digital Library

[13]

Hume, T. EyeLike - OpenCV based webcam gaze tracker.

[14]

Hutzler, F., and Wimmer, H. Eye movements of dyslexic children when reading in a regular orthography. Brain Lang 89, 1 (2004), 35--242.

[15]

Ishimaru, S., Kunze, K., Utsumi, Y., Iwamura, M., and Kise, K. Where are you looking at? - feature-based eye tracking on unmodified tablets. In ACPR (2013).

Digital Library

[16]

Kiefer, P., Giannopoulos, I., Kremer, D., Schlieder, C., and Raubal, M. Starting to get bored: An outdoor eye tracking study of tourists exploring a city panorama. In Symposium on Eye-Tracking Research & Applications (2014).

Digital Library

[17]

Kinnunen, T., Sedlak, F., and Bednarik, R. Towards task-independent person authentication using eye movement signals. In Symposium on Eye-Tracking Research & Applications (2010).

Digital Library

[18]

Klische, A. Leseschwächen gezielt beheben. PhD thesis, Ludwig-Maximilians-Universität München, December 2006. in German.

[19]

Kunze, K., Utsumi, Y., Shiga, Y., Kise, K., and Bulling, A. I know what you are reading: Recognition of document types using mobile eye tracking. In International Symposium on Wearable Computers (2013).

Digital Library

[20]

Pape-Neumann, J., van Ermingen-Marbach, M., Verhalen, N., Heim, S., and Grande, M. Rapid automatized naming, processing speed, and reading fluency. Sprache Stimme Gehör 39, 01 (2015), 30--35. in German.

[21]

Prieto, L. P., Wen, Y., Caballero, D., Sharma, K., and Dillenbourg, P. Studying teacher cognitive load in multi-tabletop classrooms using mobile eye-tracking. In ACM Conference on Interactive Tabletops and Surfaces (2014).

Digital Library

[22]

Repscher, S., Grande, M., Heim, S., van Ermingen, M., and Pape-Neumann, J. Developing parallelised word lists for a repeated testing of dyslectic children. Sprache Stimme Gehör 36, 01 (2012), 33--39. in German.

[23]

Schneps, M. H., Thomson, J. M., Sonnert, G., Pomplun, M., Chen, C., and Heffner-Wong, A. Shorter lines facilitate reading in those who struggle. PloS ONE 8, 8 (2013), e71161.

[24]

Seshadrinathan, K., Soundararajan, R., Bovik, A. C., and Cormack, L. K. Study of subjective and objective quality assessment of video. Trans. Img. Proc. 19, 6 (June 2010), 1427--1441.

Digital Library

[25]

Soleymani, M., Lichtenauer, J., Pun, T., and Pantic, M. A multimodal database for affect recognition and implicit tagging. IEEE Transactions on Affective Computing 3, 1 (2012), 42--55.

Digital Library

[26]

Timm, F., and Barth, E. Accurate eye centre localisation by means of gradients. In VISAPP (2011).

[27]

Turner, J., Bulling, A., and Gellersen, H. Extending the visual field of a head-mounted eye tracker for pervasive eye-based interaction. In Symposium on Eye-Tracking Research & Applications (2012).

Digital Library

[28]

Vaitukaitis, V., and Bulling, A. Eye gesture recognition on portable devices. In ACM UbiComp (2012).

Digital Library

[29]

Valenti, R., and Gevers, T. Accurate eye center location and tracking using isophote curvature. In CVPR (2008).

[30]

van Ermingen-Marbach, M., Verhalen, N., Grande, M., Heim, S., Mayer, A., and Pape-Neumann, J. Standards for rapid automatised naming performances in normal reading children at the age of 9--11. Sprache Stimme Gehör 38, 04 (2014), e28--e32. in German.

[31]

Wood, E. Gaze tracking for commodity portable devices. Master's thesis, Gonville and Caius College - University of Cambridge, 2013.

[32]

Wood, E., and Bulling, A. EyeTab source code.

[33]

Wood, E., and Bulling, A. EyeTab: Model-based gaze estimation on unmodified tablet computers. In Symposium on Eye-Tracking Research & Applications (2014).

Digital Library

Cited By

Park YManduchi R(2024)A Functional Usability Analysis of Appearance-Based Gaze Tracking for AccessibilityProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656363(1-7)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3656363
Namnakani O(2023)Gaze-based Interaction on Handheld Mobile DevicesProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3589540(1-4)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3589540
Khamis MMarky KBulling AAlt F(2022)User-centred multimodal authentication: securing handheld mobile devices using gaze and touch inputBehaviour & Information Technology10.1080/0144929X.2022.206959741:10(2061-2083)Online publication date: 6-May-2022
https://doi.org/10.1080/0144929X.2022.2069597
Show More Cited By

Index Terms

On the Applicability of Computer Vision based Gaze Tracking in Mobile Scenarios
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Mobile 3D Gaze Tracking Calibration
CRV '15: Proceedings of the 2015 12th Conference on Computer and Robot Vision

We present a new calibration method to combine a mobile eye tracker with an external tracking system to obtain a 3D gaze vector. Our method captures calibration points of varying distances, pupil positions and head positions/orientations. With these ...
A Simplified 3D Gaze Tracking Technology with Stereo Vision
ICOIP '10: Proceedings of the 2010 International Conference on Optoelectronics and Image Processing - Volume 01

A simplified 3D gaze tracking technology with stereo vision has been developed in this paper. A pair of stereo cameras and two point light sources are used to estimate 3D gaze of user's eye. Compared with other 3D systems, there are two improvements to ...
Interacting with objects in the environment using gaze tracking glasses and speech
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design

This work explores the combination of gaze and speech to interact with objects in the environment. A head-mounted wireless gaze tracker in the form of gaze tracking glasses is used for mobile monitoring of a subject's point of regard on the surrounding ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 2015

611 pages

ISBN:9781450336529

DOI:10.1145/2785830

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
326
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)6

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Park YManduchi R(2024)A Functional Usability Analysis of Appearance-Based Gaze Tracking for AccessibilityProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656363(1-7)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3656363
Namnakani O(2023)Gaze-based Interaction on Handheld Mobile DevicesProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3589540(1-4)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3589540
Khamis MMarky KBulling AAlt F(2022)User-centred multimodal authentication: securing handheld mobile devices using gaze and touch inputBehaviour & Information Technology10.1080/0144929X.2022.206959741:10(2061-2083)Online publication date: 6-May-2022
https://doi.org/10.1080/0144929X.2022.2069597
Bâce MStaal SBulling ABernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Quantification of Users' Visual Attention During Everyday Mobile Device InteractionsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376449(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376449
Rivu SAbdrabou YMayer TPfeuffer KAlt FKrejtz KSharif B(2019)GazeButtonProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3317956.3318154(1-7)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3317956.3318154
Liu DGe RDing Qli Mli QYang MLiu D(2019)RETRACTED ARTICLE: The application of target tracking method in power load analysis based on computer vision in complex scenesCluster Computing10.1007/s10586-017-1405-322:Suppl 5(11457-11465)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1007/s10586-017-1405-3
Brousseau BRose JEizenman M(2018)Accurate Model-Based Point of Gaze Estimation on Mobile DevicesVision10.3390/vision20300352:3(35)Online publication date: 24-Aug-2018
https://doi.org/10.3390/vision2030035
Khamis MAlt FBulling ABailie LOliver N(2018)The past, present, and future of gaze-enabled handheld mobile devicesProceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3229434.3229452(1-17)Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1145/3229434.3229452
Ho TWang HLai S(2018)Non-native Language Reading Support with Display of Machine Translation Based on Eye-Tracking and Sentence-Level MappingProceedings of the Sixth International Symposium of Chinese CHI10.1145/3202667.3202675(57-63)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3202667.3202675
Khamis MBaier AHenze NAlt FBulling AMandryk RHancock MPerry MCox A(2018)Understanding Face and Eye Visibility in Front-Facing Cameras of Smartphones used in the WildProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173854(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173854
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents