extended-abstract

Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network

Authors:

Weston Sewell,

Oleg KomogortsevAuthors Info & Claims

CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Pages 3739 - 3744

https://doi.org/10.1145/1753846.1754048

Published: 10 April 2010 Publication History

Get Access

Abstract

An eye-gaze-guided computer interface could enable computer use by the seriously disabled but existing systems cost tens of thousands of dollars or have cumbersome setups. This paper presents a methodology for real-time eye gaze tracking using a standard webcam without the need for hardware modification or special placement. An artificial neural network was employed to estimate the location of the user's gaze based on an image of the user's eye, mimicking the way that humans determine where another person is looking. Accuracy measurements and usability experiments were performed using a laptop computer with a webcam built into the screen. The results show this approach to be promising for the development of usable eye tracking systems using standard webcams, particularly those built into many laptop computers.

References

[1]

FANN. {Online} {Cited: December 2, 2009.} http://leenissen.dk.

Google Scholar

[2]

OpenCV. {Online} {Cited: December 2, 2009.} http://opencv.willowgarage.com.

Google Scholar

[3]

Low-Cost Gaze Interaction: Ready to Deliver the Promises. Agustin, Javier San, et al. : ACM, 2009. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems. pp. 4453--4458.

Digital Library

Google Scholar

[4]

Bäck, David. Neural Network Gaze Tracking using Web Camera. Välkommen till institutionen för medicinsk teknik : Masters Thesis, 2005.

Google Scholar

[5]

Non-Intrusive Gaze Tracking Using Artificial Neural Networks. Baluja, Shumeet and Pomerleau, Dean. 1994, Technical Report: CS-94-102.

Digital Library

Google Scholar

[6]

Task-Dependent Evolution of Modularity in Neural Networks. Igel, Christian, Toussaint, Marc and Hüsken, Michael. 2002, Connection Science.

Google Scholar

[7]

A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm. Riedmiller, Martin and Braun, Heinrich. 1993. IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS.

Google Scholar

[8]

Sibert, L.E. and Jacob, R.J. Evaluation of eye gaze interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI '00. ACM, New York, NY, 281--288.

Digital Library

Google Scholar

[9]

Rapid Object Detection using a Boosted Cascade of Simple Features. Viola, Paul and Jones, Michael. s.l. : IEEE, 2001. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. pp. I-511--I-518 vol.1.

Google Scholar

Cited By

View all

Asha KVenkatesh K(2024)A Systematic Review With Recommendations on Intelligent Systems in Cognitive HealthcareIntelligent Solutions for Cognitive Disorders10.4018/979-8-3693-1090-8.ch001(1-21)Online publication date: 23-Feb-2024
https://doi.org/10.4018/979-8-3693-1090-8.ch001
Khaleel AAbbas TSami Ibrahim A(2024)Best low-cost methods for real-time detection of the eye and gaze trackingi-com10.1515/icom-2023-002623:1(79-94)Online publication date: 8-Jan-2024
https://doi.org/10.1515/icom-2023-0026
Kohel KOsama MMohamed NMokhtar MTamer OFakhr M(2024)Gaze Tracking with Multi-Modal Neural Network in Desktop Environments Using Generic Web Camera2024 6th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE)10.1109/REEPE60449.2024.10479903(1-5)Online publication date: 29-Feb-2024
https://doi.org/10.1109/REEPE60449.2024.10479903
Show More Cited By

Index Terms

Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Scalable Webcam Eye Tracking by Learning from User Interactions
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

Eye tracking systems are commonly used in a variety of research domains, but cost thousands of dollars. In my thesis I investigate a new approach to enable eye tracking for common webcams. The aim is to provide a natural experience to everyday users ...
Evaluating Calibration-free Webcam-based Eye Tracking for Gaze-based User Modeling
ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction

Eye tracking has been a research tool for decades, providing insights into interactions, usability, and, more recently, gaze-enabled interfaces. Recent work has utilized consumer-grade and webcam-based eye tracking, but is limited by the need to ...
Eye and gaze tracking for interactive graphic display

This paper describes a computer vision system based on active IR illumination for real-time gaze tracking for interactive graphic display. Unlike most of the existing gaze tracking techniques, which often require assuming a static head to work well and ...

Comments

Information & Contributors

Information

Published In

CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

April 2010

2219 pages

ISBN:9781605589305

DOI:10.1145/1753846

General Chairs:
Elizabeth Mynatt
Georgia Institute of Technology
,
Don Schoner
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

CHI EA '10 Paper Acceptance Rate 350 of 1,346 submissions, 26%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

78
Total Citations
View Citations
1,702
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)5

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Asha KVenkatesh K(2024)A Systematic Review With Recommendations on Intelligent Systems in Cognitive HealthcareIntelligent Solutions for Cognitive Disorders10.4018/979-8-3693-1090-8.ch001(1-21)Online publication date: 23-Feb-2024
https://doi.org/10.4018/979-8-3693-1090-8.ch001
Khaleel AAbbas TSami Ibrahim A(2024)Best low-cost methods for real-time detection of the eye and gaze trackingi-com10.1515/icom-2023-002623:1(79-94)Online publication date: 8-Jan-2024
https://doi.org/10.1515/icom-2023-0026
Kohel KOsama MMohamed NMokhtar MTamer OFakhr M(2024)Gaze Tracking with Multi-Modal Neural Network in Desktop Environments Using Generic Web Camera2024 6th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE)10.1109/REEPE60449.2024.10479903(1-5)Online publication date: 29-Feb-2024
https://doi.org/10.1109/REEPE60449.2024.10479903
Hassan MYin XZhuang YAldridge CMcMurry TSoutherland ARohde G(2024)A Digital Camera-Based Eye Movement Assessment Method for NeuroEye ExaminationIEEE Journal of Biomedical and Health Informatics10.1109/JBHI.2023.328594028:2(655-665)Online publication date: Feb-2024
https://doi.org/10.1109/JBHI.2023.3285940
Mahanama BAshok VJayarathna S(2024)Multi-Eyes: A Framework for Multi-User Eye-Tracking using Webcameras2024 IEEE International Conference on Information Reuse and Integration for Data Science (IRI)10.1109/IRI62200.2024.00069(308-313)Online publication date: 7-Aug-2024
https://doi.org/10.1109/IRI62200.2024.00069
Molina-Cantero ALebrato-Vázquez CCastro-García JMerino-Monge MBiscarri-Triviño FEscudero-Fombuena J(2024)A review on visible-light eye-tracking methods based on a low-cost cameraJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-024-04760-815:4(2381-2397)Online publication date: 14-Mar-2024
https://doi.org/10.1007/s12652-024-04760-8
Ansari MKasprowski PPeer P(2023)Person-Specific Gaze Estimation from Low-Quality Webcam ImagesSensors10.3390/s2308413823:8(4138)Online publication date: 20-Apr-2023
https://doi.org/10.3390/s23084138
Garcia De La Santa Ramos ACabeza RVillanueva A(2023)Calibration free eye tracking solution for mobile and embedded devicesProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3589539(1-3)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3589539
Booth BBosch ND’Mello S(2023)Engagement Detection and Its Applications in Learning: A Tutorial and Selective ReviewProceedings of the IEEE10.1109/JPROC.2023.3309560111:10(1398-1422)Online publication date: Oct-2023
https://doi.org/10.1109/JPROC.2023.3309560
Beinborn LHollenstein NBeinborn LHollenstein N(2023)Cognitive Signals of Language ProcessingCognitive Plausibility in Natural Language Processing10.1007/978-3-031-43260-6_3(31-60)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-43260-6_3
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Scalable Webcam Eye Tracking by Learning from User Interactions

Evaluating Calibration-free Webcam-based Eye Tracking for Gaze-based User Modeling

Eye and gaze tracking for interactive graphic display