research-article

Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction

Authors:

Moritz Kassner,

William Patera,

Andreas BullingAuthors Info & Claims

UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication

Pages 1151 - 1160

https://doi.org/10.1145/2638728.2641695

Published: 13 September 2014 Publication History

Abstract

In this paper we present Pupil -- an accessible, affordable, and extensible open source platform for pervasive eye tracking and gaze-based interaction. Pupil comprises 1) a light-weight eye tracking headset, 2) an open source software framework for mobile eye tracking, as well as 3) a graphical user interface to playback and visualize video and gaze data. Pupil features high-resolution scene and eye cameras for monocular and binocular gaze estimation. The software and GUI are platform-independent and include state-of-the-art algorithms for real-time pupil detection and tracking, calibration, and accurate gaze estimation. Results of a performance evaluation show that Pupil can provide an average gaze estimation accuracy of 0.6 degree of visual angle (0.08 degree precision) with a processing pipeline latency of only 0.045 seconds.

References

[1]

Babcock, J. S., and Pelz, J. B. Building a lightweight eyetracking headgear. In Proceedings of the 2004 symposium on Eye tracking research & applications, ACM (2004), 109--114.

Digital Library

[2]

Bulling, A., and Gellersen, H. Toward Mobile Eye-Based Human-Computer Interaction. IEEE Pervasive Computing 9, 4 (2010), 8--12.

Digital Library

[3]

Canny, J. A computational approach to edge detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 6 (1986), 679--698.

Digital Library

[4]

Ferhat, O., Vilariño, F., and Sánchez, F. J. A cheap portable eye-tracker solution for common setups. Journal of Eye Movement Research 7, 3 (2014), 2:1--10.

[5]

Fitzgibbon, A. W., Fisher, R. B., et al. A buyer's guide to conic fitting. DAI Research paper (1996).

[6]

Global, T. Accuracy and precision test method for remote eye trackers, 2011.

[7]

Hardy, G., Seshu Aiyar, P., and Wilson, B. Collected papers of srinivasa ramanujan. Cambridge, London (1927).

[8]

Li, D., Babcock, J., and Parkhurst, D. J. openeyes: a low-cost head-mounted eye-tracking solution. In Proceedings of the 2006 symposium on Eye tracking research & applications, ACM (2006), 95--100.

Digital Library

[9]

Lukander, K., Jagadeesan, S., Chi, H., and Müller, K. Omg!: A new robust, wearable and affordable open source mobile gaze tracker. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services, ACM (2013), 408--411.

Digital Library

[10]

Mantiuk, R., Kowalik, M., Nowosielski, A., and Bazyluk, B. Do-it-yourself eye tracker: Low-cost pupil-based eye tracker for computer graphics applications. In Advances in Multimedia Modeling. Springer, 2012, 115--125.

Digital Library

[11]

Mardanbegi, D. Haytham gaze tracker: Diy hardware and open source software, March 2013.

[12]

Mulvey, F. Woking copy of definitions and terminology for eye tracker accuracy and precision, 2010.

[13]

Ryan, W. J., Duchowski, A. T., and Birchfield, S. T. Limbus/pupil switching for wearable eye tracking under variable lighting conditions. In Proceedings of the 2008 symposium on Eye tracking research & applications, ACM (2008), 61--64.

Digital Library

[14]

Suzuki, S., et al. Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing 30, 1 (1985), 32--46.

[15]

Świrski, L., Bulling, A., and Dodgson, N. Robust real-time pupil tracking in highly off-axis images. In Proceedings of the Symposium on Eye Tracking Research and Applications, ACM (2012), 173--176.

Digital Library

[16]

Topal, C., Gerek, O. N., and Doǧan, A. A head-mounted sensor-based eye tracking device: Eye touch system. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, ETRA '08, ACM (New York, NY, USA, 2008), 87--90.

Digital Library

Cited By

Niehorster DNyström MHessels RAndersson RBenjamins JHansen DHooge I(2025)The fundamentals of eye tracking part 4: Tools for conducting an eye tracking studyBehavior Research Methods10.3758/s13428-024-02529-757:1Online publication date: 6-Jan-2025
https://doi.org/10.3758/s13428-024-02529-7
Liu XShen HLi HTao YYang M(2025)Multimodal Depression Detection Based on Self-Attention Network With Facial Expression and PupilIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340594912:1(64-76)Online publication date: Feb-2025
https://doi.org/10.1109/TCSS.2024.3405949
Meregalli VGiovannini STrevisan ARomanelli MUgur STenconi EMeneguzzo PCardi VCollantoni E(2025)Eyes on the body: assessing attentional bias toward body-related stimuli in Anorexia NervosaJournal of Psychiatric Research10.1016/j.jpsychires.2025.01.043Online publication date: Jan-2025
https://doi.org/10.1016/j.jpsychires.2025.01.043
Show More Cited By

Index Terms

Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction
1. Computer systems organization
  1. Embedded and cyber-physical systems
  2. Real-time systems
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pupil-canthi-ratio: a calibration-free method for tracking horizontal gaze direction
AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces

Eye tracking is compelling for hands-free interaction with pervasive displays. However, most existing eye tracking systems require specialised hardware and explicit calibrations of equipment and individual users, which inhibit their widespread adoption. ...
HMAGIC: head movement and gaze input cascaded pointing
PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Augmentative and alternative communication tools allow people with severe motor disabilities to interact with computers. Two commonly used tools are video-based interfaces and eye trackers. Video-based interfaces map head movements captured by a camera ...
InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation

Analysis of everyday human gaze behaviour has significant potential for ubiquitous computing, as evidenced by a large body of work in gaze-based human-computer interaction, attentive user interfaces, and eye-based user modelling. However, current mobile ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication

September 2014

1409 pages

ISBN:9781450330473

DOI:10.1145/2638728

General Chairs:
AJ Brush
Microsoft Research
,
Adrian Friday
Lancaster University, UK
,
Program Chairs:
Julie Kientz
University of Washington
,
James Scott
Microsoft Research, UK
,
Junehwa Song
Korea Advanced Institute of Science and Technology (KAIST), KR

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '14

Sponsor:

UbiComp '14: The 2014 ACM Conference on Ubiquitous Computing

September 13 - 17, 2014

Washington, Seattle

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

547
Total Citations
View Citations
4,189
Total Downloads

Downloads (Last 12 months)351
Downloads (Last 6 weeks)27

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Niehorster DNyström MHessels RAndersson RBenjamins JHansen DHooge I(2025)The fundamentals of eye tracking part 4: Tools for conducting an eye tracking studyBehavior Research Methods10.3758/s13428-024-02529-757:1Online publication date: 6-Jan-2025
https://doi.org/10.3758/s13428-024-02529-7
Liu XShen HLi HTao YYang M(2025)Multimodal Depression Detection Based on Self-Attention Network With Facial Expression and PupilIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340594912:1(64-76)Online publication date: Feb-2025
https://doi.org/10.1109/TCSS.2024.3405949
Meregalli VGiovannini STrevisan ARomanelli MUgur STenconi EMeneguzzo PCardi VCollantoni E(2025)Eyes on the body: assessing attentional bias toward body-related stimuli in Anorexia NervosaJournal of Psychiatric Research10.1016/j.jpsychires.2025.01.043Online publication date: Jan-2025
https://doi.org/10.1016/j.jpsychires.2025.01.043
Islam MManab MMondal JZabeen SRahman FHasan MSadeque FNoor J(2025)Involution fused convolution for classifying eye-tracking patterns of children with Autism Spectrum DisorderEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.109475139:PAOnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.engappai.2024.109475
Richardson EBuchner SKintz JClark TAnderson ADastani MSichman JAlechina NDignum V(2024)Psychophysiological Models of Cognitive States Can Be Operator-AgnosticProceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems10.5555/3635637.3663186(2438-2440)Online publication date: 6-May-2024
https://dl.acm.org/doi/10.5555/3635637.3663186
Panwar DSharma PSharma SGoyal MGoyal K(2024)Role of Artificial Intelligence in Cognitive Assessment and Early Detection of Alzheimer's DiseaseAI-Driven Alzheimer's Disease Detection and Prediction10.4018/979-8-3693-3605-2.ch013(190-210)Online publication date: 28-Jun-2024
https://doi.org/10.4018/979-8-3693-3605-2.ch013
Drews MDierkes K(2024)Strategies for enhancing automatic fixation detection in head-mounted eye trackingBehavior Research Methods10.3758/s13428-024-02360-056:6(6276-6298)Online publication date: 9-Apr-2024
https://doi.org/10.3758/s13428-024-02360-0
Gorman LSun WMathew JRezazadeh ZSulik JFairhurst MDeroy O(2024)Choice enhances touch pleasantnessAttention, Perception, & Psychophysics10.3758/s13414-024-02887-686:5(1709-1723)Online publication date: 10-Jun-2024
https://doi.org/10.3758/s13414-024-02887-6
Palm RLilienthal A(2024)Crossing-Point Estimation in Human–Robot Navigation—Statistical Linearization versus Sigma-Point TransformationSensors10.3390/s2411330324:11(3303)Online publication date: 22-May-2024
https://doi.org/10.3390/s24113303
Gundler CTemmen MGulberti APötter-Nerger MÜckert F(2024)Improving Eye-Tracking Data Quality: A Framework for Reproducible Evaluation of Detection AlgorithmsSensors10.3390/s2409268824:9(2688)Online publication date: 24-Apr-2024
https://doi.org/10.3390/s24092688
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten