research-article

The precision of eye-trackers: a case for a new measure

Authors:

Pieter Blignaut,

Tanya BeeldersAuthors Info & Claims

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 289 - 292

https://doi.org/10.1145/2168556.2168618

Published: 28 March 2012 Publication History

Get Access

Abstract

Several possible measures for the precision of an eye-tracker exist. The fact that the commonly used measures of standard deviation and RMS lack with respect to their ability to produce replicable results with varying frame rate, gaze distance and arrangement of samples within a fixation, makes it difficult to compare eye-trackers. It is proposed that an area-based measure, BCEA, is adapted to provide a one dimensional quantity that is intuitive, independent of frame rate and sensitive to small jerks in the reported fixation position.

References

[1]

Crossland, M. D. and Rubin, G. S. 2002. The Use of an Infrared yetracker to Measure Fixation Stability. Optometry and Vision Science, 79(11), 735--739.

Crossref

Google Scholar

[2]

ISO 5725-1. 1994. Accuracy (trueness and precision) of measurement methods and results --- Part1: general principles and definitions. International Standards Organisation. Geneva, Switzerland.

Google Scholar

[3]

Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H. and Van de Weijer, J. 2011. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press, London.

Google Scholar

[4]

VIM. 2008. International vocabulary of metrology --- Basic and general concepts and associated terms. Joint Committee on Guides for Metrology (JCGM). International Standards Organization, 2008.

Google Scholar

Cited By

View all

Nyström MHooge IHessels RAndersson RHansen DJohansson RNiehorster D(2025)The fundamentals of eye tracking part 3: How to choose an eye trackerBehavior Research Methods10.3758/s13428-024-02587-x57:2Online publication date: 22-Jan-2025
https://doi.org/10.3758/s13428-024-02587-x
Heydarian HAdam MBurrows TRollo M(2025)Exploring Score-Level and Decision-Level Fusion of Inertial and Video Data for Intake Gesture DetectionIEEE Access10.1109/ACCESS.2021.311925313(643-655)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2021.3119253
Park YManduchi R(2024)A Functional Usability Analysis of Appearance-Based Gaze Tracking for AccessibilityProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656363(1-7)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3656363
Show More Cited By

Index Terms

The precision of eye-trackers: a case for a new measure
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Eye tracker data quality: what it is and how to measure it
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Data quality is essential to the validity of research results and to the quality of gaze interaction. We argue that the lack of standard measures for eye data quality makes several aspects of manufacturing and using eye trackers, as well as researching ...
TrackStick: a data quality measuring tool for Tobii eye trackers
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

It is important that eye-tracking studies report the accuracy and precision of the eye tracker. It is argued that the values provided by the manufacturers are representative of the best possible capability of the eye tracker under ideal conditions and ...
GazeMetrics: An Open-Source Tool for Measuring the Data Quality of HMD-based Eye Trackers
ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

As virtual reality (VR) garners more attention for eye tracking research, knowledge of accuracy and precision of head-mounted display (HMD) based eye trackers becomes increasingly necessary. It is tempting to rely on manufacturer-provided information ...

Comments

Information & Contributors

Information

Published In

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2012

420 pages

ISBN:9781450312219

DOI:10.1145/2168556

Conference Chairs:
Carlos H. Morimoto
University of São Paulo, Brazil
,
Howell Istance
Montfort University, UK
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Jeffrey B. Mulligan
NASA
,
Pernilla Qvarfordt
FX Palo Alto

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '12

Sponsor:

ETRA '12: Eye Tracking Research and Applications

March 28 - 30, 2012

California, Santa Barbara

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
518
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)3

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Nyström MHooge IHessels RAndersson RHansen DJohansson RNiehorster D(2025)The fundamentals of eye tracking part 3: How to choose an eye trackerBehavior Research Methods10.3758/s13428-024-02587-x57:2Online publication date: 22-Jan-2025
https://doi.org/10.3758/s13428-024-02587-x
Heydarian HAdam MBurrows TRollo M(2025)Exploring Score-Level and Decision-Level Fusion of Inertial and Video Data for Intake Gesture DetectionIEEE Access10.1109/ACCESS.2021.311925313(643-655)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2021.3119253
Park YManduchi R(2024)A Functional Usability Analysis of Appearance-Based Gaze Tracking for AccessibilityProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656363(1-7)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3656363
Manakhov PSidenmark LPfeuffer KGellersen H(2024)Filtering on the Go: Effect of Filters on Gaze Pointing Accuracy During Physical Locomotion in Extended RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345615330:11(7234-7244)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456153
Zemblys RAhlström CKircher KFinér S(2024)Practical aspects of measuring camera‐based indicators of alcohol intoxication in manual and automated drivingIET Intelligent Transport Systems10.1049/itr2.12520Online publication date: 17-Jun-2024
https://doi.org/10.1049/itr2.12520
Huang LHung KMan G(2023)Development a Low-cost Smart Eyewear System for Eye & Head Movement Measurement and Analysis2023 8th International Conference on Instrumentation, Control, and Automation (ICA)10.1109/ICA58538.2023.10273107(64-69)Online publication date: 9-Aug-2023
https://doi.org/10.1109/ICA58538.2023.10273107
Holmqvist KÖrbom SHooge INiehorster DAlexander RAndersson RBenjamins JBlignaut PBrouwer AChuang LDalrymple KDrieghe DDunn MEttinger UFiedler SFoulsham Tvan der Geest JHansen DHutton SKasneci EKingstone AKnox PKok ELee HLee JLeppänen JMacknik SMajaranta PMartinez-Conde SNuthmann ANyström MOrquin JOtero-Millan JPark SPopelka SProudlock FRenkewitz FRoorda ASchulte-Mecklenbeck MSharif BShic FShovman MThomas MVenrooij WZemblys RHessels R(2022)RETRACTED ARTICLE: Eye tracking: empirical foundations for a minimal reporting guidelineBehavior Research Methods10.3758/s13428-021-01762-855:1(364-416)Online publication date: 6-Apr-2022
https://doi.org/10.3758/s13428-021-01762-8
Ostaszewska-Lizewska A(2022)Metrological Aspects in Inteligent Eye-tracking Systems2022 IEEE 11th International Conference on Intelligent Systems (IS)10.1109/IS57118.2022.10019672(1-5)Online publication date: 12-Oct-2022
https://doi.org/10.1109/IS57118.2022.10019672
Holmqvist KÖrbom SZemblys R(2021)Small head movements increase and colour noise in data from five video-based P–CR eye trackersBehavior Research Methods10.3758/s13428-021-01648-954:2(845-863)Online publication date: 6-Aug-2021
https://doi.org/10.3758/s13428-021-01648-9
Sipatchin AWahl SRifai K(2021)Eye-Tracking for Clinical Ophthalmology with Virtual Reality (VR): A Case Study of the HTC Vive Pro Eye’s UsabilityHealthcare10.3390/healthcare90201809:2(180)Online publication date: 9-Feb-2021
https://doi.org/10.3390/healthcare9020180
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Eye tracker data quality: what it is and how to measure it

TrackStick: a data quality measuring tool for Tobii eye trackers

GazeMetrics: An Open-Source Tool for Measuring the Data Quality of HMD-based Eye Trackers