research-article

Aggregate gaze visualization with real-time heatmaps

Authors:

Andrew T. Duchowski,

Margaux M. Price,

Pilar OreroAuthors Info & Claims

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 13 - 20

https://doi.org/10.1145/2168556.2168558

Published: 28 March 2012 Publication History

Abstract

A GPU implementation is given for real-time visualization of aggregate eye movements (gaze) via heatmaps. Parallelization of the algorithm leads to substantial speedup over its CPU-based implementation and, for the first time, allows real-time rendering of heatmaps atop video. GLSL shader colorization allows the choice of color ramps. Several luminance-based color maps are advocated as alternatives to the popular rainbow color map, considered inappropriate (harmful) for depiction of (relative) gaze distributions.

References

[1]

Baron, J., and Li, Y., 2007. Notes on the use of R for psychology experiments and questionnaires. Online Notes, 09 November. URL: http://www.psych.upenn.edu/~baron/rpsych/rpsych.html (last accessed Dec. 2007).

[2]

Batcher, K. E. 1968. Sorting networks and their applications. In Proceedings of the April 30--May 2, 1968, Spring Joint Computer Conference, ACM, New York, NY, AFIPS '68, 307--314.

Digital Library

[3]

Borland, D., and Taylor II, R. M. 2007. Rainbow Color Map (Still) Considered Harmful. IEEE Computer Graphics and Applications 27, 2 (March/April), 14--17.

Digital Library

[4]

Bourke, P., 1996. Colour ramping for data visualisation. Online Tutrial, July. URL: http://local.wasp.uwa.edu.au/~pbourke/texture_colour/colourramp/ (last accessed, Dec. 2010).

[5]

Breslow, L. A., Ratwani, R. M., and Trafton, J. G. 2009. Cognitive Models of the Influence of Color Scale on Data Visualization Tasks. Human Factors 51, 3, 321--338.

[6]

Brewer, C., Harrower, M., Woodruff, A., and Heyman, D., 2009. Colorbrewer 2.0: Color advice for maps. Online Resource, Winter. URL: http://colorbrewer2.org (last accessed Dec. 2010).

[7]

Buck, I., and Purcell, T. 2004. A Toolkit for Computation on GPUs. In GPU Gems: Programming Techniques, Tips, and Tricks for Real-Time Graphics, R. Fernando, Ed. Addison-Wesley, Boston, MA, 621--636.

[8]

Caldara, R., and Miellet, S. 2011. iMap: a novel method for statistical fixation mapping of eye movement data. Behavior Research Methods 43, 3 (April), 864--878.

[9]

Chafe, W. L. 1980. The Deployment of Consciousness in the Production of a Narrative. In The Pear Stories: Cognitive, Cultural and Linguistic Aspects of Narrative Production, W. L. Chafe, Ed. Ablex Publishing Corporation, Norwood, NJ.

[10]

Daugherty, B. 2000. Ocular Vergence Response Over Anaglyphic Stereoscopic Video. Master's thesis, Clemson University, Clemson, SC.

[11]

Duchowski, A. T., Driver, J., Jolaoso, S., Ramey, B. N., Robbins, A., and Tan, W. 2010. Scanpath Comparison Revisited. In Eye Tracking Research & Applications (ETRA), ACM, Austin, TX.

Digital Library

[12]

Elias, G., Sherwin, G., and Wise, J. 1984. Eye movements while viewing NTSC format television. Tech. rep., SMPTE Psychophysics Subcommittee, March.

[13]

Fournier, A., Ed. 1995. Course Notes: Wavelets and Their Applications in Computer Graphics, SIGGRAPH 1995, 22nd International Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY.

[14]

Grindinger, T. J., Murali, V. N., Tetreault, S., Duchowski, A. T., Birchfield, S. T., and Orero, P. 2010. Algorithm for Discriminating Aggregate Gaze Points: Comparison with Salient Regions-Of-Interest. In International Workshop on Gaze Sensing and Interactions, IWGSI/ACCV.

Digital Library

[15]

Kirk, D. B., and Hwu, W.-m. W. 2010. Programming Massively Parallel Processors: A Hands-on Approach. Morgan Kaufmann Publishers, Burlington, MA.

Digital Library

[16]

Marchant, P., Raybould, D., Renshaw, T., and Stevens, R. 2009. Are You Seeing What I'm Seeing? An Eye-Tracking Evaluation of Dynamic Scenes. Digital Creativity 20, 3, 153--163.

[17]

McDonnell, R., Larkin, M., Hernández, B., Rudomin, I., and O'Sullivan, C. 2009. Eye-catching crowds: saliency based selective variation. In SIGGRAPH '09: ACM SIGGRAPH 2009 papers, ACM, New York, NY, USA, 1--10.

Digital Library

[18]

Mital, P. K., Smith, T. J., Hill, R. L., and Henderson, J. M. 2011. Clustering of Gaze During Dynamic Scene Viewing is Predicted by Motion. Cognitive Computation 3, 5--24.

[19]

Munshi, A., Gaster, B. R., Mattson, T. G., Fung, J., and Ginsburg, D. 2012. OpenCL Programming Guide. Pearson Education, Inc., Boston, MA.

Digital Library

[20]

Nodine, C. F., Kundel, H. L., Toto, L. C., and Krupinski, E. A. 1992. Recording and analyzing eye-position data using a microcomputer workstation. Behavior Research Methods 24, 3, 475--485.

[21]

Paris, S., and Durand, F. 2006. A Fast Approximation of the Bilateral Filter using a Signal Processing Approach. Tech. Rep. MIT-CSAIL-TR-2006-073, Massachusetts Inst. of Technology.

[22]

Pomplun, M., Ritter, H., and Velichkovsky, B. 1996. Disambiguating Complex Visual Information: Towards Communication of Personal Views of a Scene. Perception 25, 8, 931--948.

[23]

Privitera, C. M. 2006. The scanpath theory: its definitions and later developments. In Human Vision and Electronic Imaging XI, SPIE, San Jose, CA, B. E. Rogowitz, T. N. Pappas, and S. J. Daly, Eds.

[24]

Ratwani, R. M., Trafton, J. G., and Boehm-Davis, D. A. 2008. Thinking Graphically: Connecting Vision and Cognition During Graph Comprehension. Journal of Experimental Psychology: Applied 14, 1, 36--49.

[25]

Rost, R. J., and Licea-Kane, B. 2010. OpenGL Shading Language, 3rd ed. Pearson Education, Inc., Boston, MA.

Digital Library

[26]

Stellmach, S., Nacke, L., and Dachselt, R. 2010. 3D attentional maps: aggregated gaze visualizations in three-dimensional virtual environments. In Proceedings of the International Conference on Advanced Visual Interfaces, ACM, New York, NY, AVI '10, 345--348.

Digital Library

[27]

Stellmach, S. 2009. Visual Analysis of Gaze Data in Virtual Environments. Master's thesis, Otto-von-Guericke University Magdeburg, Magdeburg, Germany.

[28]

van Gisbergen, M. S., van der Most, J., and Aelen, P. 2007. Visual Attention to Online Search Engine Results. Tech. rep., De Vos & Jansen in cooperation with Checkit. URL: http://www.iprospect.nl/wp-content/themes/iprospect/pdf/checkit/eyetracking_research.pdf (last accessed Dec. 2011).

[29]

Špakov, O. 2008. iComponent---Device-Independent Platform for Analyzing Eye Movement Data and Developing Eye-Based Applications. PhD thesis, University of Tampere, Finland.

[30]

Williams, L. 1983. Pyramidal Parametrics. Computer Graphics 17, 3 (July), 1--11.

Digital Library

[31]

Wooding, D. S. 2002. Fixation Maps: Quantifying Eye-Movement Traces. In ETRA '02: Proceedings of the 2002 Symposium on Eye Tracking Research & Applications, ACM, New York, NY, 31--36.

Digital Library

Cited By

Niehorster DNyström MHessels RAndersson RBenjamins JHansen DHooge I(2025)The fundamentals of eye tracking part 4: Tools for conducting an eye tracking studyBehavior Research Methods10.3758/s13428-024-02529-757:1Online publication date: 6-Jan-2025
https://doi.org/10.3758/s13428-024-02529-7
Abeysinghe YMahanama BJayawardena GJayawardana YSunkara MDuchowski AAshok VJayarathna S(2024)A-DisETrac Advanced Analytic Dashboard for Distributed Eye TrackingInternational Journal of Multimedia Data Engineering and Management10.4018/IJMDEM.34179215:1(1-20)Online publication date: 2-Apr-2024
https://doi.org/10.4018/IJMDEM.341792
Akcan DYilmaz MGüleç UIlgın H(2024)Engagement and Brand Recall in Software Developers: An Eye-Tracking Study on AdvergamesApplied Sciences10.3390/app1418836014:18(8360)Online publication date: 17-Sep-2024
https://doi.org/10.3390/app14188360
Show More Cited By

Index Terms

Aggregate gaze visualization with real-time heatmaps
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Rendering
2. Human-centered computing
  1. Accessibility
  2. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Realistic heatmap visualization for interactive analysis of 3D gaze data
ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

In this paper, a novel approach for real-time heatmap generation and visualization of 3D gaze data is presented. By projecting the gaze into the scene and considering occlusions from the observer's view, to our knowledge, for the first time a correct ...
Zoomable Heatmaps: Improving Manhattan Plots to Compare Multiple Genome-Wide Studies
Design for Equality and Justice
Abstract
Making comparisons between genome-wide association studies is a crucial practice in genetics. Despite this, conventional visualizations used in these studies tend to suffer from readability issues. These issues include, for instance, overcrowded ...
Informative or Misleading? Heatmaps Deconstructed
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends

Eye tracking heatmaps have become very popular and easy to create over the last few years. They are very compelling and can be effective in summarizing and communicating data. However, heatmaps are often used incorrectly and for the wrong reasons. In ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2012

420 pages

ISBN:9781450312219

DOI:10.1145/2168556

Conference Chairs:
Carlos H. Morimoto
University of São Paulo, Brazil
,
Howell Istance
Montfort University, UK
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Jeffrey B. Mulligan
NASA
,
Pernilla Qvarfordt
FX Palo Alto

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

heatmaps

Qualifiers

Research-article

Conference

ETRA '12

Sponsor:

ETRA '12: Eye Tracking Research and Applications

March 28 - 30, 2012

California, Santa Barbara

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
1,072
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)5

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Niehorster DNyström MHessels RAndersson RBenjamins JHansen DHooge I(2025)The fundamentals of eye tracking part 4: Tools for conducting an eye tracking studyBehavior Research Methods10.3758/s13428-024-02529-757:1Online publication date: 6-Jan-2025
https://doi.org/10.3758/s13428-024-02529-7
Abeysinghe YMahanama BJayawardena GJayawardana YSunkara MDuchowski AAshok VJayarathna S(2024)A-DisETrac Advanced Analytic Dashboard for Distributed Eye TrackingInternational Journal of Multimedia Data Engineering and Management10.4018/IJMDEM.34179215:1(1-20)Online publication date: 2-Apr-2024
https://doi.org/10.4018/IJMDEM.341792
Akcan DYilmaz MGüleç UIlgın H(2024)Engagement and Brand Recall in Software Developers: An Eye-Tracking Study on AdvergamesApplied Sciences10.3390/app1418836014:18(8360)Online publication date: 17-Sep-2024
https://doi.org/10.3390/app14188360
Kim GYeo DLee JKim S(2023)Simulating Urban Element Design with Pedestrian Attention: Visual Saliency as Aid for More Visible Wayfinding DesignLand10.3390/land1202039412:2(394)Online publication date: 1-Feb-2023
https://doi.org/10.3390/land12020394
Pathmanathan NÖney SBecher MSedlmair MWeiskopf DKurzhals K(2023)Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real‐World EnvironmentsComputer Graphics Forum10.1111/cgf.1483842:3(385-396)Online publication date: 27-Jun-2023
https://doi.org/10.1111/cgf.14838
Hao QSbert MFeixas MZhang YVila MZhang J(2023)Saccade Direction Information ChannelNeural Information Processing10.1007/978-3-031-30105-6_4(37-50)Online publication date: 13-Apr-2023
https://doi.org/10.1007/978-3-031-30105-6_4
Duchowski A(2022)Gaze-based interactionComputers and Graphics10.1016/j.cag.2018.04.00273:C(59-69)Online publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.cag.2018.04.002
Kamari MHam Y(2022)AI-based risk assessment for construction site disaster preparedness through deep learning-based digital twinningAutomation in Construction10.1016/j.autcon.2021.104091134(104091)Online publication date: Feb-2022
https://doi.org/10.1016/j.autcon.2021.104091
Krassanakis V(2021)Aggregated Gaze Data Visualization Using Contiguous Irregular CartogramsDigital10.3390/digital10300101:3(130-144)Online publication date: 30-Jun-2021
https://doi.org/10.3390/digital1030010
Elshamy MKhooshabeh P(2021)Fixation: A universal framework for experimental eye movement research✱ACM Symposium on Eye Tracking Research and Applications10.1145/3448018.3458007(1-5)Online publication date: 25-May-2021
https://dl.acm.org/doi/10.1145/3448018.3458007
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents