research-article

Permutation test for groups of scanpaths using normalized Levenshtein distances and application in NMR questions

Authors:

Joseph J. Topczewski,

Anna M. Topczewski,

Norbert J. PientaAuthors Info & Claims

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 169 - 172

https://doi.org/10.1145/2168556.2168584

Published: 28 March 2012 Publication History

Abstract

This paper presents a permutation test that statistically compares two groups of scanpaths. The test uses normalized Levenshtein distances when the lengths of scanpaths are not the same. This method was applied in a recent eye-tracking experiment in which two groups of chemistry students viewed nuclear magnetic resonance (NMR) spectroscopic signals and chose the corresponding molecular structure from the candidates. A significant difference was detected between the two groups, which is consistent with the fact that students in the expert group showed more efficient scan patterns in the experiment than the novice group. Various numbers of permutations were tested and the results showed that p-values only varied in a small range with different permutation numbers and that the statistical significance was not affected.

References

[1]

Alonso, D. E. and Warren, S. E. 2005. NMR analysis of unknowns: An introduction to 2D NMR spectroscopy. Journal of chemical education, 82, 9, 1385--1386.

[2]

Duchowski, A. T., Driver, J., Jolaoso, S., Tan, W., Ramey, B. N. and Robbins, A. 2010. Scanpath comparison revisited. In Proceedings of the Symposium on Eye-tracking Research & Applications, 219--226. New York: ACM Press.

Digital Library

[3]

Feusner, M and Lukoff, B. 2008. Testing for statistically significant differences between groups of scan patterns. In Proceedings of the Symposium on Eye-tracking Research & Applications, ACM Press, New York, 43--46.

Digital Library

[4]

Josephson, S. and Holmes, M. E. 2002. Visual attention to repeated internet images: Testing the scanpath theory on the World Wide Web. In Proceedings of the Symposium on Eye-tracking Research & Applications, ACM Press, New York, 43--49.

Digital Library

[5]

Klebanov, L., Gordon, A., Xiao, Y., Land, H. and Yakovlev, A. 2006. A permutation test motivated by microarray data analysis. Computational Statistics & Data Analysis, 50, 3619--3628.

Digital Library

[6]

Knijnenburg, T. A., Wessels, L. F., Reinders, M. J. and Shmulevich, I. 2009. Fewer permutations, more accurate P-values. Bioinformatics, 25, i161--i168.

Digital Library

[7]

Lai, Y. 2007. Conservative adjustment of permutation p-values when the number of permutations is limited. International Journal of Bioinformatics Research and Applications, 3, 536--546.

Digital Library

[8]

Levenshtein, V. 1966. Binary codes capable of correcting deletions, insertions, and reversals, Soviet Physics Doklady, 10, 707--710.

[9]

Peebles, D. and Cheng, P. C-H. 2001. Graph-based reasoning: From task analysis to cognitive explanation. In Proceedings of the 23rd Annual Conference of the Cognitive Science Society, ed. K. Stenning. Mahwah, Lawrence Erlbaum Associates, NJ.

[10]

Privitera, C. M. and Stark, L. W. 2000. Algorithms for defining visual regions-of-interest: Comparison with eye fixations. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 22, 9, 970--982.

Digital Library

[11]

Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 3, 372--422.

[12]

Rosengrant, D. 2010. Gaze scribing in physics problem solving. In Proceedings of the Symposium on Eye-tracking Research & Applications, ACM Press, New York, 45--48.

Digital Library

[13]

Slykhuis, D. A., Wiebe, E. N. and Annetta, L. A. 2005. Eye-tracking students' attention to powerpoint photographs in a science education setting. Journal of Science Education and Technology, 14, 509--520.

[14]

Van Gog, T., Jarodzka, H., Scheiter, K., Gerjets, P. and Paas, F. 2009. Attention guidance during example study via the model's eye movements. Computers in Human Behavior, 25, 785--791.

Digital Library

[15]

West, J. M., Haake, A. H., Rozanski, E. P. and Karn, K. S. 2006. EyePatterns: Software for identifying patterns and similarities across fixation sequences. In Proceedings of the Symposium on Eye-tracking Research & Applications, ACM Press, New York, 149--154.

Digital Library

Cited By

Akaygun SAdadan E(2021)Investigating the Role of Conceptual Understanding on How Students Watch an Experimental Video Using Eye-TrackingApplying Bio-Measurements Methodologies in Science Education Research10.1007/978-3-030-71535-9_5(93-106)Online publication date: 28-May-2021
https://doi.org/10.1007/978-3-030-71535-9_5
Baluyut JHolme T(2019)Eye tracking student strategies for solving stoichiometry problems involving particulate nature of matter diagramsChemistry Teacher International10.1515/cti-2018-00031:1Online publication date: 28-Feb-2019
https://doi.org/10.1515/cti-2018-0003
Toker DConati CCarenini G(2019)Gaze analysis of user characteristics in magazine style narrative visualizationsUser Modeling and User-Adapted Interaction10.1007/s11257-019-09244-529:5(977-1011)Online publication date: 30-Aug-2019
https://doi.org/10.1007/s11257-019-09244-5
Show More Cited By

Index Terms

Permutation test for groups of scanpaths using normalized Levenshtein distances and application in NMR questions
1. Applied computing
  1. Physical sciences and engineering
    1. Chemistry

Recommendations

A new method for categorizing scanpaths from eye tracking data
ETRA '16: Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications

From the seminal work of Yarbus [1967] on the relationship of eye movements to vision, scanpath analysis has been recognized as a window into the mind. Computationally, characterizing the scanpath, the sequential and spatial dependencies between eye ...
Perceived Text Relevance Estimation Using Scanpaths and GNNs
ICMI '24: Proceedings of the 26th International Conference on Multimodal Interaction

A scanpath is an important concept in eye tracking that represents a person’s eye movements in a graph-like structure. Passive gaze-based interfaces, in which users do not consciously interact using their eyes, typically interpret users’ scanpaths to ...
A Monte Carlo comparison of studentized bootstrap and permutation tests for heteroscedastic two-sample problems

The present Monte Carlo study compares bootstrap and permutation tests for semiparametric heteroscedastic two-sample testing problems of Behrens-Fisher type. The underlying functionals to be tested are (a) the difference of the means and (b) the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2012

420 pages

ISBN:9781450312219

DOI:10.1145/2168556

Conference Chairs:
Carlos H. Morimoto
University of São Paulo, Brazil
,
Howell Istance
Montfort University, UK
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Jeffrey B. Mulligan
NASA
,
Pernilla Qvarfordt
FX Palo Alto

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Undergraduate Education

Conference

ETRA '12

Sponsor:

ETRA '12: Eye Tracking Research and Applications

March 28 - 30, 2012

California, Santa Barbara

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
339
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Akaygun SAdadan E(2021)Investigating the Role of Conceptual Understanding on How Students Watch an Experimental Video Using Eye-TrackingApplying Bio-Measurements Methodologies in Science Education Research10.1007/978-3-030-71535-9_5(93-106)Online publication date: 28-May-2021
https://doi.org/10.1007/978-3-030-71535-9_5
Baluyut JHolme T(2019)Eye tracking student strategies for solving stoichiometry problems involving particulate nature of matter diagramsChemistry Teacher International10.1515/cti-2018-00031:1Online publication date: 28-Feb-2019
https://doi.org/10.1515/cti-2018-0003
Toker DConati CCarenini G(2019)Gaze analysis of user characteristics in magazine style narrative visualizationsUser Modeling and User-Adapted Interaction10.1007/s11257-019-09244-529:5(977-1011)Online publication date: 30-Aug-2019
https://doi.org/10.1007/s11257-019-09244-5
Tang HPienta N(2018)Advanced Methods for Processing and Analyzing Eye-Tracking Data Using REye Tracking for the Chemistry Education Researcher10.1021/bk-2018-1292.ch006(99-117)Online publication date: 19-Sep-2018
https://doi.org/10.1021/bk-2018-1292.ch006
Day ETang HKendhammer LPienta N(2018)Sequence Analysis: Use of Scanpath Patterns for Analysis of Students’ Problem-Solving StrategiesEye Tracking for the Chemistry Education Researcher10.1021/bk-2018-1292.ch005(73-97)Online publication date: 19-Sep-2018
https://doi.org/10.1021/bk-2018-1292.ch005
Cullipher SVandenPlas J(2018)Using Fixations To Measure AttentionEye Tracking for the Chemistry Education Researcher10.1021/bk-2018-1292.ch004(53-72)Online publication date: 19-Sep-2018
https://doi.org/10.1021/bk-2018-1292.ch004
Děchtěrenko FLukavský JHolmqvist K(2016)Flipping the stimulus: Effects on scanpath coherence?Behavior Research Methods10.3758/s13428-016-0708-249:1(382-393)Online publication date: 2-Mar-2016
https://doi.org/10.3758/s13428-016-0708-2
Nisiforou ELaghos A(2015)Field Dependence–Independence and Eye Movement Patterns: Investigating Users’ Differences Through an Eye Tracking StudyInteracting with Computers10.1093/iwc/iwv01528:4(407-420)Online publication date: 16-Jun-2015
https://doi.org/10.1093/iwc/iwv015
Havanki KVandenPlas J(2014)Eye Tracking Methodology for Chemistry Education ResearchTools of Chemistry Education Research10.1021/bk-2014-1166.ch011(191-218)Online publication date: 31-Jul-2014
https://doi.org/10.1021/bk-2014-1166.ch011
Tang HJi P(2014)Using the Statistical Program R Instead of SPSS To Analyze DataTools of Chemistry Education Research10.1021/bk-2014-1166.ch008(135-151)Online publication date: 31-Jul-2014
https://doi.org/10.1021/bk-2014-1166.ch008
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents