research-article

Analysing mouse activity for cognitive load detection

Authors:

OzCHI '13: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration

Pages 115 - 118

https://doi.org/10.1145/2541016.2541083

Published: 25 November 2013 Publication History

Get Access

Abstract

User interaction and multimodal behaviour have been argued as viable indicators of cognitive load. We extend this idea to explore interactive mouse behaviour for the same. Though mouse dynamics is generally being explored as a biometric technology, we intend to adapt and enhance this usage for detecting pattern changes in user behaviour as cognitive load is varied. The scope of this paper is limited to analysing mouse interaction data generated during a larger multitier experiment (aimed at investigating effects of cognitive load on organisational trust). Mouse events data is from 88 subjects, each of which completed two different tasks (labelled T1 & T3) twice (under randomized order of high and low cognitive load levels). High cognitive load was induced using standard dual-task design. This paper brings forth core issues in mouse activity analysis and focuses on pause/break activity as possible indicator of cognitive load (in the context of performed experiment). Significant differences were found in extracted features from contemplation and hesitation type pause categories and future course of study charted.

References

[1]

Ayres, P., and Paas, F. "Cognitive Load Theory: New Directions and Challenges." Applied Cognitive Psychology 26, no. 6 (2012): 827--832.

Crossref

Google Scholar

[2]

Brunken, R., Plass, J. L., and Leutner, D. "Direct measurement of cognitive load in multimedia learning." Educational Psychologist 38.1 (2003): 53--61.

Crossref

Google Scholar

[3]

Chen, F., Ruiz, N., Choi, E., Epps, J., Khawaja, M. A., Taib, R., Yin, B., & Wang, Y. Multimodal behavior and interaction as indicators of cognitive load. ACM Transactions on Interactive Intelligent Systems (TiiS) 2, no. 4 (2012): 22.

Digital Library

Google Scholar

[4]

Colquitt, J. A., Scott, B. A. and LePine, J. A. "Trust, trustworthiness, and trust propensity: a meta-analytic test of their unique relationships with risk taking and job performance." Journal of Applied Psychology 92.4 (2007): 909.

Crossref

Google Scholar

[5]

Jorgensen, Z., and Yu, Y. "On mouse dynamics as a behavioral biometric for authentication." In Proceedings of the 6th ACM Symposium on Information, Computer and Communications Security, pp. 476--482. ACM, (2011).

Digital Library

Google Scholar

[6]

Kirschner, P. A., Ayres, P. and Chandler, P. "Contemporary cognitive load theory research: The good, the bad and the ugly." Computers in Human Behavior 27, no. 1 (2011): 99--105.

Digital Library

Google Scholar

[7]

Mayer, R. C., Davis, J. H. and Schoorman, F. D. "An integrative model of organizational trust." Academy of management review 20.3 (1995): 709--734.

Crossref

Google Scholar

[8]

Ruiz, N., Taib, R., and Chen, F. 'Examining the redundancy of multimodal input'. In Proceedings of the Annual Conference of the Australian Computer-Human Interaction Special Interest Group (OzCHI 2006).

Digital Library

Google Scholar

[9]

Sweller, J., Ayres, P. and Kalyuga, S. Cognitive load theory. Vol. 1. Springer, 2011.

Google Scholar

[10]

Gog, T., Kirschner, F. Kester, L. and Paas, F. "Timing and frequency of mental effort measurement: Evidence in favour of repeated measures." Applied Cognitive Psychology 26, no. 6 (2012): 833--839.

Crossref

Google Scholar

[11]

Yin, B. & Chen, F. Towards automatic cognitive load measurement from speech analysis. In Human-Computer Interaction, Interaction Design and Usability, J. Jacko, Ed. Springer, 1011--1020 (2007).

Digital Library

Google Scholar

[12]

Yu, K., Epps, J., & Chen, F. (2011a) Cognitive load evaluation of handwriting using stroke-level features. In Proceedings of the International Conference on Intelligent User Interfaces (IUI'11).

Digital Library

Google Scholar

[13]

Yu, K., Epps, J., & Chen, F. (2011b) Cognitive load evaluation with pen orientation and pressure. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST'11).

Google Scholar

Cited By

View all

Schneegass CWilson MShaban JNiess JChiossi FMitrevska TWoźniak P(2024)Broadening the mind: how emerging neurotechnology is reshaping HCI and interactive system designi-com10.1515/icom-2024-000723:2(165-177)Online publication date: 23-May-2024
https://doi.org/10.1515/icom-2024-0007
Braarud P(2024)Measuring cognitive workload in the nuclear control room: a reviewErgonomics10.1080/00140139.2024.230238167:6(849-865)Online publication date: 26-Jan-2024
https://doi.org/10.1080/00140139.2024.2302381
Alt FHassib MDistler V(2023)Human-centered Behavioral and Physiological SecurityProceedings of the 2023 New Security Paradigms Workshop10.1145/3633500.3633504(48-61)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3633500.3633504
Show More Cited By

Index Terms

Analysing mouse activity for cognitive load detection
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Interactive Mouse Stream as Real-Time Indicator of User's Cognitive Load
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

User interaction and multimodal behavior have been argued as viable indicators of cognitive load. We extend this idea by exploring interactive mouse data stream and implementing sliding windows technique to detect cognitive load variation in real-time. ...
Analysing mouse and pen flick gestures
CHINZ '02: Proceedings of the SIGCHI-NZ Symposium on Computer-Human Interaction

Gesture based interfaces promise to increase the efficiency of user input, particularly in mobile computing where standard input devices such as the mouse and keyboard are impractical. This paper describes an investigation into the low-level physical ...
Mouse 2.0: multi-touch meets the mouse
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

In this paper we present novel input devices that combine the standard capabilities of a computer mouse with multi-touch sensing. Our goal is to enrich traditional pointer-based desktop interactions with touch and gestures. To chart the design space, we ...

Comments

Information & Contributors

Information

Published In

OzCHI '13: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration

November 2013

549 pages

ISBN:9781450325257

DOI:10.1145/2541016

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Air Force Office of Scientific Research

Conference

OzCHI '13

Sponsor:

Human Factors & Ergonomics Soc

OzCHI '13: Augmentation, Application, Innovation, Collaboration

November 25 - 29, 2013

Adelaide, Australia

Acceptance Rates

OzCHI '13 Paper Acceptance Rate 34 of 70 submissions, 49%;

Overall Acceptance Rate 362 of 729 submissions, 50%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
316
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)4

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Schneegass CWilson MShaban JNiess JChiossi FMitrevska TWoźniak P(2024)Broadening the mind: how emerging neurotechnology is reshaping HCI and interactive system designi-com10.1515/icom-2024-000723:2(165-177)Online publication date: 23-May-2024
https://doi.org/10.1515/icom-2024-0007
Braarud P(2024)Measuring cognitive workload in the nuclear control room: a reviewErgonomics10.1080/00140139.2024.230238167:6(849-865)Online publication date: 26-Jan-2024
https://doi.org/10.1080/00140139.2024.2302381
Alt FHassib MDistler V(2023)Human-centered Behavioral and Physiological SecurityProceedings of the 2023 New Security Paradigms Workshop10.1145/3633500.3633504(48-61)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3633500.3633504
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Oppelt MFoltyn ADeuschel JLang NHolzer NEskofier BYang S(2022)ADABase: A Multimodal Dataset for Cognitive Load EstimationSensors10.3390/s2301034023:1(340)Online publication date: 28-Dec-2022
https://doi.org/10.3390/s23010340
Muke PTelec ZTrawiński B(2022)Multimodal Approach to Measuring Cognitive Load Using Sternberg Memory and Input Diagrammatic Reasoning TestsIntelligent Information and Database Systems10.1007/978-3-031-21967-2_56(693-713)Online publication date: 9-Dec-2022
https://doi.org/10.1007/978-3-031-21967-2_56
Herbig NDüwel THelali MEckhart LSchuck PChoudhury SKrüger A(2020)Investigating Multi-Modal Measures for Cognitive Load Detection in E-LearningProceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3340631.3394861(88-97)Online publication date: 7-Jul-2020
https://dl.acm.org/doi/10.1145/3340631.3394861
Van Acker BParmentier DConradie PVan Hove SBiondi ABombeke KVlerick PSaldien J(2020)Development and validation of a behavioral video coding scheme for detecting mental workload in manual assemblyErgonomics10.1080/00140139.2020.1811400(1-55)Online publication date: 19-Aug-2020
https://doi.org/10.1080/00140139.2020.1811400
Herbig NPal SVela MKrüger AGenabith J(2019)Multi-modal indicators for estimating perceived cognitive load in post-editing of machine translationMachine Translation10.1007/s10590-019-09227-833:1-2(91-115)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s10590-019-09227-8
Zhou JYu KChen FWang YArshad S(2018)Multimodal behavioral and physiological signals as indicators of cognitive loadThe Handbook of Multimodal-Multisensor Interfaces10.1145/3107990.3108002(287-329)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1145/3107990.3108002
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Interactive Mouse Stream as Real-Time Indicator of User's Cognitive Load

Analysing mouse and pen flick gestures

Mouse 2.0: multi-touch meets the mouse