research-article

Easing the generation of predictive human performance models from legacy systems

Authors:

Amanda Swearngin,

Rachel BellamyAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2489 - 2498

https://doi.org/10.1145/2207676.2208415

Published: 05 May 2012 Publication History

Abstract

With the rise of tools for predictive human performance modeling in HCI comes a need to model legacy applications. Models of legacy systems are used to compare products to competitors, or new proposed design ideas to the existing version of an application. We present CogTool-Helper, an exemplar of a tool that results from joining this HCI need to research in automatic GUI testing from the Software Engineering testing community. CogTool-Helper uses automatic UI-model extraction and test case generation to automatically create CogTool storyboards and models and infer methods to accomplish tasks beyond what the UI designer has specified. A design walkthrough with experienced CogTool users reveal that CogTool-Helper resonates with a "pain point" of real-world modeling and provide suggestions for future work.

References

[1]

Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. (2004) An integrated theory of the mind. Psychological Review 111, 4, 1036--1060.

[2]

Bellamy, R., John, B. E., Kogan, S. (2011) Deploying CogTool: Integrating quantitative usability assessment into real-world software development. Proceeding of the 33rd International Conference on Software Engineering (ICSE '11). ACM, New York, NY, USA, 691--700.

Digital Library

[3]

Card, S. K., Moran, T. P., and Newell, A. 1983. The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.

Digital Library

[4]

Chang, T., Yeh, T., and Miller, R. C. (2010) GUI testing using computer vision, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1535--1544.

Digital Library

[5]

Gray, W. D., John, B. E., & Atwood, M. E. (1993) Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-Computer Interaction, 8, 237--309.

Digital Library

[6]

Grechanik, M. Xie, Q. and Fu C. (2009) Creating GUI testing tools using accessibility technologies, Software Testing Verification and Validation Workshop, 243--250.

Digital Library

[7]

John, B. E., Prevas, K., Salvucci, D. D., and Koedinger, K. 2004. Predictive human performance modeling made easy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 455--462.

Digital Library

[8]

Kieras, D. E. (1999). A Guide to GOMS Model Usability Evaluation using GOMSL and GLEAN3. University of Michigan. Available at: ftp://www.eecs.umich.edu/people/kieras/GOMS/GOMSL_Guide.pdf

[9]

Knight, A., Pyrzak, G., and Green, C. 2007. When two methods are better than one: combining user study with cognitive modeling. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1783--1788.

Digital Library

[10]

Memon, A. M. (2002), GUI testing: pitfalls and process, IEEE Computer, 35(8), 87--88.

Digital Library

[11]

Memon, A. M. (2011) GUITAR- A GUI testing framework, available at: http://guitar.sourceforge.net.

[12]

Memon, A. M. (2011) TerpOffice, available at: http://www.cs.umd.edu/~atif/TerpOffice/

[13]

Memon, A. M., Banerjee, I and Nagarajan, A. (2003) GUI Ripping: Reverse engineering of graphical user interfaces for testing, In Proceedings of The 10th Working Conference on Reverse Engineering, 260--269.

Digital Library

[14]

Memon, A. M., Pollack, M. E. and Soffa, M. L. (2001) Hierarchical GUI test case generation using automated planning, IEEE Transactions on Software Engineering, 27(2), 144--155.

Digital Library

[15]

Monkiewicz, J. (1992). CAD's next-generation user interface. Computer-Aided Engineering, November, 1992, 55--56.

[16]

Pirolli, P. and Card, S. K. (1999). Information foraging. Psychological Review, 106, 643--675.

[17]

St. Amant, R., and Riedl, M. O. (2001). A perception/action substrate for cognitive modeling in HCI. International Journal of Human-Computer Studies 55(1), 15--39.

Digital Library

[18]

Teo, L., John, B. E., and Blackmon, M. H. (2012) CogTool-Explorer: A Model of Goal-Directed User Exploration that Considers Information Layout. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA.

Digital Library

[19]

White L. and Almezen, H. (2000). Generating test cases for GUI responsibilities using complete interaction sequences, in International Symposium on Software Reliability Engineering (ISSRE), 110--121.

Digital Library

[20]

Yuan, X. and Memon. A. M. (2010). Generating event sequence-based test cases using GUI runtime state feedback. IEEE Transactions on Software Engineering, 36(1), 81--95.

Digital Library

Cited By

Yuan HLi SRusconi P(2021)CogTool+ACM Transactions on Computer-Human Interaction10.1145/344753428:2(1-38)Online publication date: 17-Apr-2021
https://dl.acm.org/doi/10.1145/3447534
Yuan HLi SRusconi PYuan HLi SRusconi P(2020)Review of Cognitive Modeling Software ToolsCognitive Modeling for Automated Human Performance Evaluation at Scale10.1007/978-3-030-45704-4_3(17-26)Online publication date: 17-Sep-2020
https://doi.org/10.1007/978-3-030-45704-4_3
Saddler JCohen MVos TEldh SPrasetya W(2016)EventFlowSlicer: goal based test generation for graphical user interfacesProceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation10.1145/2994291.2994293(8-15)Online publication date: 18-Nov-2016
https://dl.acm.org/doi/10.1145/2994291.2994293
Show More Cited By

Index Terms

Easing the generation of predictive human performance models from legacy systems
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Predictive human performance modeling made easy
CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Although engineering models of user behavior have enjoyed a rich history in HCI, they have yet to have a widespread impact due to the complexities of the modeling process. In this paper we describe a development system in which designers generate ...
Experiences with collaborative, distributed predictive human performance modeling
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Although predictive human performance modeling has been researched for 30 years in HCI, to our knowledge modeling has been conducted as a solitary task of one modeler or, occasionally, two modelers working in tight face-to-face collaboration. In ...
Automatic Android GUI Traversal with High Coverage
CSNT '14: Proceedings of the 2014 Fourth International Conference on Communication Systems and Network Technologies

Android apps are usually rich in GUIs and users interact with the GUIs to use the functions provided by an app. To make Android apps reliable, GUI testing is an effective method. Automation and high GUI coverage is necessary in the testing for the sake ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
375
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yuan HLi SRusconi P(2021)CogTool+ACM Transactions on Computer-Human Interaction10.1145/344753428:2(1-38)Online publication date: 17-Apr-2021
https://dl.acm.org/doi/10.1145/3447534
Yuan HLi SRusconi PYuan HLi SRusconi P(2020)Review of Cognitive Modeling Software ToolsCognitive Modeling for Automated Human Performance Evaluation at Scale10.1007/978-3-030-45704-4_3(17-26)Online publication date: 17-Sep-2020
https://doi.org/10.1007/978-3-030-45704-4_3
Saddler JCohen MVos TEldh SPrasetya W(2016)EventFlowSlicer: goal based test generation for graphical user interfacesProceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation10.1145/2994291.2994293(8-15)Online publication date: 18-Nov-2016
https://dl.acm.org/doi/10.1145/2994291.2994293
Memon ACohen MNotkin DCheng BPohl K(2013)Automated testing of GUI applications: models, tools, and controlling flakinessProceedings of the 2013 International Conference on Software Engineering10.5555/2486788.2487046(1479-1480)Online publication date: 18-May-2013
https://dl.acm.org/doi/10.5555/2486788.2487046
Swearngin ACohen MJohn BBellamy RNotkin DCheng BPohl K(2013)Human performance regression testingProceedings of the 2013 International Conference on Software Engineering10.5555/2486788.2486809(152-161)Online publication date: 18-May-2013
https://dl.acm.org/doi/10.5555/2486788.2486809
Memon ABanerjee INguyen BRobbins B(2013)The first decade of GUI ripping: Extensions, applications, and broader impacts2013 20th Working Conference on Reverse Engineering (WCRE)10.1109/WCRE.2013.6671275(11-20)Online publication date: Oct-2013
https://doi.org/10.1109/WCRE.2013.6671275
Memon ACohen M(2013)Automated testing of GUI applications: Models, tools, and controlling flakiness2013 35th International Conference on Software Engineering (ICSE)10.1109/ICSE.2013.6606750(1479-1480)Online publication date: May-2013
https://doi.org/10.1109/ICSE.2013.6606750
Swearngin ACohen MJohn BBellamy R(2013)Human performance regression testing2013 35th International Conference on Software Engineering (ICSE)10.1109/ICSE.2013.6606561(152-161)Online publication date: May-2013
https://doi.org/10.1109/ICSE.2013.6606561
Patton EGra WJohn B(2012)Automated CPM-GOMS Modeling from Human DataProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131256121056:1(1005-1009)Online publication date: 1-Sep-2012
https://doi.org/10.1177/1071181312561210
John BPatton EGray WMorrison D(2012)Tools for Predicting the Duration and Variability of SkilledProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131256120656:1(985-989)Online publication date: 1-Sep-2012
https://doi.org/10.1177/1071181312561206

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents