Article

Free access

Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations

Authors:

Cathleen Wharton,

Janice Bradford,

Robin Jeffries,

Marita FranzkeAuthors Info & Claims

CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 381 - 388

https://doi.org/10.1145/142750.142864

Published: 01 June 1992 Publication History

Abstract

The Cognitive Walkthrough methodology was developed in an effort to bring cognitive theory closer to practice; to enhance the design and evaluation of use interfaces in industrial settings. For the first time, small teams of professional developers have used this method to critique three complex software systems. In this paper we report evidence about how the methodology worked for these evaluations. We focus on five core issues: (1) task selection, coverage, and evaluation, (2) the process of doing a Cognitive Walkthrough, (3) requisite knowlege for the evaluators, (4) group walkthroughs, and (5) the interpretation of results. Our findings show that many variables can affect the success of the technique; we believe that if the Cognitive Walkthrough is ultimately to be successful in industrial settings, the method must be refined and augmented in a variety of ways.

References

[1]

Card, S.K., Moran, T.R, and Newell, A. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, HiUsdale, NJ, 1983.

Digital Library

[2]

Franzke, M. Evaluation Technique Evaluated: Experience Using the Cognitive Walkthrough. Proc. of the Bellcore/BCC Symposium on User-Centered Design. Livingston, NJ, November 1991.

[3]

Gray, W.D., John, B.E., and Atwood, M.E. The Prtcis of Project Ernestine, or An Overview of a Validation of GOMS. Proc. ACM CHI'92. (Monterey, California, May 3-7, 1992).

Digital Library

[4]

Hammond, K.R. and Adelman, L. Science, Values, and Human Judgement. Science, 1976, Volume 194, pp. 389-396.

[5]

Jefffies, R., Miller, J.R., Wharton, C., and Uyeda, K.M. User Interface Evaluation in the Real World: A Comparison of Four Techniques. Proc. A CM CHI'91. (New Orleans, Louisiana, April 27 - May 2, 1991) pp. 119-124.

Digital Library

[6]

Karat, C., Campbell, R., and Fiegel, T. Comparison of Empirical Testing and Walkthrough Methods in User Interface Evaluation. Proc. A CM CHI'92. (Monterey, California, May 3-7, 1992).

Digital Library

[7]

Lewis, C., and Polson P.G. Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces. Tutorial presented at A CM CHI'91. (New Orleans, Louisiana, April 27-May 2, 1991).

[8]

Lewis, C., Polson, P., Wharton, C., and Rieman, J. Testing a Walkthrough Methodology for Theory-Based Design of Walk- Up-and-Use Interfaces. Proc. ACM CHI'90. (Seattle, Washington, April 1 - 5, 1990) pp. 235-242.

Digital Library

[9]

McGrath, J.E. Groups: Interaction and Performance. Prentice-Hall, Englewood Cliffs, NJ, 1984.

[10]

Neale, M.A. and Bazerman, M.H. Cognition and Rationality in Negotiation. Free Press, New York, NY, 1991.

[11]

Nielsen, J. Finding Usability Problems Through Heuristic Evaluation. Proc. ACM CHI'92. (Monterey, California, May 3-7, 1992).

Digital Library

[12]

Poison, RG., and Lewis, C. Theory-Based Design for Easily Learned Interfaces. Human-Computer Interaction, 1990, Volume 5, pp. 191-220.

[13]

Polson, P., Lewis, C., Rieman, J., and Wharton, C. Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces. To appear in International Journal of Man- Machine Studies, 1992.

Digital Library

[14]

Rowley, D.E., and Rhoades, D.G. The Cognitive Jogthrough: A Pa~t-Pa~ed U~er Interfa~ Evaluation Procedure. Proc. ACM CHI'92. (Monterey, California, May 3-7, 1992).

Digital Library

[15]

Shaw, M.E. Group Dynamics: The Psychology of SmaU Group Behavior. 3rd edition. McGraw-Hill, New York, NY, 1981.

[16]

Wharton, C. Cognitive Walkthroughs: Instructions, Forms, and Examples. Technical Report University of Colorado at Boulder, Institute of Cognitive Science, 1992.

[17]

Yourdon, E. Structured Walkthroughs. 4th edition. Yourdon Press, Englewood Cliffs, NJ, 1989.

Digital Library

Cited By

Reime LTsaknaki VCohn M(2023)Walking Through Normativities of Reproductive Bodies: A Method for Critical Analysis of Tracking ApplicationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581450(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581450
Silva Neto BRodriguez CNeris V(2023)Buttons, Devices, and Adults: How Preschool Children Designed an IoT Programming ToolInteracting with Computers10.1093/iwc/iwad037Online publication date: 13-Jul-2023
https://doi.org/10.1093/iwc/iwad037
Imoukhome EWeeks LAbidi S(2022)Fall Prevention and Management App Prototype for the Elderly and Their CaregiversResearch Anthology on Supporting Healthy Aging in a Digital Society10.4018/978-1-6684-5295-0.ch044(769-789)Online publication date: 4-Feb-2022
https://doi.org/10.4018/978-1-6684-5295-0.ch044
Show More Cited By

Index Terms

Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Cognitive robotics
    2. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. HCI theory, concepts and models
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

The effect of task description detail on evaluator performance with cognitive walkthroughs
CHI '98: CHI 98 Conference Summary on Human Factors in Computing Systems
Design and Evaluation of Intelligent Menu Interface through Cognitive Walkthrough Procedure and Automated Logging for Management Information System
Computer Supported Cooperative Work in Design IV

One of the critcal issues in Managment Information System (MIS) is the information overload from complicated hierachical menu. Novice users easily get lost when an important and frequently used menu item is rooted and hidden in a deeper level of a ...
Experimenting on the cognitive walkthrough with users
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

This paper presents a case study aiming to investigate which variant of the Think-Aloud Protocol (i.e., the Concurrent Think-Aloud and the Retrospective Think-Aloud) better integrates with the Cognitive Walkthrough with Users. To this end we performed a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '92: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

June 1992

713 pages

ISBN:0897915135

DOI:10.1145/142750

Editors:
Penny Bauersfeld
IBM Almaden Research Center, San Jose, CA
,
John Bennett
Tektronix, Inc. Beverton, OR
,
Gene Lynch

Copyright © 1992 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1992

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI92

Sponsor:

SIGCHI

CHI92: Conference on Human Factors in Computing

May 3 - 7, 1992

California, Monterey, USA

Acceptance Rates

CHI '92 Paper Acceptance Rate 67 of 216 submissions, 31%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

85
Total Citations
View Citations
3,759
Total Downloads

Downloads (Last 12 months)240
Downloads (Last 6 weeks)34

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Reime LTsaknaki VCohn M(2023)Walking Through Normativities of Reproductive Bodies: A Method for Critical Analysis of Tracking ApplicationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581450(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581450
Silva Neto BRodriguez CNeris V(2023)Buttons, Devices, and Adults: How Preschool Children Designed an IoT Programming ToolInteracting with Computers10.1093/iwc/iwad037Online publication date: 13-Jul-2023
https://doi.org/10.1093/iwc/iwad037
Imoukhome EWeeks LAbidi S(2022)Fall Prevention and Management App Prototype for the Elderly and Their CaregiversResearch Anthology on Supporting Healthy Aging in a Digital Society10.4018/978-1-6684-5295-0.ch044(769-789)Online publication date: 4-Feb-2022
https://doi.org/10.4018/978-1-6684-5295-0.ch044
Bekiaris ILeonidis AKorozi MStratakis CZidianakis EDoxastaki MStephanidis C(2021)GRETA: Pervasive and AR Interfaces for Controlling Intelligent Greenhouses2021 17th International Conference on Intelligent Environments (IE)10.1109/IE51775.2021.9486584(1-8)Online publication date: Jun-2021
https://doi.org/10.1109/IE51775.2021.9486584
Vu KProctor RHung Y(2021)WEBSITE DESIGN AND EVALUATIONHANDBOOK OF HUMAN FACTORS AND ERGONOMICS10.1002/9781119636113.ch39(1016-1036)Online publication date: 13-Aug-2021
https://doi.org/10.1002/9781119636113.ch39
Imoukhome EWeeks LAbidi S(2020)Fall Prevention and Management App Prototype for the Elderly and Their CaregiversInternational Journal of Extreme Automation and Connectivity in Healthcare10.4018/IJEACH.20200101042:1(48-67)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.4018/IJEACH.2020010104
Remy CMacDonald Vermeulen LFrich JBiskjaer MDalsgaard PWakkary RAndersen KOdom WDesjardins APetersen M(2020)Evaluating Creativity Support Tools in HCI ResearchProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395474(457-476)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395474
Stobert ESafaie TMolyneaux HMannan MYoussef A(2020)ByPass: Reconsidering the Usability of Password ManagersSecurity and Privacy in Communication Networks10.1007/978-3-030-63086-7_24(446-466)Online publication date: 12-Dec-2020
https://doi.org/10.1007/978-3-030-63086-7_24
Sánchez EMacías J(2019)A set of prescribed activities for enhancing requirements engineering in the development of usable e-Government applicationsRequirements Engineering10.1007/s00766-017-0282-x24:2(181-203)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s00766-017-0282-x
Shekhar AMarsden NMarsden NWulf VRode JWeibert A(2018)Cognitive walkthrough of a learning management system with gendered personasProceedings of the 4th Conference on Gender & IT10.1145/3196839.3196869(191-198)Online publication date: 14-May-2018
https://dl.acm.org/doi/10.1145/3196839.3196869
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents