Article

Usability over time

Authors:

Valerie Mendoza,

David G. NovickAuthors Info & Claims

SIGDOC '05: Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information

Pages 151 - 158

https://doi.org/10.1145/1085313.1085348

Published: 21 September 2005 Publication History

Abstract

Testing of usability could perhaps be more accurately described as testing of learnability. We know more about the problems of novice users than we know of the problems of experienced users. To understand how these problems differ, and to understand how usability problems change as users change from novice to experienced, we conducted a longitudinal study of usability among middle-school teachers creating Web sites. The study looked at the use both the use of documentation and the underlying software, tracking the causes and extent of user frustration over eight weeks. We validated a categorization scheme for frustration episodes. We found that over the eight weeks the level of frustration dropped, the distribution of causes of frustration changed, and the users' responses to frustration episodes changed. These results suggest that the sorts of errors that are most prominently featured in conventional usability testing are likely of little consequence over longer periods of time.

References

[1]

Baecker, R., Booth, K., Jovicic, S., McGrenere, J. and Moore, G. (2000). Reducing the gap between what users know and what they need to know. Proceedings of the ACM 2000 International Conference on Intelligent User Interfaces, 17--23.

Digital Library

[2]

Bessiere, K., Ceaparu, I., Lazar, J., Robinson, J., and Shneiderman, B. (2003). Social and psychological influences on computer user frustration, CS Technical Report 4410, Department of Computer Science. University of Maryland.

[3]

Borella, M.S., Sears, A., and Jacko, J.A. (1997, November). The Effects of internet latency on user perception of information content. Proceedings of IEEE Global Telecommunications Conferences, 1932--1936.

[4]

Carletta, J. Assessing agreement on classification tasks: the kappa statistic. Computational Linguistics, 22(2) (1996), 249--254.

Digital Library

[5]

Carlsson, M., Lofstom, L., and Ahlfeldt, H. (2001). Classification of procedures in the domain of thoracic surgery-A study of reliability in coding. Journal of Medical Systems, 25(1).

Digital Library

[6]

Carroll, J., and Carrithers, C. (1984). Training wheels in a user interface. Communications of the ACM, 27(8), 800--806.

Digital Library

[7]

Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., and Shneiderman, B. (2004). Determining causes and severity of end-user frustration, International Journal of Human-Computer Interaction, 17(3), 333--356.

[8]

Cook R., Kay, J., Ryan, G., and Thomas, R. (1995). A toolkit for appraising the long term usability of a text editor. Software Quality Journal, 4(2), 131--154.

[9]

Hazlett, R. (2003). Measurement of user frustration: a biologic approach. Conference on Human Factors in Computing Systems (CHI 2003), 734--735.

Digital Library

[10]

Hilbert, D. (1998). A survey of computer-aided techniques for extracting usability information from user interface events, Technical Report UCI-ICS-98-13, Department of Information and Computer Science, University of California at Irvine, March, 1998.

[11]

Lazar, J. & Huang, Y. (2003). Improved error message design in Web browsers. In J. Ratner (ed.). Human Factors and Web Development (2nd ed.), 167--182. Mahwah, NJ: Lawrence Erlbaum Associates.

[12]

Lazar J., Meiselwitz, G., and Norcio, A. (2003). Novice user perception of error on the Web. Universal Access in the Information Society, 3(3), 202--208.

Digital Library

[13]

Lazar, J., and Norcio, A. (2000). System and training design for end-user error. In S. Clarke & B. Lehaney (Eds.), Human-Centered Methods in Information Systems: Current Research and Practice. Hershey, PA: Idea Group Publishing, 76--90.

[14]

Mentis, H. M. & Gay, G. K. (2003). User recalled occurrences of usability errors: Implications on the user experience. Extended Abstracts of the Conference on Human Factors in Computing Systems, Ft. Lauderdale, Fl, 736--737.

Digital Library

[15]

Norman, D. (1983). Design rules based on analyses of human error. Communications of the ACM, 26(4), 254--258.

Digital Library

[16]

Novick, D. (2000). Testing documentation with "low-tech" simulation, Proceedings of IPCC/SIGDOC 2000, Cambridge, MA, September, 2000.

Digital Library

[17]

Reason, J. (1990) Human Error. Cambridge: University Press, Cambridge.

[18]

Schleifer, L., and Amick, B. (1989). System response time and method of pay: Stress effects in computer-based tasks, International Journal of Human Computer Interaction, 1(1): 23--39.

[19]

Shneiderman, B. (1998). Designing the user interface: Strategies for effective human-computer interaction. 3d ed. Reading, MA: Addison-Wesley.

Digital Library

[20]

Shneiderman, B. (2000). Universal usability: Pushing human-computer interaction research to empower every citizen. Communications of the ACM, 43, 5, p.84--91.

Digital Library

[21]

Snoddy, S., and Novick, D. (2004). Post-training support for learning technology, Proceedings of SIGDOC 2004, Memphis, TN, October 10-13, 2004.

Digital Library

Cited By

Meinhardt LRück MZähnle JElhaidary MColley MRietzler MRukzio E(2024)Hey, What's Going On?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596188:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659618
Yuhui WYiyang ZYanying C(2024)Using animation to develop a usability questionnaireInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103258187:COnline publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103258
Alder GTaylor DRashid UOlsen SBrooks TTerry GNiazi ISignal N(2023)A Brain Computer Interface Neuromodulatory Device for Stroke Rehabilitation: Iterative User-Centered Design ApproachJMIR Rehabilitation and Assistive Technologies10.2196/4970210(e49702)Online publication date: 11-Dec-2023
https://doi.org/10.2196/49702
Show More Cited By

Index Terms

Usability over time
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Evaluating Usability of IFML Models: How Usability is Perceived and Propagated
IHC '18: Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems

System acceptance is strongly related to its usability. It is important that the usability is carefully designed during the system design steps and later propagated to the interface. This care avoids reworking the interface design of an application in ...
Usability Testing of an Interactive Online Movie Download Service: A HCI Study

The Human-Computer Interaction HCI is gaining momentum as more and more people increasingly are using technology tools and devises for their daily activities. Users expect highly effective and easy-to-learn interfaces and developers and designers now ...
Current practice in measuring usability: Challenges to usability studies and research

How to measure usability is an important question in HCI research and user interface evaluation. We review current practice in measuring usability by categorizing and discussing usability measures from 180 studies published in core HCI journals and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGDOC '05: Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information

September 2005

176 pages

ISBN:1595931759

DOI:10.1145/1085313

General Chair:
Scott Tilley
Florida Institute of Technology, USA
,
Program Chair:
Robert M. Newman
Coventry University, UK

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGDOC05

Sponsor:

SIGDOC05: ACM 23rd Annual International Conference on Documentation

September 21 - 23, 2005

Coventry, United Kingdom

Acceptance Rates

Overall Acceptance Rate 355 of 582 submissions, 61%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

61
Total Citations
View Citations
1,407
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)7

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Meinhardt LRück MZähnle JElhaidary MColley MRietzler MRukzio E(2024)Hey, What's Going On?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596188:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659618
Yuhui WYiyang ZYanying C(2024)Using animation to develop a usability questionnaireInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103258187:COnline publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103258
Alder GTaylor DRashid UOlsen SBrooks TTerry GNiazi ISignal N(2023)A Brain Computer Interface Neuromodulatory Device for Stroke Rehabilitation: Iterative User-Centered Design ApproachJMIR Rehabilitation and Assistive Technologies10.2196/4970210(e49702)Online publication date: 11-Dec-2023
https://doi.org/10.2196/49702
Hertzum MHornbæk K(2023)Frustration: Still a Common User ExperienceACM Transactions on Computer-Human Interaction10.1145/358243230:3(1-26)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582432
Maddalon LMinissi MCervera-Torres SHervás AGómez-García SAlcañiz M(2023)Multimodal Interaction in ASD Children: A Usability Study of a Portable Hybrid VR SystemUniversal Access in Human-Computer Interaction10.1007/978-3-031-35681-0_40(614-624)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35681-0_40
Kujala SMiron-Shatz TJokinen J(2022)The cross-sequential approachJournal of Usability Studies10.5555/3532689.353269314:2(105-116)Online publication date: 18-Apr-2022
https://dl.acm.org/doi/10.5555/3532689.3532693
Bavay MReisecker MEgger TKorhammer D(2022)Inishell 2.0: semantically driven automatic GUI generation for scientific modelsGeoscientific Model Development10.5194/gmd-15-365-202215:2(365-378)Online publication date: 18-Jan-2022
https://doi.org/10.5194/gmd-15-365-2022
Neumayr TAugstein MKubicek B(2022)Territoriality in Hybrid CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/35552246:CSCW2(1-37)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555224
Mkpojiogu EOkeke-Uzodike OEze CEmmanuel E(2022)A Conceptual UX Model for the Design and Evaluation of Interactive Digital Artifacts over Time2022 Conference on Information Communications Technology and Society (ICTAS)10.1109/ICTAS53252.2022.9744658(1-6)Online publication date: Mar-2022
https://doi.org/10.1109/ICTAS53252.2022.9744658
Wang YZhang YChen Y(2022)A Longitudinal Study of Children’s Perceived Usability: Methodology and MeasurementsInternational Journal of Human–Computer Interaction10.1080/10447318.2022.210006539:18(3604-3619)Online publication date: 31-Jul-2022
https://doi.org/10.1080/10447318.2022.2100065
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents