research-article

Usability studies and the Hawthorne effect

Author:

Ritch MacefieldAuthors Info & Claims

Journal of Usability Studies, Volume 2, Issue 3

Pages 145 - 154

Published: 01 May 2007 Publication History

Get Access

Abstract

This paper provides a brief review of the Hawthorne effect, a discussion of how this effect relates to usability studies, and help for practitioners in defending their studies against criticisms made on the basis of this effect.

References

[1]

Adair, G. (1984). The Hawthorne effect: A reconsideration of the methodological artifact. Journal of Applied Psychology, 69(2), 334--5.

Google Scholar

[2]

Carey, A. (1967). The Hawthorne Studies: A radical criticism. American Sociological Review, 32, 403--16.

Google Scholar

[3]

CIF v2.02 (2002). Common Industry Format for usability test reports. Retrieved June 22, 2002, from http://zing.ncsl.nist.gov/iusr/overview.html.

Google Scholar

[4]

Draper, S. (2006). The Hawthorne, Pygmalion, placebo and other effects of expectation: some notes. Retrieved January 1, 2007, from http://www.psy.gla.ac.uk/~steve/hawth.html.

Google Scholar

[5]

Gillespie, R. (1991). Manufacturing knowledge: a history of the Hawthorne experiments. Cambridge: Cambridge University Press.

Google Scholar

[6]

International Standards Organization (1998). Definition: 9241-11:1998. Retrieved April 27, 2002, from http://www.iso.ch.

Google Scholar

[7]

Johnson-Laird, P. N. (1983). Mental models. Cambridge: Cambridge University Press.

Google Scholar

[8]

Khan Research Group (2000). Validity 101 -- What it is, why it is essential, where others fail, and how we succeed. Retrieved January 18, 2007, from http://www.webehavior.com/validity101.htm.

Google Scholar

[9]

Kolata, G. (1998). Scientific Myths That Are Too Good to Die. New York Times. Retrieved January 18, 2007, from http://www.nytimes.com/library/review/120698science-myths-review.html.

Google Scholar

[10]

Mayo, E. (1933). The human problems of an industrial civilization. New York: MacMillan.

Google Scholar

[11]

Norman, D. A. (1983). Some observations on mental models. In: Gentner, D. & Stevens, A., L. Mental Models. London: Erlbaum.

Google Scholar

[12]

Norman, D. A. (1988). The psychology of everyday things. New York: Basic Books.

Google Scholar

[13]

Parsons, H. M. (1974). What happened at Hawthorne? Science, 183(4128), 922--32.

Google Scholar

[14]

Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S. & Carey, T. (1994). Human-computer interaction. Wokingham: Addison Wesley.

Crossref

Google Scholar

[15]

Raskin, J. (1994). Intuitive equals familiar. Communications of the ACM, 37(9), 17.

Crossref

Google Scholar

[16]

Rice, B. (1982). The Hawthorne defect: Persistence of a flawed theory. Psychology Today, 16(2), 70--4.

Google Scholar

[17]

Sasse, M. A. (1997). Eliciting and Describing Users' Models of Computer Systems. PhD Thesis. Birmingham University, UK.

Google Scholar

[18]

Snow, C. E. (1927). Research on industrial illumination: A discussion of the relation of illumination intensity to productive efficiency. The Tech Engineering News, 257--82.

Google Scholar

[19]

Sonnenfeld, J. (1983) Commentary: Academic Learning, Worker Learning, and the Hawthorne Studies, Social Forces, 61(3), 904--9.

Google Scholar

Cited By

View all

Mast DBroekens Jde Vries SVerbeek F(2023)Participation Patterns of Interactive Playful Museum Exhibits: Evaluating the Participant Journey Map through Situated ObservationsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595985(1861-1885)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595985
Carrera DLee SMaiden NSas C(2022)Watch Me Write: Exploring the Effects of Revealing Creative Writing Process through Writing ReplayProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3532806(146-160)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3532806
Carter ABailey GPearson JJones MRobinson SRaju DWinter SHicks J(2022)Designing and Embedding a Tangible Public Interface in the COVID EraExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503556(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503556
Show More Cited By

Index Terms

Usability studies and the Hawthorne effect
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Mitigating the "Hawthorne effect" in simulation studies
WSC '13: Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World

Though little research has been published on the influence of the Hawthorne effect in simulation studies, it is an inescapable phenomenon that can have a dramatic impact on both data gathering and model validation. This paper examines the potential ...
The Hawthorne effect in journal peer review

Purpose--this paper aims to look at the Hawthorne effect in editorial peer review. Design/methodology/approach--discusses the quality evaluation of refereed scholarly journals. Findings--a key finding of this research was that in the peer review process ...
A Data-Driven Study on the Hawthorne Effect in Sensor-Based Human Activity Recognition
UbiComp/ISWC '23 Adjunct: Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing

Known as the Hawthorne Effect, studies have shown that participants alter their behavior and execution of activities in response to being observed. With researchers from a multitude of human-centered studies knowing of the existence of the said effect, ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Usability Studies

Journal of Usability Studies Volume 2, Issue 3

May 2007

53 pages

Issue’s Table of Contents

Publisher

Usability Professionals' Association

Bloomingdale, IL

Publication History

Published: 01 May 2007

Published in JUS Volume 2, Issue 3

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
313
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mast DBroekens Jde Vries SVerbeek F(2023)Participation Patterns of Interactive Playful Museum Exhibits: Evaluating the Participant Journey Map through Situated ObservationsProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595985(1861-1885)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595985
Carrera DLee SMaiden NSas C(2022)Watch Me Write: Exploring the Effects of Revealing Creative Writing Process through Writing ReplayProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3532806(146-160)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3532806
Carter ABailey GPearson JJones MRobinson SRaju DWinter SHicks J(2022)Designing and Embedding a Tangible Public Interface in the COVID EraExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503556(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503556
Han YKim HChu HKim JLee HChoe SJung DChung DKwon BKo S(2021)Wait, Let’s Think about Your Purchase Again: A Study on Interventions for Supporting Self-Controlled Online PurchasesProceedings of the Web Conference 202110.1145/3442381.3450021(2476-2487)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3442381.3450021
Kulshreshtha SArif A(2020)Woodpecker: Secret Back-of-Device Tap Rhythms to Authenticate Mobile Users2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC42975.2020.9283239(2727-2733)Online publication date: 11-Oct-2020
https://dl.acm.org/doi/10.1109/SMC42975.2020.9283239
Dahlinger AWortmann FRyder BGahr BMandryk RHancock MPerry MCox A(2018)The Impact of Abstract vs. Concrete Feedback Design on Behavior Insights from a Large Eco-Driving Field ExperimentProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173953(1-11)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173953
Drew MFalcone BBaccus W(2018)What Does the System Usability Scale (SUS) Measure?Design, User Experience, and Usability: Theory and Practice10.1007/978-3-319-91797-9_25(356-366)Online publication date: 15-Jul-2018
https://dl.acm.org/doi/10.1007/978-3-319-91797-9_25
Cross EGosha KEugene WArcediano FHamilton CHundley J(2008)Game design from the lens of a studentProceedings of the 46th annual ACM Southeast Conference10.1145/1593105.1593170(247-252)Online publication date: 28-Mar-2008
https://dl.acm.org/doi/10.1145/1593105.1593170

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Mitigating the "Hawthorne effect" in simulation studies

The Hawthorne effect in journal peer review

A Data-Driven Study on the Hawthorne Effect in Sensor-Based Human Activity Recognition

Comments

Published In

Publisher

Publication History

Author Tags

Qualifiers

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Mitigating the "Hawthorne effect" in simulation studies

The Hawthorne effect in journal peer review

A Data-Driven Study on the Hawthorne Effect in Sensor-Based Human Activity Recognition

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations