Behavior

The Hawthorne effect: the most-cited finding that probably didn't happen

The 1920s Hawthorne studies are cited in every research methods textbook as the source of 'observed people behave differently.' The original data, re-examined, doesn't support the canonical claim.

James Okonkwo
Contributing Editor, Tessera. PhD, Behavioral Economics, LSE
4 min read

The Hawthorne studies are taught in every undergraduate research methods class as the source of the Hawthorne effect — the supposed finding that people perform better when they know they're being observed. The studies took place at the Western Electric Hawthorne Works plant outside Chicago between 1924 and 1932. Researchers varied lighting levels, work hours, breaks, and other conditions and found that worker productivity rose regardless of what they changed.

The conclusion that entered the textbooks: workers worked harder because they were being studied. The conclusion that entered the literature is poorly supported by the actual data.

1. What the records actually show

When economists Steven Levitt and John List obtained the original Hawthorne dataset and re-analyzed it in 2011, they found something different. The productivity gains attributed to the "Hawthorne effect" were not actually present in the data in the form the textbook claims.

The original analysis had been done on small subsets of workers (often 5-6 employees) and had compared productivity across days where many variables changed simultaneously. When productivity is plotted properly against the documented experimental conditions, much of the apparent "increase in response to observation" disappears (Levitt & List, 2011).

Other effects — natural learning curves, selection of workers, seasonal variation in output — explain most of what was attributed to the observer effect.

2. The original interpretation

The canonical interpretation comes from Elton Mayo's writings in the 1930s and 1940s, building a Human Relations Management movement on the Hawthorne findings. Mayo's account of the studies emphasized worker psychology and the importance of being attended to. The findings became the empirical foundation for a generation of management theory.

What's now clear: Mayo's interpretive frame ran well ahead of the actual data. The studies were not designed to test the hypothesis Mayo ended up using them to support. The narrative was constructed retrospectively.

3. The cited phenomenon does exist (sometimes)

This doesn't mean the broader phenomenon — that being observed can change behavior — is fake. There is real evidence for observer effects in some contexts. Studies of hand-washing among healthcare workers, of police behavior during evaluation periods, of student behavior in classrooms — all show modest changes when observation is salient.

But the effect sizes are smaller than the Hawthorne story implies, and they don't replicate consistently across contexts. The McCambridge et al. 2014 systematic review of "Hawthorne effects" across 19 studies found mixed results, with most studies showing no significant effect (McCambridge et al., 2014).

4. Why the myth persists

The Hawthorne story is a useful pedagogical narrative. It teaches researchers to consider whether their measurements affect what they measure — a real and important methodological point. The narrative makes the point memorably. The fact that the studies themselves don't quite demonstrate it has been less important than the lesson the story teaches.

This is common in scientific folklore. Stories that illustrate true principles survive longer than the original data that may not quite support them.

5. The careful version

The honest version of the methodological lesson is real and worth keeping. Observation can change behavior. Researchers should consider this. Pre-registration, blinded protocols, and unobtrusive measurement help.

But the empirical Hawthorne effect — that workers at the plant worked harder because they were being studied — is much weaker in the actual data than in the textbook version. The story has been more useful than the science.

This is a smaller distinction than the broader pattern. Many widely-cited social-science findings have similar histories: useful folk stories built on weaker empirical foundations than the citations imply.

References
  1. Levitt, S. D., & List, J. A. (2011). Was there really a Hawthorne effect at the Hawthorne plant? American Economic Journal: Applied Economics, 3(1), 224-238.
  2. McCambridge, J., Witton, J., & Elbourne, D. R. (2014). Systematic review of the Hawthorne effect. Journal of Clinical Epidemiology, 67(3), 267-277.
  3. Mayo, E. (1933). The Human Problems of an Industrial Civilization. Macmillan.