The McNamara fallacy (also known as the quantitative fallacy),[1] named for Robert McNamara, the US Secretary of Defense from 1961 to 1968, involves making a decision based solely on quantitative observations (or metrics) and ignoring all others. The reason given is often that these other observations cannot be proven.
But when the McNamara discipline is applied too literally, the first step is to measure whatever can be easily measured. The second step is to disregard that which can't easily be measured or given a quantitative value. The third step is to presume that what can't be measured easily really isn't important. The fo[u]rth step is to say that what can't be easily measured really doesn't exist. This is suicide.
— Daniel Yankelovich, "Interpreting the New Life Styles", Sales Management (1971)[2]
The quote originally referred to McNamara's ideology during the two months that he was president of Ford Motor Company, but has since been interpreted to refer to his attitudes during the Vietnam War.
Examples in warfare
editVietnam War
editThe McNamara fallacy is often considered in the context of the Vietnam War, in which enemy body counts were taken to be a precise and objective measure of success. War was reduced to a mathematical model: By increasing estimated enemy deaths and minimizing one's own, victory was assured. Critics[who?] noted that guerrilla warfare, widespread resistance, and inevitable inaccuracies in estimates of enemy casualties can thwart this formula.[3] McNamara's interest in quantitative figures is seen in Project 100,000: by lowering admission standards to the military, enlistment was increased. Key to this decision was the idea that one soldier is, in the abstract, more or less equal to another, and that with the right training and superior equipment, he would factor positively in the mathematics of warfare.
US Air Force Brigadier General Edward Lansdale reportedly told McNamara,[4][page needed] who was trying to develop a list of metrics to allow him to scientifically follow the progress of the war, that he was not considering the feelings of the common rural Vietnamese people. McNamara wrote it down on his list in pencil, then erased it and told Lansdale that he could not measure it, so it must not be important.
Global war on terror
editDonald Rumsfeld, US Secretary of Defense under George W. Bush, sought to prosecute wars with better data, clear objectives, and achievable goals. Writes Jon Krakauer:
... the sense of urgency attached to the mission came from little more than a bureaucratic fixation on meeting arbitrary deadlines so missions could be checked off a list and tallied as 'accomplished'. This emphasis on quantification has always been a hallmark of the military, but it was carried to new heights of fatuity during Donald Rumsfeld's tenure at The Pentagon. Rumsfeld was obsessed with achieving positive 'metrics' that could be wielded to demonstrate progress in the Global War on Terror.
— Jon Krakauer, Where Men Win Glory.[5]
In modern clinical trials
editThere has been increasing discussion of the McNamara fallacy in medical literature.[6][7] In particular, the McNamara fallacy is invoked to describe the inadequacy of only using progression-free survival (PFS) as a primary endpoint in clinical trials for agents treating metastatic solid tumors simply because PFS is an endpoint which is merely measurable, while failing to capture outcomes which are more meaningful, such as overall quality of life or overall survival.
In competitive admissions processes
editIn competitive admissions processes—such as those used for graduate medical education[8]—evaluating candidates using only numerical metrics results in ignoring non-quantifiable factors and attributes which may ultimately be more relevant to the applicant's success in the position.
See also
edit- Allegory of the cave – Allegory by Plato
- Goodhart's law – Adage about statistical measures
- Metric fixation – Tendency for decision-makers to place excessively large emphases on selected metrics
- Newton's flaming laser sword – Verificationist principle
- Occam's razor – Philosophical problem-solving principle
- Streetlight effect – Observational bias from only searching where it is easiest to look
- Surrogation – Psychological phenomenon; replacement of a construct with its measurement
- Truth – Being in accord with fact or reality
- Verificationism – Philosophical doctrine
- Verisimilitude – Resemblance to reality
References
edit- ^ Fischer, D. H. (June 1970). Historians' fallacies: toward a logic of historical thought. Harper torchbooks (first ed.). New York: HarperCollins. p. 90. ISBN 978-0-06-131545-9. OCLC 185446787.
- ^ Yankelovich, Daniel (November 15, 1971). "Interpreting the New Life Styles". Sales Management, the Marketing Magazine. Dartnell Corporation. Retrieved March 11, 2023.
- ^ Baskin, Jonathan Salem (July 25, 2014). "According To U.S. Big Data, We Won The Vietnam War". Forbes. Retrieved April 12, 2023.
- ^ Phillips, Rufus (2008). Why Vietnam Matters. Naval Institute Press. ISBN 978-1-682-47310-8.
- ^ Krakauer, Jon (2009). Where Men Win Glory: The Odyssey of Pat Tillman (1st ed.). New York: Doubleday. p. 246. ISBN 978-0-385-52226-7.
- ^ Basler, Michael H. (2009). "Utility of the McNamara fallacy". BMJ. 339: b3141. doi:10.1136/bmj.b3141. S2CID 71916631.
- ^ Booth, Christopher M.; Eisenhauer, Elizabeth A. (2012). "Progression-Free Survival: Meaningful or Simply Measurable?". Journal of Clinical Oncology. 30 (10): 1030–1033. doi:10.1200/JCO.2011.38.7571. PMID 22370321.
- ^ Carmody, JB (2019). "On residency selection and the quantitative fallacy". Journal of Graduate Medical Education. 11 (4): 420–421. doi:10.4300/JGME-D-19-00453.1. PMC 6699544. PMID 31440336.