research-article

Whose Walkability?: Challenges in Algorithmically Measuring Subjective Experience

Authors:

Nicholas DiakopoulosAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 3, Issue CSCW

Article No.: 126, Pages 1 - 22

https://doi.org/10.1145/3359228

Published: 07 November 2019 Publication History

Abstract

The Walk Score is a patented algorithm for measuring the walkability of a given geographic area. In addition to its use in real estate, the accompanying API is used in a range of research in public health and urban development. This study explores how neighborhood residents differently understand the notion of walkability as well as the extent to which their personal definitions of neighborhood walkability are reflected in the Walk Score's underlying algorithm. We find that, while the Walk Score generally aligns with residents' priorities around walkability, significant subjective aspects that influence walking behavior are not reflected in the score, raising the need to consider implications for using algorithmic tools like the Walk Score in certain research contexts. We discuss the challenge of measuring subjective experience and how designers might begin to address it. We call for qualitative evaluations of algorithmic tools to help determine appropriate contexts of use.

References

[1]

Oscar Alvarado and Annika Waern. 2018. Towards algorithmic experience: Initial efforts for social media contexts. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 286.

Digital Library

[2]

Lora Aroyo, Lucas Dixon, Nithum Thain, Olivia Redfield, and Rachel Rosen. 2019. Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. In Companion Proceedings of The 2019 World Wide Web Conference (WWW '19). ACM, New York, NY, USA, 1100--1105. https://doi.org/10.1145/3308560.3317083

[3]

Bradley Bereitschaft. 2019. Exploring perceptions of creativity and walkability in Omaha, NE. City, Culture and Society, Vol. 17 (2019), 8--19.

[4]

Taina Bucher. 2012. Want to be on the top? Algorithmic power and the threat of invisibility on Facebook. New media & society, Vol. 14, 7 (2012), 1164--1180.

[5]

Aylin Caliskan, Joanna J Bryson, and Arvind Narayanan. 2017. Semantics derived automatically from language corpora contain human-like biases. Science, Vol. 356, 6334 (2017), 183--186.

[6]

Lucas J Carr, Shira I Dunsiger, and Bess H Marcus. 2010. Walk score? as a global estimate of neighborhood walkability. American journal of preventive medicine, Vol. 39, 5 (2010), 460--463.

[7]

Lucas J Carr, Shira I Dunsiger, and Bess H Marcus. 2011. Validation of Walk Score for estimating access to walkable amenities. Br J Sports Med, Vol. 45, 14 (2011), 1144--1148.

[8]

Eric Corbett and Yanni Loukissas. 2019. Engaging Gentrification As a Social Justice Issue in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 280, 16 pages. https://doi.org/10.1145/3290605.3300510

Digital Library

[9]

Paulo Jorge Monteiro de Cambra. 2012. Pedestrian accessibility and attractiveness indicators for walkability assessment. Ph.D. Dissertation. Thesis for the Master Degree (MSc) in Urban Studies and Territorial Management.

[10]

Nicholas Diakopoulos. 2015. Algorithmic Accountability: Journalistic investigation of computational power structures. Digital Journalism, Vol. 3, 3 (2015), 398--415. https://doi.org/10.1080/21670811.2014.976411

[11]

Mark D'iaz, Isaac Johnson, Amanda Lazar, Anne Marie Piper, and Darren Gergle. 2018. Addressing age-related bias in sentiment analysis. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 412.

Digital Library

[12]

Berkeley J Dietvorst, Joseph P Simmons, and Cade Massey. 2015. Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General, Vol. 144, 1 (2015), 114.

[13]

Lucas Dixon, John Li, Jeffrey Sorensen, Nithum Thain, and Lucy Vasserman. 2018. Measuring and Mitigating Unintended Bias in Text Classification. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society (AIES '18). ACM, New York, NY, USA, 67--73. https://doi.org/10.1145/3278721.3278729

Digital Library

[14]

Maeve Duggan. 2017. Online harassment 2017. (2017).

[15]

Dustin T Duncan, Jared Aldstadt, John Whalen, Steven J Melly, and Steven L Gortmaker. 2011. Validation of Walk Score® for estimating neighborhood walkability: an analysis of four US metropolitan areas. International journal of environmental research and public health, Vol. 8, 11 (2011), 4160--4179.

[16]

Motahhare Eslami, Amirhossein Aleyasen, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. FeedVis: A Path for Exploring News Feed Curation Algorithms. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing (CSCW'15 Companion). ACM, New York, NY, USA, 65--68. https://doi.org/10.1145/2685553.2702690

Digital Library

[17]

Wendy Nelson Espeland and Mitchell L Stevens. 2008. A sociology of quantification. European Journal of Sociology/Archives Européennes de Sociologie, Vol. 49, 3 (2008), 401--436.

[18]

Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor .St. Martin's Press.

Digital Library

[19]

Sarah E. Fox, Meredith Lampe, and Daniela K. Rosner. 2018. Parody in Place: Exposing Socio-spatial Exclusions in Data-Driven Maps with Design Parody. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 322, 13 pages. https://doi.org/10.1145/3173574.3173896

Digital Library

[20]

Batya Friedman. 1997. Human values and the design of computer technology. Number 72. Cambridge University Press.

[21]

Batya Friedman, Peter Kahn, and Alan Borning. 2002. Value sensitive design: Theory and methods. University of Washington technical report 02--12 (2002).

[22]

Batya Friedman, Peter H Kahn, and Alan Borning. 2008. Value sensitive design and information systems. The handbook of information and computer ethics (2008), 69--101.

[23]

Tarleton Gillespie. 2014. The relevance of algorithms. Media technologies: Essays on communication, materiality, and society, Vol. 167 (2014).

[24]

Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M. Branham. 2018. Gender Recognition or Gender Reductionism?: The Social Implications of Embedded Gender Recognition Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 8, 13 pages. https://doi.org/10.1145/3173574.3173582

[25]

Kotaro Hara and Jon E Froehlich. 2015. Characterizing and visualizing physical world accessibility at scale using crowdsourcing, computer vision, and machine learning. ACM SIGACCESS Accessibility and Computing 113 (2015), 13--21.

Digital Library

[26]

Douglas Harper. 2002. Talking about pictures: A case for photo elicitation. Visual studies, Vol. 17, 1 (2002), 13--26.

[27]

Chester Harvey, Lisa Aultman-Hall, Stephanie E Hurley, and Austin Troy. 2015. Effects of skeletal streetscape design on perceived safety. Landscape and Urban Planning, Vol. 142 (2015), 18--28.

[28]

Jana A Hirsch, Kari A Moore, Kelly R Evenson, Daniel A Rodriguez, and Ana V Diez Roux. 2013. Walk Score® and Transit Score® and walking in the multi-ethnic study of atherosclerosis. American journal of preventive medicine, Vol. 45, 2 (2013), 158--166.

[29]

Jana A Hirsch, Meghan Winters, Philippa J Clarke, Nathalie Ste-Marie, and Heather A McKay. 2017. The influence of walkability on broader mobility for Canadian middle aged and older adults: An examination of Walk Score? and the Mobility Over Varied Environments Scale (MOVES). Preventive medicine, Vol. 95 (2017), S60--S67.

[30]

Lindsey Irene Jones. 2010. Investigating neighborhood walkability and its association with physical activity levels and body composition of a sample of Maryland adolescent girls. Ph.D. Dissertation.

[31]

Herbert Kalthoff. 2005. Practices of calculation: Economic representations and risk management. Theory, Culture & Society, Vol. 22, 2 (2005), 69--97.

[32]

Os Keyes. 2018. The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition. Proc. ACM Hum.-Comput. Interact., Vol. 2, CSCW, Article 88 (Nov. 2018), 22 pages. https://doi.org/10.1145/3274357

Digital Library

[33]

René F Kizilcec. 2016. How much information?: Effects of transparency on trust in an algorithmic interface. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2390--2395.

Digital Library

[34]

Karin Knorr-Cetina. 1999. Epistemic cultures: The cultures of knowledge societies. Cambridge, MA: Harvard (1999).

[35]

Felicitas Kraemer, Kees van Overveld, and Martin Peterson. 2010. Is there an ethics of algorithms? Ethics and Information Technology, Vol. 13, 3 (July 2010), 251--260.

[36]

Juhi Kulshrestha, Motahhare Eslami, Johnnatan Messias, Muhammad Bilal Zafar, Saptarshi Ghosh, Krishna P Gummadi, and Karrie Karahalios. 2017. Quantifying search bias: Investigating sources of bias for political searches in social media. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 417--432.

Digital Library

[37]

Christopher A Le Dantec, Erika Shehan Poole, and Susan P Wyche. 2009. Values as lived experience: evolving value sensitive design in support of value discovery. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1141--1150.

Digital Library

[38]

Anthony Li, Manaswi Saha, Anupam Gupta, and Jon E Froehlich. 2018. Interactively Modeling and Visualizing Neighborhood Accessibility at Scale: An Initial Study of Washington DC. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 444--446.

Digital Library

[39]

Caitlin Lustig and Bonnie Nardi. 2015. Algorithmic authority: The case of Bitcoin. In 2015 48th Hawaii International Conference on System Sciences. IEEE, 743--752.

Digital Library

[40]

Caitlin Lustig, Katie Pine, Bonnie Nardi, Lilly Irani, Min Kyung Lee, Dawn Nafus, and Christian Sandvig. 2016. Algorithmic Authority: The Ethics, Politics, and Economics of Algorithms That Interpret, Decide, and Manage. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1057--1062. https://doi.org/10.1145/2851581.2886426

Digital Library

[41]

Kevin Manaugh and Ahmed El-Geneidy. 2011. Validating walkability indices: How do different households respond to the walkability of their neighborhood? Transportation research part D: transport and environment, Vol. 16, 4 (2011), 309--315.

[42]

Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, 220--229.

Digital Library

[43]

Brent Daniel Mittelstadt, Patrick Allo, Mariarosaria Taddeo, Sandra Wachter, and Luciano Floridi. 2016. The ethics of algorithms: Mapping the debate. Big Data and Society, Vol. 3, 2 (2016).

[44]

Helen Nissenbaum. 2001. How computer systems embody values. Computer, Vol. 34, 3 (2001), 120--119.

Digital Library

[45]

Safiya Umoja Noble. 2018. Algorithms of oppression: How search engines reinforce racism .NYU Press.

[46]

Cathy O'Neil. 2017. Weapons of math destruction: How big data increases inequality and threatens democracy .Broadway Books.

[47]

Michael Prescott. 2014. Using Social Topography to Understand the Active Mobility Networks (AMNs) of People with Disabilities (PWDs). http://hdl.handle.net/10012/8250

[48]

Reid Priedhorsky, David Pitchford, Shilad Sen, and Loren Terveen. 2012. Recommending Routes in the Context of Bicycling: Algorithms, Evaluation, and the Value of Personalization. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 979--988. https://doi.org/10.1145/2145204.2145350

Digital Library

[49]

Emilee Rader, Kelley Cotter, and Janghee Cho. 2018. Explanations As Mechanisms for Supporting Algorithmic Transparency. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 103, 13 pages. https://doi.org/10.1145/3173574.3173677

Digital Library

[50]

Andrew Schrock. 2018. Civic Tech: Making Technology Work for People.

[51]

Walk Score. 2014. Walk score methodology. Accessed April, Vol. 24 (2014).

[52]

Katie Shilton, Jes A Koepfler, and Kenneth R Fleischmann. 2014. How to see values in social computing: methods for studying values dimensions. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 426--435.

Digital Library

[53]

A Strauss and J M Corbin. 1990. Basics of qualitative research: Grounded theory procedures and techniques. Sage Publications, Inc.

[54]

Paul Y Takahashi, Mitzi A Baker, Stephan Cha, and Paul V Targonski. 2012. A cross-sectional survey of the relationship between walking, biking, and the built environment for adults aged over 70 years. Risk management and healthcare policy, Vol. 5 (2012), 35.

[55]

Jacob Thebault-Spieker, Loren Terveen, and Brent Hecht. 2017. Toward a Geographic Understanding of the Sharing Economy: Systemic Biases in UberX and TaskRabbit. ACM Trans. Comput.-Hum. Interact., Vol. 24, 3, Article 21 (April 2017), 40 pages. https://doi.org/10.1145/3058499

Digital Library

[56]

Samuel D Towne, Jaewoong Won, Sungmin Lee, Marcia G Ory, Samuel N Forjuoh, Suojin Wang, and Chanam Lee. 2016. Using Walk Score? and neighborhood perceptions to assess walking among middle-aged and older adults. Journal of community health, Vol. 41, 5 (2016), 977--988.

[57]

Vasillis Vlachokyriakos, Clara Crivellaro, Christopher A Le Dantec, Eric Gordon, Pete Wright, and Patrick Olivier. 2016. Digital civics: Citizen empowerment with and through technology. In Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems. ACM, 1096--1099.

Digital Library

[58]

Zeerak Waseem. 2016. Are you a racist or am i seeing things? annotator influence on hate speech detection on twitter. In Proceedings of the first workshop on NLP and computational social science. 138--142.

[59]

Peter West, Richard Giordano, Max Van Kleek, and Nigel Shadbolt. 2016. The Quantified Patient in the Doctor's Office: Challenges & Opportunities. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3066--3078. https://doi.org/10.1145/2858036.2858445

Digital Library

[60]

Allison Woodruff, Sarah E. Fox, Steven Rousso-Schindler, and Jeffrey Warshaw. 2018. A Qualitative Exploration of Perceptions of Algorithmic Fairness. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 656, 14 pages. https://doi.org/10.1145/3173574.3174230

Digital Library

Cited By

Cahill MAnguelov N(2024)Hedonic analysis of willingness to pay for dam removal: evidence from Plymouth, MassachusettsJournal of Environmental Planning and Management10.1080/09640568.2024.2322538(1-21)Online publication date: 20-Mar-2024
https://doi.org/10.1080/09640568.2024.2322538
Dickinson CManaugh KPathak PSengupta R(2024)Geographic identity and perceptions of walkable spaceTravel Behaviour and Society10.1016/j.tbs.2023.10070334(100703)Online publication date: Jan-2024
https://doi.org/10.1016/j.tbs.2023.100703
Hutchinson BRostamzadeh NGreer CHeller KPrabhakaran V(2022)Evaluation Gaps in Machine Learning PracticeProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533233(1859-1876)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3533233
Show More Cited By

Index Terms

Whose Walkability?: Challenges in Algorithmically Measuring Subjective Experience

Recommendations

Walkability optimization: formulations, algorithms, and a case study of toronto
AAAI'23/IAAI'23/EAAI'23: Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence

The concept of walkable urban development has gained increased attention due to its public health, economic, and environmental sustainability benefits. Unfortunately, land zoning and historic under-investment have resulted in spatial inequality in ...
Evaluating walkability: a capability-wise planning and design support system

We present a methodology and a planning and design support software tool for evaluating walkability and pedestrian accessibility of places which are relevant for people’s capabilities, and thus an important component of quality of life in cities. A ...
Algorithmic Technologies and Underrepresented Populations
CSCW '19 Companion: Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing

In this work I aim to unpack how algorithmic tools measure and quantify human behavior. I explore algorithms' appropriate contexts of use and their connections to algorithmic bias. This thesis ultimately explores a method of representing subjects of ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 3, Issue CSCW

November 2019

5026 pages

EISSN:2573-0142

DOI:10.1145/3371885

Editors:
Airi Lampinen
Stockholm University, Sweden
,
Darren Gergle
Northwestern University, USA
,
David A. Shamma
FXPAL, USA

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2019

Published in PACMHCI Volume 3, Issue CSCW

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
263
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)4

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cahill MAnguelov N(2024)Hedonic analysis of willingness to pay for dam removal: evidence from Plymouth, MassachusettsJournal of Environmental Planning and Management10.1080/09640568.2024.2322538(1-21)Online publication date: 20-Mar-2024
https://doi.org/10.1080/09640568.2024.2322538
Dickinson CManaugh KPathak PSengupta R(2024)Geographic identity and perceptions of walkable spaceTravel Behaviour and Society10.1016/j.tbs.2023.10070334(100703)Online publication date: Jan-2024
https://doi.org/10.1016/j.tbs.2023.100703
Hutchinson BRostamzadeh NGreer CHeller KPrabhakaran V(2022)Evaluation Gaps in Machine Learning PracticeProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533233(1859-1876)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3533233
Sun YLu WSun P(2021)Optimization of Walk Score Based on Street Greening—A Case Study of Zhongshan Road in QingdaoInternational Journal of Environmental Research and Public Health10.3390/ijerph1803127718:3(1277)Online publication date: 31-Jan-2021
https://doi.org/10.3390/ijerph18031277
Bandy J(2021)Problematic Machine BehaviorProceedings of the ACM on Human-Computer Interaction10.1145/34491485:CSCW1(1-34)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449148

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents