research-article

Open access

Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics

Authors:

Richmond Y. Wong,

Michael A. Madaio,

Nick MerrillAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue CSCW1

Article No.: 145, Pages 1 - 27

https://doi.org/10.1145/3579621

Published: 16 April 2023 Publication History

Abstract

Numerous toolkits have been developed to support ethical AI development. However, toolkits, like all tools, encode assumptions in their design about what work should be done and how. In this paper, we conduct a qualitative analysis of 27 AI ethics toolkits to critically examine how the work of ethics is imagined and how it is supported by these toolkits. Specifically, we examine the discourses toolkits rely on when talking about ethical issues, who they imagine should do the work of ethics, and how they envision the work practices involved in addressing ethics. Among the toolkits, we identify a mismatch between the imagined work of ethics and the support the toolkits provide for doing that work. In particular, we identify a lack of guidance around how to navigate labor, organizational, and institutional power dynamics as they relate to performing ethical work. We use these omissions to chart future work for researchers and designers of AI ethics toolkits.

References

[1]

J Khadijah Abdurahman. 2021. A Body of Work That Cannot Be Ignored. Logic 15: Beacons (2021). https://logicmag.io/beacons/a-body-of-work-that-cannot-be-ignored/

[2]

Sara Ahmed. 2012. On being included. Duke University Press, Durham, NC.

[3]

Yongsu Ahn and Yu-Ru Lin. 2020. FairSight: Visual Analytics for Fairness in Decision Making. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 1086--1095. https://doi.org/10.1109/TVCG.2019.2934262

[4]

Philip Alston. 2019. Report of the Special Rapporteur on extreme poverty and human rights. Technical Report October. United Nations. 1--23 pages. https://undocs.org/A/74/493

[5]

Jacqui Ayling and Adriane Chapman. 2021. Putting AI ethics to work: are the tools fit for purpose? AI and Ethics 2, 3 (2021), 405--429. https://doi.org/10.1007/s43681-021-00084-x

[6]

Kenneth A. Bamberger and Deirdre K. Mulligan. 2015. Privacy on the Ground: Driving Corporate Behavior in the United States and Europe. The MIT Press, Cambridge, Massachusetts.

Digital Library

[7]

Elettra Bietti. 2020. From Ethics Washing to Ethics Bashing: A View on Tech Ethics from within Moral Philosophy. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). Association for Computing Machinery, New York, NY, USA, 210--219. https://doi.org/10.1145/3351095.3372860

Digital Library

[8]

Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (Technology) is Power: A Critical Survey of ?Bias" in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 5454--5476. https://doi.org/10.18653/v1/2020.acl-main.485

[9]

Geoffrey Bowker and Susan Leigh Star. 1999. Sorting things out. Vol. 4. MIT Press, Cambridge, MA.

[10]

Karen Boyd. 2020. Ethical Sensitivity in Machine Learning Development. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing (Virtual Event, USA) (CSCW '20 Companion). Association for Computing Machinery, New York, NY, USA, 87--92. https://doi.org/10.1145/3406865.3418359

Digital Library

[11]

Karen L Boyd. 2021. Datasheets for Datasets help ML Engineers Notice and Understand Ethical Issues in Training Data. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (oct 2021), 1--27. https://doi.org/10.1145/3479582

Digital Library

[12]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.

[13]

Kirsten E Bray, Christina Harrington, Andrea G Parker, N'Deye Diakhate, and Jennifer Roberts. 2022. Radical Futures: Supporting Community-Led Design Engagements through an Afrofuturist Speculative Design Toolkit. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 452, 13 pages. https://doi.org/10.1145/3491102.3501945

Digital Library

[14]

Hao-Fei Cheng, Logan Stapleton, Ruiqi Wang, Paige Bullock, Alexandra Chouldechova, Zhiwei Steven Steven Wu, and Haiyi Zhu. 2021. Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 390, 17 pages. https://doi.org/10.1145/3411764.3445308

Digital Library

[15]

Shruthi Sai Chivukula, Ziqing Li, Anne C Pivonka, Jingning Chen, and Colin M Gray. 2021. Surveying the Landscape of Ethics-Focused Design Methods. arXiv preprint arXiv:2102.08909 (2021), 32 pages.

[16]

Shruthi Sai Chivukula, Chris Rhys Watkins, Rhea Manocha, Jingle Chen, and Colin M. Gray. 2020. Dimensions of UX Practice that Shape Ethical Awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376459

Digital Library

[17]

Keeley Alexandra Crockett, Luciano Gerber, Annabel Latham, and Edwin Colyer. 2021. Building Trustworthy AI Solutions: A Case for Practical Solutions for Small Businesses. IEEE Transactions on Artificial Intelligence (2021), 1--1. https://doi.org/10.1109/TAI.2021.3137091

[18]

Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder Participation in AI: Beyond" Add Diverse Stakeholders and Stir". arXiv preprint arXiv:2111.01122 (2021), 7 pages.

[19]

Wesley Hanwen Deng, Manish Nagireddy, Michelle Seng Ah Lee, Jatinder Singh, Zhiwei Steven Wu, Kenneth Holstein, and Haiyi Zhu. 2022. Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits. In 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT '22). Association for Computing Machinery, New York, NY, USA, 473--484. https://doi.org/10.1145/3531146.3533113

Digital Library

[20]

Jeffrey Ding. 2018. Deciphering China's AI dream., 44 pages. https://www.fhi.ox.ac.uk/wp-content/uploads/Deciphering_Chinas_AI-Dream.pdf

[21]

Mary Flanagan and Helen Nissenbaum. 2014. Groundwork for Values in Games. In Values at Play in Digital Games. MIT Press, Cambridge, Massachusetts, Chapter 1.

[22]

Jodi Forlizzi and John Zimmerman. 2013. Promoting service design as a core practice in interaction design. In Proceedings of the 5th International Congress of International Association of Societies of Design Research-IASDR, Vol. 13. 1--12.

[23]

Batya Friedman, Peter Kahn, and Alan Borning. 2002. Value sensitive design: Theory and methods.

[24]

Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé Iii, and Kate Crawford. 2021. Datasheets for datasets. Commun. ACM 64, 12 (2021), 86--92. https://doi.org/10.1145/3458723

Digital Library

[25]

Charles Goodwin. 1994. Professional Vision. American Anthropologist 96, 3 (1994), 606--633. http://www.jstor.org/stable/682303

[26]

Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Houghton Mifflin Harcourt, Boston.

[27]

Ben Green. 2021. Data Science as Political Action: Grounding Data Science in a Politics of Justice. Journal of Social Computing 2, 3 (Sept. 2021), 249--265. https://doi.org/10.23919/JSC.2021.0029

[28]

Daniel Greene, Anna Lauren Hoffmann, and Luke Stark. 2019. Better, Nicer, Clearer, Fairer: A Critical Assessment of the Movement for Ethical Artificial Intelligence and Machine Learning. In Proceedings of the 52nd Hawaii International Conference on System Sciences. 2122--2131. https://doi.org/10.24251/HICSS.2019.258

[29]

Zoë Hitzig. 2020. The normative gap: mechanism design and ideal theories of justice. Economics & Philosophy 36, 3 (2020), 407--434.

[30]

Anna Lauren Hoffmann. 2019. Where fairness fails: data, algorithms, and the limits of antidiscrimination discourse. Information, Communication & Society 22, 7 (June 2019), 900--915. https://doi.org/10.1080/1369118X.2019.1573912

[31]

Anna Lauren Hoffmann. 2020. Terms of inclusion: Data, discourse, violence. New Media & Society 23 (sep 2020), 146144482095872. Issue 12. https://doi.org/10.1177/1461444820958725

[32]

Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé III, Miro Dudik, and Hanna Wallach. 2019. Improving fairness in machine learning systems: What do industry practitioners need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland UK) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--16. https://doi.org/10.1145/3290605.3300830

Digital Library

[33]

Lara Houston, Steven J Jackson, Daniela K Rosner, Syed Ishtiaque Ahmed, Meg Young, and Laewoo Kang. 2016. Values in Repair. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. ACM Press, New York, New York, USA, 1403--1414. https://doi.org/10.1145/2858036.2858470

Digital Library

[34]

Abigail Z. Jacobs and Hanna Wallach. 2021. Measurement and Fairness. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21). Association for Computing Machinery, New York, NY, USA, 375--385. https://doi.org/10.1145/3442188.3445901

Digital Library

[35]

Nassim JafariNaimi (Parvin), Lisa Nathan, and Ian Hargraves. 2015. Values as Hypotheses: Design, Inquiry, and the Service of Values. Design Issues 31, 4 (Oct 2015), 91--104. https://doi.org/10.1162/DESI_a_00354

[36]

Sheila Jasanoff and Sang-Hyun Kim. 2015. Dreamscapes of modernity: Sociotechnical imaginaries and the fabrication of power. University of Chicago Press, Chicago.

[37]

Anna Jobin, Marcello Ienca, and Effy Vayena. 2019. The global landscape of AI ethics guidelines. Nature Machine Intelligence 1 (Sep 2019), 1--11. https://doi.org/10.1038/s42256-019-0088--2

[38]

Christopher M Kelty. 2018. The Participatory Development Toolkit. https://limn.it/articles/the-participatory-development-toolkit/

[39]

Deanna Kemp and Frank Vanclay. 2013. Human rights and impact assessment: clarifying the connections in practice. Impact Assessment and Project Appraisal 31, 2 (2013), 86--96. https://doi.org/10.1080/14615517.2013.782978

[40]

Vera Khovanskaya and Phoebe Sengers. 2019. Data Rhetoric and Uneasy Alliances: Data Advocacy in US Labor History. In Proceedings of the 2019 on Designing Interactive Systems Conference. ACM, New York, NY, USA, 1391--1403. https://doi.org/10.1145/3322276.3323691

Digital Library

[41]

P. M. Krafft, Meg Young, Michael Katell, Jennifer E. Lee, Shankar Narayan, Micah Epstein, Dharma Dailey, Bernease Herman, Aaron Tam, Vivian Guetler, Corinne Bintz, Daniella Raz, Pa Ousman Jobe, Franziska Putz, Brian Robick, and Bissan Barghouti. 2021. An Action-Oriented AI Policy Toolkit for Technology Audits by Community Advocates and Activists. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21). Association for Computing Machinery, New York, NY, USA, 772--781. https://doi.org/10.1145/3442188.3445938

Digital Library

[42]

Christopher A. Le Dantec, Erika Shehan Poole, and Susan P. Wyche. 2009. Values as lived experience: Evolving value sensitive design in support of value discovery. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, New York, New York, USA, 1141. https://doi.org/10.1145/1518701.1518875

Digital Library

[43]

Michelle Seng Ah Lee and Jat Singh. 2021. The Landscape and Gaps in Open Source Fairness Toolkits. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 699, 13 pages. https://doi.org/10.1145/3411764.3445261

Digital Library

[44]

Jason Edward Lewis, Noelani Arista, Archer Pechawis, and Suzanne Kite. 2018. Making kin with the machines. Journal of Design and Science (2018). https://doi.org/10.21428/bfafd97b

[45]

LittleSis. 2017. Map the Power Toolkit. https://littlesis.org/toolkit

[46]

Ewa Luger, Lachlan Urquhart, Tom Rodden, and Michael Golembewski. 2015. Playing the Legal Card: Using Ideation Cards to Raise Data Protection Issues within the Design Process. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 457--466. https://doi.org/10.1145/2702123.2702142

Digital Library

[47]

Michael Madaio, Lisa Egede, Hariharan Subramonyam, Jennifer Wortman Vaughan, and Hanna Wallach. 2022. Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1--26. https://doi.org/10.1145/3512899

Digital Library

[48]

Michael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376445

Digital Library

[49]

Shannon Mattern. 2021. Unboxing the Toolkit. https://tool-shed.org/unboxing-the-toolkit/

[50]

Donald McMillan and Barry Brown. 2019. Against Ethical AI. In Proceedings of the Halfway to the Future Symposium 2019 (Nottingham, United Kingdom) (HTTF 2019). Association for Computing Machinery, New York, NY, USA, Article 9, 3 pages. https://doi.org/10.1145/3363384.3363393

Digital Library

[51]

Jacob Metcalf, Emanuel Moss, and danah Boyd. 2019. Owning ethics: Corporate logics, Silicon Valley, and the institutionalization of ethics. Social Research 86, 2 (2019), 449--476.

[52]

Jacob Metcalf, Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, and Madeleine Clare Elish. 2021. Algorithmic Impact Assessments and Accountability: The Co-Construction of Impacts. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21). Association for Computing Machinery, New York, NY, USA, 735--746. https://doi.org/10.1145/3442188.3445935

Digital Library

[53]

Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model Cards for Model Reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19). Association for Computing Machinery, New York, NY, USA, 220--229. https://doi.org/10.1145/3287560.3287596

Digital Library

[54]

Brent Mittelstadt. 2019. AI Ethics--Too Principled to Fail? CoRR arXiv:1906.06668. (2019). https://doi.org/10.48550/ arXiv.1906.06668

[55]

Jessica Morley, Luciano Floridi, Libby Kinsey, and Anat Elhalal. 2021. From what to how: an initial review of publicly available AI ethics tools, methods and research to translate principles into practices. In Ethics, Governance, and Policies in Artificial Intelligence. Springer, 153--183.

[56]

Gina Neff. 2020. From Bad Users and Failed Uses to Responsible Technologies: A Call to Expand the AI Ethics Toolkit. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (New York, NY, USA) (AIES '20). Association for Computing Machinery, New York, NY, USA, 5--6. https://doi.org/10.1145/3375627.3377141

Digital Library

[57]

Mim Onuoha and Diana Nucera. 2018. A People's Guide to AI. Allied Media Projects. https://alliedmedia.org/resources/peoples-guide-to-ai

[58]

Ifeoma Ozoma. 2021. The Tech Worker Handbook. https://techworkerhandbook.org/

[59]

Samir Passi and Solon Barocas. 2019. Problem Formulation and Fairness. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19). Association for Computing Machinery, New York, NY, USA, 39--48. https://doi.org/10.1145/3287560.3287567

Digital Library

[60]

Samir Passi and Steven J. Jackson. 2018. Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 136 (Nov 2018), 28 pages. https://doi.org/10.1145/3274405

Digital Library

[61]

Samir Passi and Phoebe Sengers. 2020. Making data science systems work. Big Data & Society 7, 2 (2020), 13 pages. https://doi.org/10.1177/2053951720939605

[62]

Bryan Pfaffenberger. 1992. Technological Dramas. Science, Technology, & Human Values 17, 3 (Jul 1992), 282--312. https://doi.org/10.1177/016224399201700302

[63]

James Pierce, Sarah Fox, Nick Merrill, and Richmond Wong. 2018. Differential vulnerabilities and a diversity of tactics: What toolkits teach us about cybersecurity. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1--24. https://doi.org/10.1145/3274408

Digital Library

[64]

Bogdana Rakova, Jingying Yang, Henriette Cramer, and Rumman Chowdhury. 2021. Where responsible AI meets reality: Practitioner perspectives on enablers for shifting organizational practices. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1--23. https://doi.org/10.1145/3449081

Digital Library

[65]

Noopur Raval and Amba Kak. 2021. A New AI Lexicon: Responses and Challenges to the Critical AI discourse. https://medium.com/a-new-ai-lexicon/a-new-ai-lexicon-responses-and-challenges-to-the-critical-ai-discourse-f2275989fa62

[66]

Peter Redfield. 2013. Life in crisis. University of California Press, Berkeley.

[67]

Brianna Richardson, Jean Garcia-Gathright, Samuel F. Way, Jennifer Thom, and Henriette Cramer. 2021. Towards Fairness in Practice: A Practitioner-Oriented Rubric for Evaluating Fair ML Toolkits. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 236, 13 pages. https://doi.org/10.1145/3411764.3445604

Digital Library

[68]

John Gerard Ruggie. 2017. The Social Construction of the UN Guiding Principles on Business & Human Rights. (2017). https://doi.org/10.2139/ssrn.2984901

[69]

Nithya Sambasivan, Erin Arnesen, Ben Hutchinson, Tulsee Doshi, and Vinodkumar Prabhakaran. 2021. Re-Imagining Algorithmic Fairness in India and Beyond. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21). Association for Computing Machinery, New York, NY, USA, 315--328. https://doi.org/10.1145/3442188.3445896

Digital Library

[70]

Daniel Schiff, Bogdana Rakova, Aladdin Ayesh, Anat Fanti, and Michael Lennon. 2020. Principles to practices for responsible AI: Closing the gap. arXiv preprint arXiv:2006.04707 (2020). https://doi.org/10.48550/arXiv.2006.04707

[71]

James C. Scott. 1998. Seeing Like a State: How certain schemes to improve the human condition have failed. Yale University Press, New Haven.

[72]

Andrew D. Selbst, Danah Boyd, Sorelle A. Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019. Fairness and Abstraction in Sociotechnical Systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19). Association for Computing Machinery, New York, NY, USA, 59--68. https://doi.org/10.1145/3287560.3287598

Digital Library

[73]

Hong Shen, Wesley H. Deng, Aditi Chattopadhyay, Zhiwei Steven Wu, Xu Wang, and Haiyi Zhu. 2021. Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21). Association for Computing Machinery, New York, NY, USA, 850--861. https://doi.org/10.1145/3442188.3445971

Digital Library

[74]

Hong Shen, Alicia DeVos, Motahhare Eslami, and Kenneth Holstein. 2021. Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 433 (oct 2021), 29 pages. https://doi.org/10.1145/3479577

Digital Library

[75]

Hong Shen, Haojian Jin, Ángel Alexander Cabrera, Adam Perer, Haiyi Zhu, and Jason I Hong. 2020. Designing Alternative Representations of Confusion Matrices to Support Non-Expert Public Understanding of Algorithm Performance. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1--22. https://doi.org/10.1145/3415224

Digital Library

[76]

Hong Shen, Leijie Wang, Wesley H. Deng, Ciell Brusse, Ronald Velgersdijk, and Haiyi Zhu. 2022. The Model Card Authoring Toolkit: Toward Community-Centered, Deliberation-Driven AI Design. In 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT '22). Association for Computing Machinery, New York, NY, USA, 440--451. https://doi.org/10.1145/3531146.3533110

Digital Library

[77]

Katie Shilton. 2013. Values levers: Building ethics into design. Science, Technology, & Human Values 38, 3 (2013), 374--397. https://doi.org/10.1177/0162243912436985

[78]

Katie Shilton. 2018. Values and ethics in human-computer interaction. Foundations and Trends® in Human--Computer Interaction 12, 2 (2018), 107--171. https://doi.org/10.1561/1100000073

Digital Library

[79]

Katie Shilton, Donal Heidenblad, Adam Porter, Susan Winter, and Mary Kendig. 2020. Role-Playing Computer Ethics: Designing and Evaluating the Privacy by Design (PbD) Simulation. Science and Engineering Ethics (Jul 2020). https://doi.org/10.1007/s11948-020-00250-0

[80]

Katie Shilton, Jes A. Koepfler, and Kenneth R. Fleischmann. 2014. How to see values in social computing: Methods for Studying Values Dimensions. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, New York, NY, USA, 426--435. https://doi.org/10.1145/2531602.2531625

Digital Library

[81]

Mandla Shonhiwa. 2020. Human values matter: why value-sensitive design should be part of every UX designer's toolkit. https://uxdesign.cc/human-values-matter-why-value-sensitive-design-should-be-part-of-every-ux-designers-toolkit-e53ffe7ec436

[82]

Susan S Silbey. 2009. Taming Prometheus: Talk about safety and culture. Annual Review of Sociology 35 (2009), 341--369.

[83]

Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2022. Participation Is Not a Design Fix for Machine Learning., Article 1 (2022), 6 pages. https://doi.org/10.1145/3551624.3555285

Digital Library

[84]

Danny Spitzberg, Kevin Shaw, Colin Angevine, Marissa Wilkins, M Strickland, Janel Yamashiro, Rhonda Adams, and Leah Lockhart. 2020. Principles at Work: Applying ?Design Justice" in Professionalized Workplaces. Technical Report. 1--5 pages. https://doi.org/10.21428/93b2c832.e3a8d187

[85]

Susan Leigh Star. 1989. The structure of ill-structured solutions: Boundary objects and heterogeneous distributed problem solving. In Distributed Artificial Intelligence (Vol. 2). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 37--54.

[86]

Luke Stark, Daniel Greene, and Anna Lauren Hoffmann. 2021. Critical Perspectives on Governance Mechanisms for AI/ML Systems. In The Cultural Life of Machine Learning. Springer, 257--280.

[87]

Jack Stilgoe, Richard Owen, and Phil Macnaghten. 2013. Developing a framework for responsible innovation. Research Policy 42, 9 (2013), 1568--1580. https://doi.org/10.1016/j.respol.2013.05.008

[88]

Lucy Suchman. 2002. Located accountabilities in technology production. Scandinavian journal of information systems 14, 2 (2002), 7.

Digital Library

[89]

United Nations Human Rights Office of the High Commissioner. 2011. Guiding Principles on Business and Human Rights: Implementing the United Nations "Protect, Respect and Remedy" Framework. Technical Report. United Nations. https://doi.org/10.4324/9781351171922--3

[90]

Elizabeth Anne Watkins, Michael McKenna, and Jiahao Chen. 2022. The four-fifths rule is not disparate impact: a woeful tale of epistemic trespassing in algorithmic fairness. arXiv preprint arXiv:2202.09519 (2022).

[91]

Kathryn Weaver, Janice Morse, and Carl Mitcham. 2008. Ethical sensitivity in professional practice: concept analysis. Journal of advanced nursing 62, 5 (2008), 607--618.

[92]

Richmond Y Wong. 2021. Tactics of Soft Resistance in User Experience Professionals' Values Work. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1--28. https://doi.org/10.1145/3479499

Digital Library

[93]

Richmond Y Wong, Karen Boyd, Jake Metcalf, and Katie Shilton. 2020. Beyond Checklist Approaches to Ethics in Design. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 511--517. https://doi.org/10.1145/3406865.3418590

Digital Library

[94]

JoAnne Yates and Wanda J Orlikowski. 1992. Genres of organizational communication: A structurational approach to studying communication and media. Academy of management review 17, 2 (1992), 299--326.

[95]

Daisy Yoo. 2021. Stakeholder Tokens: a constructive method for value sensitive design stakeholder analysis. Ethics and Information Technology (2021), 1--5. https://doi.org/10.1007/s10676-018--9474--4

Cited By

Ali WZhou XShao J(2025)Privacy-preserved and Responsible Recommenders: From Conventional Defense to Federated Learning and BlockchainACM Computing Surveys10.1145/370898257:5(1-35)Online publication date: 9-Jan-2025
https://dl.acm.org/doi/10.1145/3708982
Muralikumar MMcDonald D(2025)An Emerging Design Space of How Tools Support Collaborations in AI Design and DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/37011819:1(1-28)Online publication date: 10-Jan-2025
https://dl.acm.org/doi/10.1145/3701181
Ramulu HSchmitt HWermke DAcar YBalzarotti DXu W(2024)Security and privacy software creators' perspectives on unintended consequencesProceedings of the 33rd USENIX Conference on Security Symposium10.5555/3698900.3699083(3259-3276)Online publication date: 14-Aug-2024
https://dl.acm.org/doi/10.5555/3698900.3699083
Show More Cited By

Index Terms

Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
1. Social and professional topics
  1. Professional topics
    1. Computing profession

Recommendations

From ethics washing to ethics bashing: a view on tech ethics from within moral philosophy
FAT* '20: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency

The word 'ethics' is under siege in technology policy circles. Weaponized in support of deregulation, self-regulation or handsoff governance, "ethics" is increasingly identified with technology companies' self-regulatory efforts and with shallow ...
Subjectivity and information ethics

In “A Brief History of Information Ethics,” Thomas Froehlich (2004) quickly surveyed under several broad categories some of the many issues that constitute information ethics: under the category of librarianship—censorship, privacy, access, balance in ...
Conative Dimensions of Machine Ethics: A Defense of Duty

Immanuel Kant is one of the giants of moral theorizing in the western philosophical tradition. He developed a view of moral imperatives and duty that continues to inspire thought up to the present. In a thought-provoking series of papers, Anthony ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue CSCW1

CSCW

April 2023

3836 pages

EISSN:2573-0142

DOI:10.1145/3593053

Editor:
Jeff Nichols
Google

Issue’s Table of Contents

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2023

Published in PACMHCI Volume 7, Issue CSCW1

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
2,763
Total Downloads

Downloads (Last 12 months)1,735
Downloads (Last 6 weeks)129

Reflects downloads up to 21 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ali WZhou XShao J(2025)Privacy-preserved and Responsible Recommenders: From Conventional Defense to Federated Learning and BlockchainACM Computing Surveys10.1145/370898257:5(1-35)Online publication date: 9-Jan-2025
https://dl.acm.org/doi/10.1145/3708982
Muralikumar MMcDonald D(2025)An Emerging Design Space of How Tools Support Collaborations in AI Design and DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/37011819:1(1-28)Online publication date: 10-Jan-2025
https://dl.acm.org/doi/10.1145/3701181
Ramulu HSchmitt HWermke DAcar YBalzarotti DXu W(2024)Security and privacy software creators' perspectives on unintended consequencesProceedings of the 33rd USENIX Conference on Security Symposium10.5555/3698900.3699083(3259-3276)Online publication date: 14-Aug-2024
https://dl.acm.org/doi/10.5555/3698900.3699083
Li YGoel S(2024)Artificial Intelligence Auditability and Auditor Readiness for Auditing Artificial Intelligence SystemsSSRN Electronic Journal10.2139/ssrn.4787236Online publication date: 2024
https://doi.org/10.2139/ssrn.4787236
Kallina ESingh J(2024)Stakeholder Involvement for Responsible AI Development: A Process FrameworkProceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization10.1145/3689904.3694698(1-14)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3689904.3694698
Lin HKarusala NOkolo CD'Ignazio CGajos K(2024)"Come to us first": Centering Community Organizations in Artificial Intelligence for Social Good PartnershipsProceedings of the ACM on Human-Computer Interaction10.1145/36870098:CSCW2(1-28)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687009
Kawakami ACoston AHeidari HHolstein KZhu H(2024)Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and UseProceedings of the ACM on Human-Computer Interaction10.1145/36869898:CSCW2(1-24)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686989
Widder DDabbish LHerbsleb JMartelaro N(2024)Power and Play: Investigating "License to Critique" in Teams' AI Ethics DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/36869388:CSCW2(1-23)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686938
Constantinides MBogucka EQuercia DKallio STahaei M(2024)RAI Guidelines: Method for Generating Responsible AI Guidelines Grounded in Regulations and Usable by (Non-)Technical RolesProceedings of the ACM on Human-Computer Interaction10.1145/36869278:CSCW2(1-28)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686927
Popova KDemir APark JComber R(2024)Voicing Discomfort, Communicating Breakdowns: Design Exploration of Felt Ethics in a Body-Based WorkshopProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685375(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685375
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents