research-article

Open access

Who Should Act? Distancing and Vulnerability in Technology Practitioners' Accounts of Ethical Responsibility

Authors:

Kristina Popova,

Clàudia Figueras,

Kristina Höök,

Airi LampinenAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 8, Issue CSCW1

Article No.: 157, Pages 1 - 27

https://doi.org/10.1145/3637434

Published: 26 April 2024 Publication History

Abstract

Attending to emotion can shed light on why recognizing an ethical issue and taking responsibility for it can be so demanding. To examine emotions related to taking or not taking responsibility for ethical action, we conducted a semi-structured interview study with 23 individuals working in interaction design and developing AI systems in Scandinavian countries. Through a thematic analysis of how participants attribute ethical responsibility, we identify three ethical stances, that is, discursive approaches to answering the question 'who should act': an individualised I-stance ("the responsibility is mine"), a collective we-stance ("the responsibility is ours"), and a distanced they-stance ("the responsibility is someone else's"). Further, we introduce the concepts of distancing and vulnerability to analyze the emotion work that these three ethical stances place on technology practitioners in situations of low- and high-scale technology development, where they have more or less control over the outcomes of their work. We show how the we- and they-stances let technology practitioners distance themselves from the results of their activity, while the I-stance makes them more vulnerable to emotional and material risks. By illustrating the emotional dimensions involved in recognizing ethical issues and embracing responsibility, our study contributes to the field of Ethics in Practice. We argue that emotions play a pivotal role in technology practitioners' decision-making process, influencing their choices to either take action or refrain from doing so.

References

[1]

AI-HLEG. 2019. Ethics Guidelines for Trustworthy AI. Text. European Commission. https://ec.europa.eu/digitalsingle-market/en/news/ethics-guidelines-trustworthy-ai

[2]

Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2022. Machine bias. In Ethics of Data and Analytics. Auerbach Publications, New York, US, 254--264.

[3]

Maria Arnelid, Katherine Harrison, and Ericka Johnson. 2022. What Does It Mean to Measure a Smile? Assigning numerical values to emotions. Valuation Studies 9, 1 (Dec. 2022), 79--107. https://doi.org/10.3384/VS.2001--5992.2022.9.1.79--107

[4]

Madeline Balaam, Rob Comber, Rachel E. Clarke, Charles Windlin, Anna Ståhl, Kristina Höök, and Geraldine Fitzpatrick. 2019. Emotion Work in Experience-Centered Design. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300832

Digital Library

[5]

Stephanie Ballard, Karen M. Chappell, and Kristen Kennedy. 2019. Judgment Call the Game: Using Value Sensitive Design and Design Fiction to Surface Ethical Concerns Related to Technology. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS '19). Association for Computing Machinery, New York, NY, USA, 421--433. https://doi.org/10.1145/3322276.3323697

Digital Library

[6]

Jeffrey Bardzell and Shaowen Bardzell. 2013. What is "Critical" about Critical Design?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3297--3306. https://doi.org/10.1145/2470654.2466451

Digital Library

[7]

Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). Association for Computing Machinery, New York, NY, USA, 1301--1310. https://doi.org/10.1145/1753326.1753521

Digital Library

[8]

Saba Bazargan-Forward and Deborah Tollefsen (Eds.). 2020. The Routledge Handbook of Collective Responsibility. Routledge, New York, NY, USA. https://doi.org/10.4324/9781315107608

[9]

Robert D. Benford and David A. Snow. 2000. Framing Processes and Social Movements: An Overview and Assessment. Annual Review of Sociology 26 (2000), 611--639. http://www.jstor.org/stable/223459

[10]

Ruha Benjamin. 2019. Race after technology: abolitionist tools for the new Jim code. Polity, Medford, MA.

[11]

Janne Mascha Beuthel. 2022. The Armor of a Researcher: A Critical, Material Engagement with Somatic Experiences. Revista Diseña 20, 3 (2022). https://doi.org/10.7764/disena.20.article.3

[12]

Geoffrey C Bowker and Susan Leigh Star. 2000. Sorting things out: Classification and its consequences. MIT press, Cambridge, Massachusetts, USA.

Digital Library

[13]

Karen L. Boyd and Katie Shilton. 2021. Adapting Ethical Sensitivity as a Construct to Study Technology Design Teams. Proceedings of the ACM on Human-Computer Interaction 5, GROUP (July 2021), 217. https://doi.org/10.1145/3463929

Digital Library

[14]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (Jan. 2006), 77--101. https://doi.org/10.1191/1478088706qp063oa

[15]

Barry Brown, Susanne Bødker, and Kristina Höök. 2017. Does HCI Scale? Scale Hacking and the Relevance of HCI. Interactions 24, 5 (aug 2017), 28--33. https://doi.org/10.1145/3125387

Digital Library

[16]

Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, Nice, France, 77--91. https://proceedings.mlr.press/v81/buolamwini18a.html

[17]

Kathryn Bushby, Jody Chan, Shawna Druif, Kim Ho, and Elizabeth Anne Kinsella. 2015. Ethical tensions in occupational therapy practice: A scoping review. British Journal of Occupational Therapy 78, 4 (2015), 212--221. https://doi.org/10.1177/0308022614564770 arXiv:https://doi.org/10.1177/0308022614564770

[18]

Shruthi Sai Chivukula, Colin M. Gray, and Jason A. Brier. 2019. Analyzing Value Discovery in Design Decisions Through Ethicography. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300307

Digital Library

[19]

Shruthi Sai Chivukula, Chris Rhys Watkins, Rhea Manocha, Jingle Chen, and Colin M. Gray. 2020. Dimensions of UX Practice that Shape Ethical Awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376459

Digital Library

[20]

Victoria Clarke and Virginia Braun. 2021. Thematic analysis: a practical guide. SAGE Publications Ltd. 1--100 pages.

[21]

Mark Coeckelbergh. 2020. Artificial Intelligence, Responsibility Attribution, and a Relational Justification of Explainability. Science and Engineering Ethics 26, 4 (Oct. 2020), 2051--2068. https://doi.org/10.1007/s11948-019-00146--8

[22]

Sasha Costanza-Chock. 2020. Design justice: community-led practices to build the worlds we need. The MIT Press, Cambridge, Massachusetts, USA.

[23]

Kate Crawford and Vladan Joler. 2018. Anatomy of an AI System: The Amazon Echo As An Anatomical Map of Human Labor, Data and Planetary Resources. https://anatomyof.ai

[24]

Maria Puig de La Bellacasa. 2017. Matters of care: Speculative ethics in more than human worlds. Vol. 41. U of Minnesota Press.

[25]

Laura Devendorf, Kristina Andersen, and Aisling Kelliher. 2020. Making Design Memoirs: Understanding and Honoring Difficult Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3313831.3376345

Digital Library

[26]

Catherine D'Ignazio and Lauren F. Klein. 2020. Data feminism. The MIT Press, Cambridge, Massachusetts, USA.

[27]

Virginia Dignum. 2019. Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way. Springer, Cham. https://doi.org/10.1007/978--3-030--30371--6

[28]

Joseph Dumit. 2014. Writing the implosion: teaching the world one thing at a time. Cultural Anthropology 29, 2 (2014), 344--362.

[29]

Arturo Escobar. 2018. Designs for the Pluriverse: Radical Interdependence, Autonomy, and the Making of Worlds. Duke University Press, New York, USA.

[30]

Casey Fiesler. 2021. Innovating like an Optimist, Preparing like a Pessimist: Ethical Speculation and the Legal Imagination. Colorado Technology Law Journal 19, 1 (2021), 1--18.

[31]

Clàudia Figueras, Harko Verhagen, and Teresa Cerratto Pargman. 2022. Exploring tensions in Responsible AI in practice: An interview study on AI practices in and for Swedish public organizations. Scandinavian Journal of Information Systems 34, 2 (2022), 6.

[32]

Mary Flanagan, Daniel C. Howe, and Helen Nissenbaum. 2005. Values at Play: Design Tradeoffs in Socially-Oriented Game Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI '05). Association for Computing Machinery, New York, NY, USA, 751--760. https://doi.org/10.1145/1054972.1055076

Digital Library

[33]

Christopher Frauenberger, Marjo Rauhala, and Geraldine Fitzpatrick. 2017. In-Action Ethics. Interacting with Computers 29, 2 (2017), 220--236. https://doi.org/10.1093/iwc/iww024

[34]

Batya Friedman. 1996. Value-Sensitive Design. Interactions 3, 6 (dec 1996), 16--23. https://doi.org/10.1145/242485.242493

Digital Library

[35]

Batya Friedman and David Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. The MIT Press, Cambridge, Massachusetts, USA.

[36]

Batya Friedman, Daniel C Howe, and Edward Felten. 2002. Informed consent in the Mozilla browser: implementing value-sensitive design. In Proceedings of the 35th Annual Hawaii International Conference on System Sciences. IEEE Comput. Soc, Big Island, HI, USA, 10. https://doi.org/10.1109/HICSS.2002.994366

[37]

Batya Friedman, Peter H. Kahn Jr., Jennifer Hagman, Rachel L. Severson, and Brian Gill. 2006. The Watcher and the Watched: Social Judgments About Privacy in a Public Place. Human--Computer Interaction 21, 2 (2006), 235--272. https://doi.org/10.1207/s15327051hci2102_3

Digital Library

[38]

Batya Friedman, Peter H. Khan, and Daniel C. Howe. 2000. Trust Online. Commun. ACM 43, 12 (dec 2000), 34--40. https://doi.org/10.1145/355112.355120

Digital Library

[39]

Rachael Garrett, Kristina Popova, Claudia Núñez-Pacheco, Thorhildur Asgeirsdottir, Airi Lampinen, and Kristina Höök. 2023. Felt Ethics: Cultivating Ethical Sensibility in Design Practice. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 1, 15 pages. https://doi.org/10.1145/3544548.3580875

Digital Library

[40]

Carol Gilligan. 1977. In a different voice: Women's conceptions of self and of morality. Harvard educational review 47, 4 (1977), 481--517.

[41]

Lisa Gitelman (Ed.). 2013. "Raw data" is an oxymoron. The MIT Press, Cambridge, Massachusetts, USA.

[42]

Colin M Gray and Shruthi Sai Chivukula. 2019. Ethical Mediation in UX Practice. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--11. https://doi.org/10.1145/3290605.3300408

Digital Library

[43]

Colin M. Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L. Toombs. 2018. The Dark (Patterns) Side of UX Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3173574.3174108

Digital Library

[44]

ColinMGray, Austin L Toombs, Ann Light, and John Vines. 2018. Editorial: Ethics, Values, and Designer Responsibility. In Design as a catalyst for change, C Storni, K Leahy, M McMahon, P Lloyd, and E Bohemia (Eds.). DRS International Conference 2018, Limerick, Ireland. https://doi.org/10.21606/drs.2018.003

[45]

Daniel Greene, Anna Lauren Hoffmann, and Luke Stark. 2019. Better, Nicer, Clearer, Fairer: A Critical Assessment of the Movement for Ethical Artificial Intelligence and Machine Learning. In Proceedings of the 52nd Hawaii International Conference on System Sciences. IEEE Computer Society Press, Hawaii, USA, 2122--2131. https://doi.org/10.24251/HICSS.2019.258

[46]

Thilo Hagendorff. 2020. The Ethics of AI Ethics: An Evaluation of Guidelines. Minds and Machines 30, 1 (2020), 99--120. https://doi.org/10.1007/s11023-020-09517--8

Digital Library

[47]

Sandra Harding. 2015. Objectivity and diversity. Another Logic of Scientific Research. University of Chicago Press, Chicago, USA.

[48]

Karey Helms. 2022. A Speculative Ethics for Designing with Bodily Fluids. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA '22). Association for Computing Machinery, New York, NY, USA, Article 13, 11 pages. https://doi.org/10.1145/3491101.3516395

Digital Library

[49]

Arlie Russel Hochschild. 2012. The managed heart: commercialization of human feeling (updated ed ed.). University of California Press, Berkeley, Calif. London.

[50]

James Hodge, Sarah Foley, Rens Brankaert, Gail Kenning, Amanda Lazar, Jennifer Boger, and Kellie Morrissey. 2020. Relational, Flexible, Everyday: Learning from Ethics in Dementia Research. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--16. https://doi.org/10.1145/3313831.3376627

Digital Library

[51]

David Holman, David Martinez-Iñigo, and Peter Totterdell. 2008. Emotional Labour and Employee Well-being: An Integrative Review. In Research Companion to Emotion in Organizations, Neal M Ashkanasy and Cary L Cooper (Eds.). Edward Elgar Publishing, Cheltenham, UK, Chapter 18, 301--316.

[52]

Kristina Höök. 2018. Designing with the body: Somaesthetic interaction design. MIT Press, Cambridge, MA, USA.

[53]

Kristina Höök, Baptiste Caramiaux, Cumhur Erkut, Jodi Forlizzi, Nassrin Hajinejad, Michael Haller, Caroline Hummels, Katherine Isbister, Martin Jonsson, George Khut, Lian Loke, Danielle Lottridge, Patrizia Marti, Edward Melcer, Florian Müller, Marianne Petersen, Thecla Schiphorst, Elena Segura, Anna Ståhl, Dag Svanæs, Jakob Tholander, and Helena Tobiasson. 2018. Embracing First-Person Perspectives in Soma-Based Design. Informatics 5, 1 (Feb. 2018), 8. https://doi.org/10.3390/informatics5010008

[54]

Kristina Höök, Sara Eriksson, Marie Louise Juul Søndergaard, Marianela Ciolfi Felice, Nadia Campo Woytuk, Ozgun Kilic Afsar, Vasiliki Tsaknaki, and Anna Ståhl. 2019. Soma Design and Politics of the Body. In Proceedings of the Halfway to the Future Symposium 2019 (Nottingham, United Kingdom) (HTTF 2019). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/3363384.3363385

Digital Library

[55]

Noura Howell, Audrey Desjardins, and Sarah Fox. 2021. Cracks in the Success Narrative: Rethinking Failure in Design Research through a Retrospective Trioethnography. ACM Trans. Comput.-Hum. Interact. 28, 6, Article 42 (nov 2021), 31 pages. https://doi.org/10.1145/3462447

Digital Library

[56]

Anna Jobin, Marcello Ienca, and Effy Vayena. 2019. The global landscape of AI ethics guidelines. Nature Machine Intelligence 1, 9 (Sept. 2019), 389--399. https://doi.org/10.1038/s42256-019-0088--2

[57]

Laura Kalbag and Aral Balkan. 2017. Ethical Design Manifesto by ind.ie. https://ind.ie/ethical-design/

[58]

Pratyusha Kalluri. 2020. Don't ask if artificial intelligence is good or fair, ask how it shifts power. Nature 583, 7815 (July 2020), 169--169. https://doi.org/10.1038/d41586-020-02003--2

[59]

Emre Kazim and Adriano Soares Koshiyama. 2021. A high-level overview of AI ethics. Patterns 2, 9 (Sept. 2021), 100314. https://doi.org/10.1016/j.patter.2021.100314

[60]

Carly Kind. 2020. The term ?ethical AI' is finally starting to mean something. https://venturebeat.com/2020/08/23/theterm-ethical-ai-is-finally-starting-to-mean-something/

[61]

Max Liboiron. 2021. Pollution Is Colonialism. Duke University Press. https://doi.org/10.2307/j.ctv1jhvnk1

[62]

Max Liboiron, Emily Simmonds, Edward Allen, Emily Wells, Jessica Melvin, Alex Zahara, and Charles Mather. 2021. Doing Ethics with Cod. In Making & Doing: Activating STS through Knowledge Expression and Travel. The MIT Press. https://doi.org/10.7551/mitpress/11310.003.0009

[63]

Ann Light, Alison Powell, and Irina Shklovski. 2017. Design for Existential Crisis in the Anthropocene Age. In Proceedings of the 8th International Conference on Communities and Technologies (C&T '17). Association for Computing Machinery, New York, NY, USA, 270--279. https://doi.org/10.1145/3083671.3083688

Digital Library

[64]

Sharon Lindberg, Petter Karlström, and Sirkku Männikkö Barbutiu. 2021. Design Ethics in Practice - Points of Departure. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 130 (apr 2021), 19 pages. https://doi.org/10.1145/3449204

Digital Library

[65]

Michael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, and Hanna Wallach. 2020. Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376445

Digital Library

[66]

Jacob Metcalf, Emanuel Moss, and danah boyd. 2019. Owning Ethics: Corporate Logics, Silicon Valley, and the Institutionalization of Ethics. Social Research: An International Quarterly 86, 2 (2019), 449--476. https://muse.jhu.edu/article/732185

[67]

Brent Mittelstadt. 2019. Principles alone cannot guarantee ethical AI. Nature Machine Intelligence 1, 11 (Nov. 2019), 501--507. https://doi.org/10.1038/s42256-019-0114--4

[68]

Shakir Mohamed, Marie-Therese Png, and William Isaac. 2020. Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence. Philosophy & Technology 33, 4 (2020), 659--684.

[69]

Mike Monteiro and Vivianne Castillo. 2019. Ruined by design: how designers destroyed the world, and what we can do to fix it. Mule Design, Fresno.

[70]

Jessica Morley, Luciano Floridi, Libby Kinsey, and Anat Elhalal. 2020. From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices. Science and Engineering Ethics 26, 4 (Aug. 2020), 2141--2168. https://doi.org/10.1007/s11948-019-00165--5

[71]

Chris Nodder. 2013. Evil by design: Interaction design to lead us into temptation. John Wiley & Sons, Indianapolis, USA.

Digital Library

[72]

Nel Noddings. 2013. Caring: A Relational Approach to Ethics and Moral Education (2 ed.). University of California Press, Berkeley, California. http://www.jstor.org/stable/10.1525/j.ctt7zw1nb

[73]

Giovanna Nunes Vilaza, Kevin Doherty, Darragh McCashin, David Coyle, Jakob Bardram, and Marguerite Barry. 2022. A Scoping Review of Ethics Across SIGCHI. In Designing Interactive Systems Conference (DIS '22). Association for Computing Machinery, New York, NY, USA, 137--154. https://doi.org/10.1145/3532106.3533511

Digital Library

[74]

Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (Oct. 2019), 447--453. https://doi.org/10.1126/science.aax2342

[75]

The IEEE Global Initiative on Ethics of Autonomous and Intelligent System. 2019. Ethically Aligned Design: A vision for prioritizing human well-being with autonomous and intelligent systems, First edition. Technical Report. IEEE. https://ethicsinaction.ieee.org/

[76]

Victor J. Papanek. 1985. Design for the real world: human ecology and social change (2nd ed., completely rev ed.). Academy Chicago, Chicago, Ill.

[77]

Samir Passi and Steven J. Jackson. 2018. Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 1--28. https://doi.org/10.1145/3274405

Digital Library

[78]

Samir Passi and Phoebe Sengers. 2020. Making data science systems work. Big Data & Society 7, 2 (2020), 2053951720939605. https://doi.org/10.1177/2053951720939605 arXiv:https://doi.org/10.1177/2053951720939605

[79]

Ajit G. Pillai, Thida Sachathep, and Naseem Ahmadpour. 2022. Exploring the Experience of Ethical Tensions and the Role of Community in UX Practice. In Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI '22). Association for Computing Machinery, New York, NY, USA, Article 60, 13 pages. https://doi.org/10.1145/3546155.3546683

Digital Library

[80]

Clémence Pinel, Barbara Prainsack, and Christopher McKevitt. 2020. Caring for data: Value creation in a data-intensive research laboratory. Social Studies of Science 50, 2 (2020), 175--197. https://doi.org/10.1177/0306312720906567 32053062.

[81]

Marie-Therese Png. 2022. At the Tensions of South and North: Critical Roles of Global South Stakeholders in AI Governance. In 2022 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, NY, USA, 1434--1445. https://doi.org/10.1145/3531146.3533200

Digital Library

[82]

Kristina Popova, Rachael Garrett, Claudia Núñez Pacheco, Airi Lampinen, and Kristina Höök. 2022. Vulnerability as an Ethical Stance in Soma Design Processes. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 178, 13 pages. https://doi.org/10.1145/3491102.3501994

Digital Library

[83]

Alison B Powell, Funda Ustek-Spilda, Sebastián Lehuedé, and Irina Shklovski. 2022. Addressing ethical gaps in ?Technology for Good': Foregrounding care and capabilities. Big Data & Society 9, 2 (2022), 20539517221113774. https://doi.org/10.1177/20539517221113774 arXiv:https://doi.org/10.1177/20539517221113774

[84]

Bogdana Rakova, Jingying Yang, Henriette Cramer, and Rumman Chowdhury. 2021. Where Responsible AI Meets Reality: Practitioner Perspectives on Enablers for Shifting Organizational Practices. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 7 (apr 2021), 23 pages. https://doi.org/10.1145/3449081

Digital Library

[85]

Samar Sabie and Tapan Parikh. 2019. Cultivating Care through Ambiguity: Lessons from a Service Learning Course. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300507

Digital Library

[86]

Nithya Sambasivan, Erin Arnesen, Ben Hutchinson, Tulsee Doshi, and Vinodkumar Prabhakaran. 2021. Re-imagining Algorithmic Fairness in India and Beyond. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT '21). Association for Computing Machinery, New York, NY, USA, 315--328. https://doi.org/10.1145/3442188.3445896

Digital Library

[87]

Filippo Santoni de Sio and Giulio Mecacci. 2021. Four Responsibility Gaps with Artificial Intelligence: Why they Matter and How to Address them. Philosophy & Technology 34, 4 (Dec. 2021), 1057--1084. https://doi.org/10.1007/s13347-021-00450-x

[88]

Daniel Schiff, Bogdana Rakova, Aladdin Ayesh, Anat Fanti, and Michael Lennon. 2021. Explaining the Principles to Practices Gap in AI. IEEE Technology and Society Magazine 40, 2 (June 2021), 81--94. https://doi.org/10.1109/MTS.2021.3056286 Conference Name: IEEE Technology and Society Magazine.

[89]

Nick Seaver. 2021. Care and Scale: Decorrelative Ethics in Algorithmic Recommendation. Cultural Anthropology 36, 3 (Aug. 2021), 509--537. https://doi.org/10.14506/ca36.3.11 Number: 3.

[90]

Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph 'Jofish' Kaye. 2005. Reflective Design. In Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility (Aarhus, Denmark) (CC '05). Association for Computing Machinery, New York, NY, USA, 49--58. https://doi.org/10.1145/1094562.1094569

Digital Library

[91]

Katie Shilton. 2013. Values Levers: Building Ethics into Design. Science, Technology, & Human Values 38, 3 (May 2013), 374--397. https://doi.org/10.1177/0162243912436985

[92]

Irina Shklovski and Carolina Némethy. 2022. Nodes of certainty and spaces for doubt in AI ethics for engineers. Information, Communication & Society 0, 0 (Jan. 2022), 1--17. https://doi.org/10.1080/1369118X.2021.2014547

[93]

Robert Soden, David Ribes, Seyram Avle, and Will Sutherland. 2021. Time for Historicism in CSCW: An Invitation. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 459 (oct 2021), 18 pages. https://doi.org/10.1145/3479603

Digital Library

[94]

Katta Spiel. 2018. Evaluating Experiences of Autistic Children with Technologies in Co-Design. Doctor of Technical Sciences. Vienna University of Technology (TU Wien), Vienna, Austria. Publisher: Gesellschaft für Informatik eV.

[95]

Katta Spiel, Emeline Brulé, Christopher Frauenberger, Gilles Bailly, and Geraldine Fitzpatrick. 2018. Micro-Ethics for Participatory Design with Marginalised Children. In Proceedings of the 15th Participatory Design Conference: Full Papers - Volume 1 (Hasselt and Genk, Belgium) (PDC '18). Association for Computing Machinery, New York, NY, USA, Article 17, 12 pages. https://doi.org/10.1145/3210586.3210603

Digital Library

[96]

Anna Ståhl, Vasiliki Tsaknaki, and Madeline Balaam. 2021. Validity and Rigour in Soma Design-Sketching with the Soma. ACM Transactions on Computer-Human Interaction (TOCHI) 28, 6 (2021), 1--36.

Digital Library

[97]

Luke Stark. 2019. Facial Recognition is the Plutonium of AI. XRDS 25, 3 (apr 2019), 50--55. https://doi.org/10.1145/3313129

Digital Library

[98]

Angelika Strohmayer, Mary Laing, and Rob Comber. 2017. Technologies and Social Justice Outcomes in Sex Work Charities: Fighting Stigma, Saving Lives. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3352--3364. https://doi.org/10.1145/3025453.3025615

Digital Library

[99]

Norman Makoto Su, Amanda Lazar, and Lilly Irani. 2021. Critical Affects: Tech Work Emotions Amidst the Techlash. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 179 (apr 2021), 27 pages.

Digital Library

[100]

Joan C. Tronto. 1993. Moral boundaries: a political argument for an ethic of care. Routledge, New York, USA.

[101]

Anna Lowenhaupt Tsing. 2015. The Mushroom at the End of the World: On the Possibility of Life in Capitalist Ruins. Princeton University Press.

[102]

Ibo van de Poel, Lambèr Royakkers, and Sjoerd D. Zwart. 2015. Moral Responsibility and the Problem of Many Hands (0 ed.). Routledge, New York, USA. https://doi.org/10.4324/9781315734217

[103]

Francisco J. Varela. 1999. Ethical know-how: action, wisdom, and cognition. Stanford University Press, Stanford, Calif.

[104]

Michael Veale, Max Van Kleek, and Reuben Binns. 2018. Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3173574.3174014

Digital Library

[105]

Jessica Vitak, Katie Shilton, and Zahra Ashktorab. 2016. Beyond the Belmont principles: Ethical challenges, practices, and beliefs in the online data research community. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing. ACM, San Francisco, USA, 941--953.

Digital Library

[106]

Sandra Wachter, Brent Mittelstadt, and Luciano Floridi. 2017. Transparent, explainable, and accountable AI for robotics. Science Robotics 2, 6 (may 2017), eaan6080. https://doi.org/10.1126/scirobotics.aan6080

[107]

David Gray Widder, Derrick Zhen, Laura Dabbish, and James Herbsleb. 2023. It's about Power: What Ethical Concerns Do Software Engineers Have, and What Do They (Feel They Can) Do about Them?. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (Chicago, IL, USA) (FAccT '23). Association for Computing Machinery, New York, NY, USA, 467--479. https://doi.org/10.1145/3593013.3594012

Digital Library

[108]

Langdon Winner. 1980. Do Artifacts Have Politics? Daedalus 109, 1 (1980), 121--136. http://www.jstor.org/stable/20024652

[109]

Richmond Y. Wong. 2021. Tactics of Soft Resistance in User Experience Professionals' Values Work. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 355 (oct 2021), 28 pages. https://doi.org/10.1145/3479499

Digital Library

[110]

Richmond Y. Wong, Michael A. Madaio, and Nick Merrill. 2023. Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics. Proc. ACM Hum.-Comput. Interact. 7, CSCW1, Article 145 (apr 2023), 27 pages. https://doi.org/10.1145/3579621

Digital Library

[111]

Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. Value-Sensitive Algorithm Design: Method, Case Study, and Lessons. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 1--23. https://doi.org/10.1145/3274463

Digital Library

[112]

Jarrett Zigon. 2007. Moral breakdown and the ethical demand: A theoretical framework for an anthropology of moralities. Anthropological Theory 7, 2 (2007), 131--150. https://doi.org/10.1177/1463499607077295

Cited By

Haapoja JSavolainen LReinikainen HLehtiniemi T(2024)Moral orders of pleasing the algorithmNew Media & Society10.1177/14614448241278674Online publication date: 11-Sep-2024
https://doi.org/10.1177/14614448241278674
Cha IPillai AWong R(2024)Ethics Pathways: A Design Activity for Reflecting on Ethics Engagement in HCI ResearchProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660714(3515-3533)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660714
Ma SZimmerman JFox SNisi VNunes N(2024)"My Sense of Morality Leads to My Suffering, Battling, and Arguing": The Role of Platform Designers in (Un)Deciding Gig Worker IssuesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660713(3501-3514)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660713

Index Terms

Who Should Act? Distancing and Vulnerability in Technology Practitioners' Accounts of Ethical Responsibility
1. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design

Recommendations

Ethical responsibilities: the smart card engineer
ETHICS '14: Proceedings of the IEEE 2014 International Symposium on Ethics in Engineering, Science, and Technology

Albert Einstein in one of his philosophical notes stated: "I do not believe in immortality of the individual, and I consider ethics to be an exclusively human concern with no superhuman authority behind it". Arguably, ethics does not necessarily mean ...
Mind the gap: responsible robotics and the problem of responsibility
Abstract
The task of this essay is to respond to the question concerning robots and responsibility—to answer for the way that we understand, debate, and decide who or what is able to answer for decisions and actions undertaken by increasingly interactive, ...
Narrative responsibility and artificial intelligence: How AI challenges human responsibility and sense-making
Abstract
Most accounts of responsibility focus on one type of responsibility, moral responsibility, or address one particular aspect of moral responsibility such as agency. This article outlines a broader framework to think about responsibility that ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 8, Issue CSCW1

CSCW

April 2024

6294 pages

EISSN:2573-0142

DOI:10.1145/3661497

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2024

Published in PACMHCI Volume 8, Issue CSCW1

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

WASP-HS

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
218
Total Downloads

Downloads (Last 12 months)218
Downloads (Last 6 weeks)63

Reflects downloads up to 13 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Haapoja JSavolainen LReinikainen HLehtiniemi T(2024)Moral orders of pleasing the algorithmNew Media & Society10.1177/14614448241278674Online publication date: 11-Sep-2024
https://doi.org/10.1177/14614448241278674
Cha IPillai AWong R(2024)Ethics Pathways: A Design Activity for Reflecting on Ethics Engagement in HCI ResearchProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660714(3515-3533)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660714
Ma SZimmerman JFox SNisi VNunes N(2024)"My Sense of Morality Leads to My Suffering, Battling, and Arguing": The Role of Platform Designers in (Un)Deciding Gig Worker IssuesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660713(3501-3514)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660713

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents