short-paper

Open access

Making AI Understandable by Making it Tangible: Exploring the Design Space with Ten Concept Cards

Authors:

Maliheh Ghajargar,

Jeffrey BardzellAuthors Info & Claims

OzCHI '22: Proceedings of the 34th Australian Conference on Human-Computer Interaction

Pages 74 - 80

https://doi.org/10.1145/3572921.3572942

Published: 06 April 2023 Publication History

All formats PDF

Abstract

The embodiment of Artificial Intelligence (AI) in everyday use products is raising challenges and opportunities for HCI and design research, such as human understandings of AI’s functions and states, passing back and forth of control, ethics, transparency and user experience. To respond to these challenges, HCI and design researchers have been working on research areas such as Explainable AI (XAI); Fairness, Accountability, and Transparency (FAccT); Human-Centered AI, as well as guidelines for Human-AI interaction design. Consequently, the interest in studying interaction modalities and their contributions to understandable and transparent AI has been growing. However, the tangible and embodied modality of interaction and more broadly studies of the forms of such everyday use products are relatively under-explored. This paper builds upon a larger project on designing graspable AI and it introduces a series of concept cards that aim to aid design researchers’ creative and critical exploration of tangible and understandable AI space. We conducted a user study in two parts of online sessions and semi-structured interviews and found out that to envision physicality and tangible interaction with AI felt challenging and “too abstract”. Even so, the act of creative exploration of that space not only supported the participants to gain new design perspectives, but also supported them to go beyond anthropomorphic forms of AI.

References

[1]

Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3173574.3174156

Digital Library

[2]

Philip Adu. 2019. A Step-by-Step Guide to Qualitative Data Coding (1st edition ed.). Routledge, New York.

[3]

Christopher Alexander. 1964. Notes on the Synthesis of Form. Harvard University Press, Cambridge, Mass.

[4]

Christopher Alexander. 2002. The Process of Creating Life: Nature of Order, Book 2: An Essay on the Art of Building and the Nature of the Universe (1st edition ed.). Center for Environmental Structure, Berkeley, Calif.

[5]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, Glasgow, Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300233

Digital Library

[6]

Jeffrey Bardzell. 2007. Creativity in Amateur Multimedia : Popular Culture, Critical Theory, and HCI. Human Technology: An Interdisciplinary Journal on Humans in ICT Environments (2007). https://jyx.jyu.fi/handle/123456789/20201 Accepted: 2009-06-02T11:52:40Z Publisher: University of Jyväskylä, Agora Center.

[7]

Jeffrey Bardzell. 2009. Interaction criticism and aesthetics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’09). Association for Computing Machinery, New York, NY, USA, 2357–2366. https://doi.org/10.1145/1518701.1519063

Digital Library

[8]

Jekaterina Belakova and Wendy E. Mackay. 2021. SonAmi: A Tangible Creativity Support Tool for Productive Procrastination. In Creativity and Cognition(C&C ’21). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3450741.3465250

Digital Library

[9]

Clive Bell. 2011. Art. CreateSpace Independent Publishing Platform, Charleston, SC.

[10]

Michael Mose Biskjaer, Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, and Peter Dalsgaard. 2019. How Time Constraints in a Creativity Support Tool Affect the Creative Writing Experience. In Proceedings of the 31st European Conference on Cognitive Ergonomics(ECCE 2019). Association for Computing Machinery, New York, NY, USA, 100–107. https://doi.org/10.1145/3335082.3335084

Digital Library

[11]

Pedro Campos, Frederica Gonçalves, Michael Martins, Miguel Campos, and Paulo Freitas. 2014. Second look: combining wearable computing and crowdsourcing to support creative writing. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational(NordiCHI ’14). Association for Computing Machinery, New York, NY, USA, 959–962. https://doi.org/10.1145/2639189.2670250

Digital Library

[12]

Alison Cawsey. 1993. User modelling in interactive explanations. User Modeling and User-Adapted Interaction 3, 3 (Sept. 1993), 221–247. https://doi.org/10.1007/BF01257890

[13]

Erin Cherry and Celine Latulipe. 2014. Quantifying the Creativity Support of Digital Tools through the Creativity Support Index. ACM Transactions on Computer-Human Interaction 21, 4 (June 2014), 21:1–21:25. https://doi.org/10.1145/2617588

Digital Library

[14]

Stefan Cronholm and Hannes Göbel. 2022. DESIGN PRINCIPLES FOR HUMAN-CENTRED AI. ECIS 2022 Research Papers (June 2022). https://aisel.aisnet.org/ecis2022_rp/32

[15]

Mihaly Csikszentmihalyi. 2013. Creativity: Flow and the Psychology of Discovery and Invention (reprint edition ed.). Harper Perennial, New York.

[16]

Peter Dalsgaard, Christian Remy, Jonas Frich Pedersen, Lindsay MacDonald Vermeulen, and Michael Mose Biskjaer. 2018. Digital tools in collaborative creative work. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction(NordiCHI ’18). Association for Computing Machinery, New York, NY, USA, 964–967. https://doi.org/10.1145/3240167.3240262

Digital Library

[17]

Meredith Davis and Jamer Hunt. 2017. Visual Communication Design: An Introduction to Design Concepts in Everyday Experience. Bloomsbury Visual Arts, London.

[18]

John J. Dudley and Per Ola Kristensson. 2018. A Review of User Interface Design for Interactive Machine Learning. ACM Transactions on Interactive Intelligent Systems 8, 2 (June 2018), 8:1–8:37. https://doi.org/10.1145/3185517

Digital Library

[19]

Michael D Ekstrand, Robin Burke, and Fernando Diaz. 2019. Fairness and discrimination in recommendation and retrieval. In Proceedings of the 13th ACM Conference on Recommender Systems(RecSys ’19). Association for Computing Machinery, New York, NY, USA, 576–577. https://doi.org/10.1145/3298689.3346964

Digital Library

[20]

Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the Landscape of Creativity Support Tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, 389:1–389:18. https://doi.org/10.1145/3290605.3300619

Digital Library

[21]

Maliheh Ghajargar and Jeffrey Bardzell. 2021. Synthesis of Forms: Integrating Practical and Reflective Qualities in Design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Number 614. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3411764.3445232

Digital Library

[22]

Maliheh Ghajargar, Jeffrey Bardzell, Alison Smith Renner, Peter Gall Krogh, Kristina Höök, David Cuartielles, Laurens Boer, and Mikael Wiberg. 2021. From "Explainable AI" to "Graspable AI". In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’21). Association for Computing Machinery, Salzburg, Austria, 1–4. https://doi.org/10.1145/3430524.3442704

Digital Library

[23]

Maliheh Ghajargar, Jeffrey Bardzell, Alison Marie Smith-Renner, Kristina Höök, and Peter Gall Krogh. 2022. Graspable AI: Physical Forms as Explanation Modality for Explainable AI. In Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’22). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3490149.3503666

Digital Library

[24]

Kim Halskov and Peter Dalsgård. 2006. Inspiration card workshops. In Proceedings of the 6th conference on Designing Interactive systems(DIS ’06). Association for Computing Machinery, New York, NY, USA, 2–11. https://doi.org/10.1145/1142405.1142409

Digital Library

[25]

Eva Hornecker. 2010. Creative idea exploration within the structure of a guiding framework: the card brainstorming game. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction(TEI ’10). Association for Computing Machinery, New York, NY, USA, 101–108. https://doi.org/10.1145/1709886.1709905

Digital Library

[26]

K. Höök. 2000. Steps to take before intelligent user interfaces become real. Interacting with Computers 12, 4 (Feb. 2000), 409–426. https://doi.org/10.1016/S0953-5438(99)00006-5

[27]

Joy Kim, Avi Bagla, and Michael S. Bernstein. 2015. Designing Creativity Support Tools for Failure. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition(C&C ’15). Association for Computing Machinery, New York, NY, USA, 157–160. https://doi.org/10.1145/2757226.2764542

Digital Library

[28]

Klaus Krippendorff. 2005. The Semantic Turn: A New Foundation for Design (1 edition ed.). CRC Press, Boca Raton.

[29]

Todd Kulesza, Margaret Burnett, Weng-Keen Wong, and Simone Stumpf. 2015. Principles of Explanatory Debugging to Personalize Interactive Machine Learning. In Proceedings of the 20th International Conference on Intelligent User Interfaces(IUI ’15). Association for Computing Machinery, Atlanta, Georgia, USA, 126–137. https://doi.org/10.1145/2678025.2701399

Digital Library

[30]

Don Norman. 2013. The Design of Everyday Things: Revised and Expanded Edition (revised editioned.). Basic Books, New York, New York.

[31]

Alun Preece. 2018. Asking ‘Why’ in AI: Explainability of intelligent systems – perspectives and challenges. Intelligent Systems in Accounting, Finance and Management 25, 2(2018), 63–72. https://doi.org/10.1002/isaf.1422 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/isaf.1422.

Digital Library

[32]

Marco C. Rozendaal, Maliheh Ghajargar, Gert Pasman, and Mikael Wiberg. 2018. Giving Form to Smart Objects: Exploring Intelligence as an Interaction Design Material. In New Directions in Third Wave Human-Computer Interaction: Volume 1 - Technologies, Michael Filimowicz and Veronika Tzankova (Eds.). Springer International Publishing, Cham, 25–42. https://doi.org/10.1007/978-3-319-73356-2_3

[33]

Ben Shneiderman. 2007. Creativity support tools: accelerating discovery and innovation. Commun. ACM 50, 12 (Dec. 2007), 20–32. https://doi.org/10.1145/1323688.1323689

Digital Library

[34]

Alison Smith-Renner, Varun Kumar, Jordan Boyd-Graber, Kevin Seppi, and Leah Findlater. 2020. Digging into user control: perceptions of adherence and instability in transparent models. In Proceedings of the 25th International Conference on Intelligent User Interfaces(IUI ’20). Association for Computing Machinery, Cagliari, Italy, 519–530. https://doi.org/10.1145/3377325.3377491

Digital Library

[35]

Brandon Taylor. 2020. The Life of Forms in Art: Modernism, Organism, Vitality (1st edition ed.). Bloomsbury Visual Arts.

[36]

Shari Trewin, Sara Basson, Michael Muller, Stacy Branham, Jutta Treviranus, Daniel Gruen, Daniel Hebert, Natalia Lyckowski, and Erich Manser. 2019. Considerations for AI fairness for people with disabilities. AI Matters 5, 3 (Dec. 2019), 40–63. https://doi.org/10.1145/3362077.3362086

Digital Library

[37]

Niels van Berkel, Mikael B. Skov, and Jesper Kjeldskov. 2021. Human-AI interaction: intermittent, continuous, and proactive. Interactions 28, 6 (Nov. 2021), 67–71. https://doi.org/10.1145/3486941

Digital Library

[38]

Colin Ware. 2008. Visual Thinking for Design(1st edition ed.). Morgan Kaufmann, Burlington, Mass. Amsterdam.

[39]

Andrew Warr and Eamonn O’Neill. 2007. Tool support for creativity using externalizations. In Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition(C&C ’07). Association for Computing Machinery, New York, NY, USA, 127–136. https://doi.org/10.1145/1254960.1254979

Digital Library

Cited By

Raftopoulos M(2024)Designing Tiny Robots: Engaging Stakeholders in Collaborative AI System DesignProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681722(121-132)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3681722
Murray-Rust DLupetti MNicenboim IHoog W(2024)Grasping AI: experiential exercises for designersAI & Society10.1007/s00146-023-01794-y39:6(2891-2911)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s00146-023-01794-y
Colley AKalving MHäkkilä JVäänänen K(2023)Exploring Tangible Explainable AI (TangXAI): A User Study of Two XAI ApproachesProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638426(679-683)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638426

Index Terms

Making AI Understandable by Making it Tangible: Exploring the Design Space with Ten Concept Cards
1. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design
    2. Interaction design theory, concepts and paradigms

Recommendations

Questioning the AI: Informing Design Practices for Explainable AI User Experiences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

A surge of interest in explainable AI (XAI) has led to a vast collection of algorithmic work on the topic. While many recognize the necessity to incorporate explainability features in AI systems, how to address real-world user needs for understanding AI ...
Tangible Explainable AI - an Initial Conceptual Framework
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia

Artificial Intelligence (AI) solutions are becoming prevalent in almost all aspects of human life. However, their acceptance may be limited by a lack of transparency of how the AI works. Explainable AI (XAI) aims to provide the users of AI systems with ...
Exploring Tangible Explainable AI (TangXAI): A User Study of Two XAI Approaches
OzCHI '23: Proceedings of the 35th Australian Computer-Human Interaction Conference

Explainable AI (XAI) has garnered significant attention as a theoretical subject in the research community. However, the practical application of XAI, particularly in the realm of user interfaces, remains limited. Moreover, evaluations of these ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '22: Proceedings of the 34th Australian Conference on Human-Computer Interaction

November 2022

373 pages

ISBN:9798400700248

DOI:10.1145/3572921

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution-NoDerivatives International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2023

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

OzCHI '22

OzCHI '22: 34th Australian Conference on Human-Computer Interaction

November 29 - December 2, 2022

ACT, Canberra, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
868
Total Downloads

Downloads (Last 12 months)551
Downloads (Last 6 weeks)65

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Raftopoulos M(2024)Designing Tiny Robots: Engaging Stakeholders in Collaborative AI System DesignProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681722(121-132)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3681722
Murray-Rust DLupetti MNicenboim IHoog W(2024)Grasping AI: experiential exercises for designersAI & Society10.1007/s00146-023-01794-y39:6(2891-2911)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s00146-023-01794-y
Colley AKalving MHäkkilä JVäänänen K(2023)Exploring Tangible Explainable AI (TangXAI): A User Study of Two XAI ApproachesProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638426(679-683)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638426

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten