skip to main content
10.1145/3643834.3661577acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article
Open access

AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients

Published: 01 July 2024 Publication History

Abstract

Clients often partner with AI experts to develop AI applications tailored to their needs. In these partnerships, careful planning and clear communication are critical, as inaccurate or incomplete specifications can result in misaligned model characteristics, expensive reworks, and potential friction between collaborators. Unfortunately, given the complexity of requirements ranging from functionality, data, and governance, effective guidelines for collaborative specification of requirements in client-AI expert collaborations are missing. In this work, we introduce AINeedsPlanner, a workbook that AI experts and clients can use to facilitate effective interchange of clear specifications. The workbook is based on (1) an interview of 10 completed AI application project teams, which identifies and characterizes steps in AI application planning and (2) a study with 12 AI experts, which defines a taxonomy of AI experts’ information needs and dimensions that affect the information needs. Finally, we demonstrate the workbook’s utility with two case studies in real-world settings.

Supplemental Material

ZIP File
Supplemental Material The contents of the directory are as follows: - README.pdf: Description of the contents of the auxiliary materials. - Study: a folder including the materials around the Main Study in Section 4. - study-protocol.pdf: The protocol used when running the Main Study. - execution-preparation-document.pdf: The execution preparation document is used by recruited AI experts, who have it reviewed through simulated discussions based on a compiled list of real-world AI application ideas. - AINeedsPlanner.pdf: The AINeedsPlanner Workbook that is designed to facilitate effective collaboration between AI Experts and clients.

References

[1]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, UK). ACM, New York, USA, 1–13. https://doi.org/10.1145/3290605.3300233
[2]
Apple. 2022. Human Interface Guidelines - Human Interface Guidelines - Design - Apple Developer. Retrieved January 20, 2024 from https://developer.apple.com/design/human-interface-guidelines/guidelines/overview/
[3]
Amid Ayobi, Katarzyna Stawarz, Dmitri Katz, Paul Marshall, Taku Yamagata, Raúl Santos-Rodríguez, Peter Flach, and Aisling Ann O’Kane. 2021. Machine Learning Explanations as Boundary Objects: How AI Researchers Explain and Non-Experts Perceive Machine Learning. In 2021 Joint ACM Conference on Intelligent User Interfaces Workshops (College Station, USA). CEUR Workshop Proceedings, College Station, USA, 9 pages. http://ceur-ws.org/Vol-2903/IUI21WS-TExSS-3.pdf
[4]
Alex Bäuerle, Ángel Alexander Cabrera, Fred Hohman, Megan Maher, David Koski, Xavier Suau, Titus Barik, and Dominik Moritz. 2022. Symphony: Composing Interactive Interfaces for Machine Learning. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA). ACM, New York, USA, Article 210, 14 pages. https://doi.org/10.1145/3491102.3502102
[5]
Aditya Bharadwaj, Pao Siangliulue, Adam Marcus, and Kurt Luther. 2019. Critter: Augmenting Creative Work with Dynamic Checklists, Automated Quality Assurance, and Contextual Reviewer Feedback. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, UK). ACM, New York, USA, 1–12. https://doi.org/10.1145/3290605.3300769
[6]
Veronika Bogina, Alan Hartman, Tsvi Kuflik, and Avital Shulner-Tal. 2021. Educating Software and AI Stakeholders about Algorithmic Fairness, Accountability, Transparency and Ethics. International Journal of Artificial Intelligence in Education 32 (2021), 1–26. https://doi.org/10.1007/s40593021002480
[7]
Carrie J. Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. "Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proceedings of the ACM on Human-Computer Interaction 3 (2019), 1–24. https://doi.org/10.1145/3359206
[8]
Paul R. Carlile. 2002. A Pragmatic View of Knowledge and Boundaries: Boundary Objects in New Product Development. Organization Science 13, 4 (2002), 442–455. https://doi.org/10.1287/orsc.13.4.442.2953
[9]
[9] Papers With Code. 2024. Retrieved January 20, 2024 from https://paperswithcode.com/
[10]
Thomas H Davenport, Rajeev Ronanki, 2018. Artificial Intelligence for the Real World. Harvard Business Review 96, 1 (2018), 108–116.
[11]
Fernando Delgado, Stephen Yang, Michael Madaio, and Qian Yang. 2021. Stakeholder Participation in AI: Beyond" Add Diverse Stakeholders and Stir". arXiv preprint arXiv:2111.01122 1 (2021), 7 pages.
[12]
Frédéric Delmar and Scott Shane. 2003. Does Business Planning Facilitate the Development of New Ventures?Strategic Management Journal 24, 12 (2003), 1165–1185. https://doi.org/10.1002/smj.349
[13]
[13] Google Docs. 2024. Retrieved January 20, 2024 from https://docs.google.com/
[14]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX Design Innovation: Challenges for Working with Machine Learning as a Design Material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, USA). ACM, New York, USA, 278–288. https://doi.org/10.1145/3025453.3025739
[15]
Mary T Dzindolet, Scott A Peterson, Regina A Pomranky, Linda G Pierce, and Hall P Beck. 2003. The Role of Trust in Automation Reliance. International journal of human-computer studies 58 (2003), 697–718. https://doi.org/10.1016/S1071-5819(03)00038-7
[16]
Vladimir Estivill-Castro, Eugene Gilmore, and René Hexel. 2022. Constructing Explainable Classifiers from the Start—Enabling Human-in-the-Loop Machine Learning. Information 13, 10 (2022), 464. https://doi.org/10.3390/info13100464
[17]
Hugging Face. 2024. Model Cards. Retrieved January 20, 2024 from https://huggingface.co/docs/hub/en/model-cards
[18]
[18] Figma. 2024. Retrieved January 20, 2024 from https://www.figma.com/
[19]
Jules Françoise, Baptiste Caramiaux, and Téo Sanchez. 2021. Marcelle: Composing Interactive Machine Learning Workflows and Interfaces. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA). ACM, New York, USA, 39–53. https://doi.org/10.1145/3472749.3474734
[20]
Gartner. 2019. Gartner Predicts The Future Of AI Technologies. Retrieved January 20, 2024 from https://www.gartner.com/smarterwithgartner/gartner-predicts-the-future-of-ai-technologies
[21]
Yubin Ge, Ziang Xiao, Jana Diesner, Hen Ji, Karrie Karahalios, and Hari Sundaram. 2023. What Should I Ask: A Knowledge-Driven Approach for Follow-up Questions Generation in Conversational Surveys. In Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation (Hong Kong, China). ACL, Stroudsburg, USA, 113–124. https://aclanthology.org/2023.paclic-1.12
[22]
Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III, and Kate Crawford. 2021. Datasheets for Datasets. Communications of the ACM 64, 12 (2021), 86–92. https://doi.org/10.1145/3458723
[23]
Leo A. Goodman. 1961. Snowball Sampling. The Annals of Mathematical Statistics 32, 1 (1961), 148–170. https://doi.org/10.1214/aoms/1177705148
[24]
Google. 2024. Model Cards. Retrieved January 20, 2024 from https://modelcards.withgoogle.com/about
[25]
John R Hayes and Jane Gradwohl Nash. 2013. On the Nature of Planning in Writing. The Science of Writing: Theories, Methods, Individual Differences and Applications 1 (2013), 29.
[26]
Xin He, Kaiyong Zhao, and Xiaowen Chu. 2021. AutoML: A Survey of the State-of-the-Art. Knowledge-Based Systems 212 (2021), 106622. https://doi.org/10.1016/j.knosys.2020.106622
[27]
Jeffrey Heer. 2019. Agency Plus Automation: Designing Artificial Intelligence into Interactive Systems. Proceedings of the National Academy of Sciences 116, 6 (2019), 1844–1850. https://doi.org/10.1073/pnas.1807184115
[28]
Amy K. Heger, Liz B. Marquis, Mihaela Vorvoreanu, Hanna Wallach, and Jennifer Wortman Vaughan. 2022. Understanding Machine Learning Practitioners’ Data Documentation Perceptions, Needs, Challenges, and Desiderata. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2, Article 340 (2022), 29 pages. https://doi.org/10.1145/3555760
[29]
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé, Miro Dudik, and Hanna Wallach. 2019. Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, UK). ACM, New York, USA, 1–16. https://doi.org/10.1145/3290605.3300830
[30]
Matthew K. Hong, Adam Fourney, Derek DeBellis, and Saleema Amershi. 2021. Planning for Natural Language Failures with the AI Playbook. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan). ACM, New York, USA, Article 386, 11 pages. https://doi.org/10.1145/3411764.3445735
[31]
The White House. 2023. Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence. Retrieved January 20, 2024 from https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/
[32]
Thomas L. Huber, Maike A.E. Winkler, Jens Dibbern, and Carol V. Brown. 2020. The Use of Prototypes to Bridge Knowledge Boundaries in Agile Software Development. Information Systems Journal 30, 2 (2020), 270–294. https://doi.org/10.1111/isj.12261
[33]
IBM. 2021. Infuse IBM Artificial Intelligence Field Guide. Retrieved January 20, 2024 from https://ac-gm-static-files-server.lahgrqm5xee.au-syd.codeengine.appdomain.cloud/cloud/architecture/files/ai-analytics-fg.pdf
[34]
Kaggle. 2024. Model Cards. Retrieved January 20, 2024 from https://www.kaggle.com/code/var0101/model-cards
[35]
Jiro Kawakita. 1982. The Original KJ Method. Tokyo: Kawakita Research Institute.
[36]
Jiro Kawakita. 1986. The KJ Method: Let Chaos Tell. Chuokoron-sha. (in Japanese).
[37]
Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large Language Models are Zero-Shot Reasoners. Advances in Neural Information Processing Systems 35 (2022), 22199–22213.
[38]
Q. Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, USA). ACM, New York, USA, 1–15. https://doi.org/10.1145/3313831.3376590
[39]
Josh Lovejoy. 2019. Human-Centered AI Cheat-Sheet.Retrieved January 20, 2024 from https://uxdesign.cc/human-centered-ai-cheat-sheet-1da130ba1bab
[40]
Yaoli Mao, Dakuo Wang, Michael Muller, Kush R. Varshney, Ioana Baldini, Casey Dugan, and Aleksandra Mojsilović. 2019. How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?Proceedings of the ACM on Human-Computer Interaction 3 (2019), 1–23. https://doi.org/10.1145/3361118
[41]
[41] Google Meet. 2024. Retrieved January 20, 2024 from https://meet.google.com/
[42]
Microsoft. 2022. Microsoft Responsible AI Standard, v2. Retrieved January 20, 2024 from https://blogs.microsoft.com/wp-content/uploads/prod/sites/5/2022/06/Microsoft-Responsible-AI-Standard-v2-General-Requirements-3.pdf
[43]
[43] Miro. 2024. Retrieved January 20, 2024 from https://miro.com/
[44]
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model Cards for Model Reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, USA). ACM, New York, USA, 220–229. https://doi.org/10.1145/3287560.3287596
[45]
Kichan Nam, Christopher S Dutt, Prakash Chathoth, Abdelkader Daghfous, and M Sajid Khan. 2021. The Adoption of Artificial Intelligence and Robotics in the Hotel Industry: Prospects and Challenges. Electronic Markets 31 (2021), 553–574.
[46]
Jakob Nielsen. 1994. Usability Heuristics for User Interface Design. Retrieved January 20, 2024 from https://www.nngroup.com/articles/ten-usability-heuristics/
[47]
European Parliament. 2023. EU AI Act: First Regulation on Artificial Intelligence. Retrieved January 20, 2024 from https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence
[48]
David Piorkowski, Soya Park, April Yi Wang, Dakuo Wang, Michael Muller, and Felix Portnoy. 2021. How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1, Article 131 (2021), 25 pages. https://doi.org/10.1145/3449205
[49]
Sajjadur Rahman, Pao Siangliulue, and Adam Marcus. 2020. MixTAPE: Mixed-initiative Team Action Plan Creation Through Semi-structured Notes, Automatic Task Generation, and Task Classification. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2, Article 169 (2020), 26 pages. https://doi.org/10.1145/3415240
[50]
Google People + AI Research. 2019. Google People + AI Guidebook. Retrieved January 20, 2024 from https://pair.withgoogle.com/guidebook/
[51]
Google People + AI Research. 2019. User Needs + Defining Success Chapter Worksheet. Retrieved January 20, 2024 from https://pair.withgoogle.com/worksheet/user-needs.pdf
[52]
Bruce Saddler, Susan Moran, Steve Graham, and Karen R Harris. 2004. Preventing Writing Difficulties: The Effects of Planning Strategy Instruction on the Writing Performance of Struggling Writers. Exceptionality 12, 1 (2004), 3–17. https://doi.org/10.1207/s15327035ex1201_2
[53]
Dan E Schendel and Charles W Hofer. 1979. A New View of Business Policy and Planning. Little, Brown & Company, Boston, USA. https://cdn.strategicmanagement.net/conferences/houston/overview/overview/_rightColumn/book-download2/s3file.pdf
[54]
Zheyuan Ryan Shi, Claire Wang, and Fei Fang. 2020. Artificial Intelligence for Social Good: A Survey. arXiv preprint arXiv:2001.01818 1 (2020), 78 pages.
[55]
Mona Sloane, Emanuel Moss, Olaitan Awomolo, and Laura Forlano. 2022. Participation Is not a Design Fix for Machine Learning. In Proceedings of the 2nd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (Arlington, USA). ACM, New York, USA, Article 1, 6 pages. https://doi.org/10.1145/3551624.3555285
[56]
Statistica. 2023. Artificial Intelligence - Worldwide. Retrieved January 20, 2024 from https://www.statista.com/outlook/tmo/artificial-intelligence/worldwide
[57]
Hariharan Subramonyam, Jane Im, Colleen Seifert, and Eytan Adar. 2022. Solving Separation-of-Concerns Problems in Collaborative Design of Human-AI Systems through Leaky Abstractions. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, USA) (CHI ’22). ACM, New York, USA, Article 481, 21 pages. https://doi.org/10.1145/3491102.3517537
[58]
Hariharan Subramonyam, Colleen Seifert, and Eytan Adar. 2021. ProtoAI: Model-Informed Prototyping for AI-Powered Interfaces. In Proceedings of the 26th International Conference on Intelligent User Interfaces (College Station, USA). ACM, New York, USA, 48–58. https://doi.org/10.1145/3397481.3450640
[59]
Hariharan Subramonyam, Colleen Seifert, and Eytan Adar. 2021. Towards A Process Model for Co-Creating AI Experiences. In Proceedings of the 2021 ACM Designing Interactive Systems Conference (Virtual Event, USA). ACM, New York, USA, 1529–1543. https://doi.org/10.1145/3461778.3462012
[60]
Hariharan Subramonyam, Colleen Seifert, and MI Eytan Adar. 2021. How Can Human-Centered Design Shape Data-Centric AI?. In In Proceedings of NeurIPS Data-Centric AI Workshop. Curran Associates, Inc., Red Hook, USA, 3 pages. https://haridecoded.com/resources/AIX_NeurIPS_2021.pdf
[61]
Mei Tan, Hansol Lee, Dakuo Wang, and Hari Subramonyam. 2024. Is a Seat at the Table Enough? Engaging Teachers and Students in Dataset Specification for ML in Education. Proceedings of the ACM on Human-Computer Interaction 8, CSCW1, Article 81 (2024), 32 pages. https://doi.org/10.1145/3637358
[62]
Rui A. Alves Teresa Limpo. 2018. Effects of Planning Strategies on Writing Dynamics and Final Texts. Acta Psychologica 188 (2018), 97–109. https://doi.org/10.1016/j.actpsy.2018.06.001
[63]
[63] Upwork. 2024. Retrieved January 20, 2024 from https://www.upwork.com/
[64]
Philip van Allen. 2018. Prototyping Ways of Prototyping AI. Interactions 25, 6 (2018), 46–51.
[65]
Ibo van de Poel. 2023. AI, Control and Unintended Consequences: The Need for Meta-Values. Springer International Publishing, Cham, Switzerland, 117–129. https://doi.org/10.1007/978-3-031-25233-4_9
[66]
Michael Veale, Max van Kleek, and Reuben Binns. 2018. Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada). ACM, New York, USA, 1–14. https://doi.org/10.1145/3173574.3174014
[67]
Janet Vertesi and Paul Dourish. 2011. The value of data: considering the context of production in data economies. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (Hangzhou, China). ACM, New York, USA, 533–542. https://doi.org/10.1145/1958824.1958906
[68]
Dakuo Wang, Elizabeth Churchill, Pattie Maes, Xiangmin Fan, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2020. From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, USA). ACM, New York, USA, 1–6. https://doi.org/10.1145/3334480.3381069
[69]
Marian G. Williams and Vivienne Begg. 1993. Translation Between Software Designers and Users. Commun. ACM 36, 6 (1993), 102–103. https://doi.org/10.1145/153571.214831
[70]
Ziang Xiao, Michelle X. Zhou, Q. Vera Liao, Gloria Mark, Changyan Chi, Wenxi Chen, and Huahai Yang. 2020. Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions. ACM Transactions on Computer-Human Interaction 27, 3, Article 15 (2020), 37 pages. https://doi.org/10.1145/3381804
[71]
Qian Yang, Alex Scuito, John Zimmerman, Jodi Forlizzi, and Aaron Steinfeld. 2018. Investigating How Experienced UX Designers Effectively Work with Machine Learning. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China). ACM, New York, USA, 585–596. https://doi.org/10.1145/3196709.3196730
[72]
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, USA). ACM, New York, USA, 1–13. https://doi.org/10.1145/3313831.3376301
[73]
Nur Yildirim, Mahima Pushkarna, Nitesh Goyal, Martin Wattenberg, and Fernanda Viégas. 2023. Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, New York, USA, Article 356, 13 pages. https://doi.org/10.1145/3544548.3580900
[74]
[74] Zoom. 2024. Retrieved January 20, 2024 from https://zoom.us/

Index Terms

  1. AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference
      July 2024
      3616 pages
      ISBN:9798400705830
      DOI:10.1145/3643834
      This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 01 July 2024

      Check for updates

      Author Tags

      1. AI application planning
      2. client-AI expert collaboration
      3. information flow
      4. workbook

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      Conference

      DIS '24
      Sponsor:
      DIS '24: Designing Interactive Systems Conference
      July 1 - 5, 2024
      Copenhagen, Denmark

      Acceptance Rates

      Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 410
        Total Downloads
      • Downloads (Last 12 months)410
      • Downloads (Last 6 weeks)96
      Reflects downloads up to 07 Jan 2025

      Other Metrics

      Citations

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media