skip to main content
10.1145/3585088.3589356acmconferencesArticle/Chapter ViewAbstractPublication PagesidcConference Proceedingsconference-collections
research-article
Open access

Collaborative Machine Learning Model Building with Families Using Co-ML

Published: 19 June 2023 Publication History

Abstract

Existing novice-friendly machine learning (ML) modeling tools center around a solo user experience, where a single user collects only their own data to build a model. However, solo modeling experiences limit valuable opportunities for encountering alternative ideas and approaches that can arise when learners work together; consequently, it often precludes encountering critical issues in ML around data representation and diversity that can surface when different perspectives are manifested in a group-constructed data set. To address this issue, we created Co-ML – a tablet-based app for learners to collaboratively build ML image classifiers through an end-to-end, iterative model-building process. In this paper, we illustrate the feasibility and potential richness of collaborative modeling by presenting an in-depth case study of a family (two children 11 and 14-years-old working with their parents) using Co-ML in a facilitated introductory ML activity at home. We share the Co-ML system design and contribute a discussion of how using Co-ML in a collaborative activity enabled beginners to collectively engage with dataset design considerations underrepresented in prior work such as data diversity, class imbalance, and data quality. We discuss how a distributed collaborative process, in which individuals can take on different model-building responsibilities, provides a rich context for children and adults to learn ML dataset design.

Supplemental Material

MP4 File
Preview Video

References

[1]
Adam Agassi, Hadas Erel, Iddo Yehoshua Wald, and Oren Zuckerman. 2019. Scratch nodes ML: A playful system for children to create gesture recognition classifiers. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–6.
[2]
Apple. 2023. CloudKit. https://developer.apple.com/icloud/cloudkit/
[3]
Apple. 2023. CoreML. https://developer.apple.com/documentation/coreml
[4]
Apple. 2023. CreateML. https://developer.apple.com/machine-learning/create-ml/
[5]
Andrei Barbu, David Mayo, Julian Alverio, William Luo, Christopher Wang, Dan Gutfreund, Josh Tenenbaum, and Boris Katz. 2019. Objectnet: A large-scale bias-controlled dataset for pushing the limits of object recognition models. Advances in neural information processing systems 32 (2019).
[6]
Brigid Barron, Caitlin Kennedy Martin, Lori Takeuchi, and Rachel Fithian. 2009. Parents as learning partners in the development of technological fluency. (2009).
[7]
Amanda M Bell. 2015. Learning complex systems with story-building in scratch. In Proceedings of the 14th International Conference on Interaction Design and Children. 307–310.
[8]
Erin Beneteau, Olivia K Richards, Mingrui Zhang, Julie A Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication breakdowns between families and Alexa. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.
[9]
Leema Kuhn Berland and Brian J Reiser. 2009. Making sense of argumentation and explanation. Science education 93, 1 (2009), 26–55.
[10]
Alan F Blackwell, Carol Britton, Anna Cox, Thomas RG Green, Corin Gurr, Gada Kadoda, Maria S Kutar, Martin Loomes, Chrystopher L Nehaniv, Marian Petre, 2001. Cognitive dimensions of notations: Design tools for cognitive technology. In International conference on cognitive technology. Springer, 325–341.
[11]
Phyllis C Blumenfeld, Ronald W Marx, Elliot Soloway, and Joseph Krajcik. 1996. Learning with peers: From small group cooperation to collaborative communities. Educational researcher 25, 8 (1996), 37–39.
[12]
Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77–91.
[13]
Michelle Carney, Barron Webster, Irene Alvarado, Kyle Phillips, Noura Howell, Jordan Griffith, Jonas Jongejan, Amit Pitaru, and Alexander Chen. 2020. Teachable machine: Approachable Web-based tool for exploring machine learning classification. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.
[14]
Richard Lee Davis, Melisa Orta Martinez, Oliver Schneider, Karon E MacLean, Allison M Okamura, and Paulo Blikstein. 2017. The haptic bridge: Towards a theory for haptic-supported learning. In Proceedings of the 2017 conference on interaction design and children. 51–60.
[15]
Nicoletta Di Blas and Bianca Boretti. 2009. Interactive storytelling in pre-school: a case-study. In Proceedings of the 8th International conference on interaction design and children. 44–51.
[16]
Stefania Druga. 2018. Growing up with AI: Cognimates: from coding to teaching machines. Ph. D. Dissertation. Massachusetts Institute of Technology.
[17]
Stefania Druga, Fee Lia Christoph, and Amy J Ko. 2022. Family as a Third Space for AI Literacies: How do children and parents learn about AI together?. In CHI Conference on Human Factors in Computing Systems. 1–17.
[18]
Utkarsh Dwivedi, Jaina Gandhi, Raj Parikh, Merijke Coenraad, Elizabeth Bonsignore, and Hernisa Kacorri. 2021. Exploring Machine Teaching with Children. In 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 1–11.
[19]
Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin’s Press.
[20]
Rebecca Fiebrink and Perry R Cook. 2010. The Wekinator: a system for real-time, interactive machine learning in music. In Proceedings of The Eleventh International Society for Music Information Retrieval Conference (ISMIR 2010)(Utrecht), Vol. 3.
[21]
Gamelab. 2003. Diner Dash. https://www.crazygames.com/game/diner-dash
[22]
Ghost Town Games. 2016. Overcooked. https://www.team17.com/games/overcooked/
[23]
Fred Hohman, Kanit Wongsuphasawat, Mary Beth Kery, and Kayur Patel. 2020. Understanding and Visualizing Data Iteration in Machine Learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3313831.3376177
[24]
Jonggi Hong, Kyungjun Lee, June Xu, and Hernisa Kacorri. 2020. Crowdsourcing the perception of machine teaching. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[25]
Ken Kahn and Niall Winters. 2017. Child-friendly programming interfaces to AI cloud services. In European Conference on Technology Enhanced Learning. Springer, 566–570.
[26]
Irene Lee, Safinah Ali, Helen Zhang, Daniella DiPaola, and Cynthia Breazeal. 2021. Developing Middle School Students’ AI Literacy. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education. 191–197.
[27]
Janet Mei-Chuen Lin and Shu-Fen Liu. 2012. An investigation into parent-child collaboration in learning computer programming. Journal of Educational Technology & Society 15, 1 (2012), 162–173.
[28]
Duri Long and Brian Magerko. 2020. What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–16.
[29]
Duri Long, Aadarsh Padiyath, Anthony Teachey, and Brian Magerko. 2021. The Role of Collaboration, Creativity, and Embodiment in AI Learning Experiences. In Creativity and Cognition. 1–10.
[30]
Duri Long, Anthony Teachey, and Brian Magerko. 2022. Family Learning Talk in AI Literacy Learning Activities. In CHI Conference on Human Factors in Computing Systems. 1–20.
[31]
Leilah Lyons, Michael Tissenbaum, Matthew Berland, Rebecca Eydt, Lauren Wielgus, and Adam Mechtley. 2015. Designing visible engineering: supporting tinkering performances in museums. In Proceedings of the 14th International Conference on Interaction Design and Children. 49–58.
[32]
Safiya Umoja Noble. 2018. Algorithms of oppression. New York University Press.
[33]
Blakeley H Payne. 2019. An ethics of artificial intelligence curriculum for middle school students. (2019).
[34]
Ricarose Roque, Karina Lin, and Richard Liuzzi. 2016. “I’m Not Just a Mom”: Parents Developing Multiple Roles in Creative Computing. Singapore: International Society of the Learning Sciences.
[35]
Jeremy Roschelle. 1992. Learning by collaborating: Convergent conceptual change. The journal of the learning sciences 2, 3 (1992), 235–276.
[36]
David Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Francois Crespo, and Dan Dennison. 2015. Hidden technical debt in machine learning systems. Advances in neural information processing systems 28 (2015).
[37]
David S. Touretzky, Christina Gardner-McCune, Fred Martin, and Deborah Seehorn. 2019. K-12 Guidelines for Artificial Intelligence: What Students Should Know. https://github.com/touretzkyds/ai4k12/raw/master/documents/ISTE_2019_Presentation_website_final.pdf/
[38]
Tiffany Tseng, Yumiko Murai, Natalie Freed, Deanna Gelosi, Tung D Ta, and Yoshihiro Kawahara. 2021. PlushPal: Storytelling with Interactive Plush Toys and Machine Learning. In Interaction Design and Children. 236–245.
[39]
Christiane Gresse von Wangenheim, Jean CR Hauck, Fernando S Pacheco, and Matheus F Bertonceli Bueno. 2021. Visual tools for teaching machine learning in K-12: A ten-year systematic mapping. Education and Information Technologies (2021), 1–46.
[40]
Lev Semenovich Vygotsky and Michael Cole. 1978. Mind in society: Development of higher psychological processes. Harvard university press.
[41]
Randi Williams and Cynthia Breazeal. 2020. How to Train Your Robot: A Middle School AI and Ethics Curriculum. IJCAI.
[42]
Qian Yang, Jina Suh, Nan-Chen Chen, and Gonzalo Ramos. 2018. Grounding interactive machine learning tool design in how non-experts actually build models. In Proceedings of the 2018 designing interactive systems conference. 573–584.
[43]
Robert K Yin. 2009. Case study research: Design and methods. Vol. 5. sage.
[44]
Jason Yip, June Ahn, Tamara Clegg, Elizabeth Bonsignore, Daniel Pauw, and Michael Gubbels. 2014. " It helped me do my science." a case of designing social media technologies for children in science learning. In Proceedings of the 2014 conference on Interaction design and children. 155–164.
[45]
Xiaofei Zhou, Jessica Van Brummelen, and Phoebe Lin. 2020. Designing AI Learning Experiences for K-12: Emerging Works, Future Opportunities and a Design Framework. arXiv preprint arXiv:2009.10228 (2020).
[46]
Heather Zimmerman, Suzanne Perin, and Philip Bell. 2010. Parents, science, and interest. Museums & Social Issues 5, 1 (2010), 67–86.
[47]
Abigail Zimmermann-Niefield, Shawn Polson, Celeste Moreno, and R Benjamin Shapiro. 2020. Youth making machine learning models for gesture-controlled interactive media. In Proceedings of the Interaction Design and Children Conference. 63–74.
[48]
Abigail Zimmermann-Niefield, Makenna Turner, Bridget Murphy, Shaun K Kane, and R Benjamin Shapiro. 2019. Youth learning machine learning through building models of athletic moves. In Proceedings of the 18th ACM International Conference on Interaction Design and Children. 121–132.

Cited By

View all
  • (2024)Unpacking Approaches to Learning and Teaching Machine Learning in K-12 Education: Transparency, Ethics, and Design ActivitiesProceedings of the 19th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3677619.3678117(1-10)Online publication date: 16-Sep-2024
  • (2024)Youth as Peer Auditors: Engaging Teenagers with Algorithm Auditing of Machine Learning ApplicationsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655752(560-573)Online publication date: 17-Jun-2024
  • (2024)Not Just Training, Also Testing: High School Youths' Perspective-Taking through Peer Testing Machine Learning-Powered ApplicationsProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630899(881-887)Online publication date: 7-Mar-2024
  • Show More Cited By

Index Terms

  1. Collaborative Machine Learning Model Building with Families Using Co-ML

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference
    June 2023
    824 pages
    ISBN:9798400701313
    DOI:10.1145/3585088
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 June 2023

    Check for updates

    Badges

    • Honorable Mention

    Author Tags

    1. children
    2. collaboration
    3. families
    4. learning
    5. machine learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Data Availability

    Conference

    IDC '23
    Sponsor:
    IDC '23: Interaction Design and Children
    June 19 - 23, 2023
    IL, Chicago, USA

    Acceptance Rates

    Overall Acceptance Rate 172 of 578 submissions, 30%

    Upcoming Conference

    IDC '25
    Interaction Design and Children
    June 23 - 26, 2025
    Reykjavik , Iceland

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)501
    • Downloads (Last 6 weeks)54
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Unpacking Approaches to Learning and Teaching Machine Learning in K-12 Education: Transparency, Ethics, and Design ActivitiesProceedings of the 19th WiPSCE Conference on Primary and Secondary Computing Education Research10.1145/3677619.3678117(1-10)Online publication date: 16-Sep-2024
    • (2024)Youth as Peer Auditors: Engaging Teenagers with Algorithm Auditing of Machine Learning ApplicationsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655752(560-573)Online publication date: 17-Jun-2024
    • (2024)Not Just Training, Also Testing: High School Youths' Perspective-Taking through Peer Testing Machine Learning-Powered ApplicationsProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630899(881-887)Online publication date: 7-Mar-2024
    • (2024)Parent-Child Joint Media Engagement Within HCI: A Scoping Analysis of the Research LandscapeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642307(1-21)Online publication date: 11-May-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media