A Home Study of Parent-Child Co-Reading with a Bilingual Conversational Agent
Authors: 
Kunlei He, Julian Levine, Kelsyann Cervera, Santiago Ojeda-Ramirez, Ying Xu, Mark WarschauerAuthors Info & Claims
Kunlei He, Julian Levine, Kelsyann Cervera, Santiago Ojeda-Ramirez, Ying Xu, Mark WarschauerAuthors Info & ClaimsArticle No.: 17, Pages 1 - 8
Abstract
Conversational agents (CAs) are increasingly prevalent in children’s lives, serving as educational companions, particularly in shared reading activities. While effective for monolingual children’s learning, there exists a gap in meeting the unique needs of the rapidly expanding bilingual child population, who face dual challenges of school readiness and heritage language maintenance. Moreover, most current CAs, designed for one-to-one interactions with children, neglect the importance of parents’ active participation in shared reading. Our study introduces the development and home deployment of a bilingual CA, integrated within e-books, designed to foster parent-child joint engagement in shared reading, thereby promoting children’s bilingual language development. Results of the study indicated high levels of family engagement in co-reading activities over an extended period, with observable language learning gains in children. This study provides valuable design implications for designing effective and engaging CAs for bilingual families.
Supplemental Material
- Download
- 8.88 MB
- Transcript
- Download
- 99.85 MB
- Transcript
References
[1]
Erin Beneteau, Olivia K Richards, Mingrui Zhang, Julie A Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication breakdowns between families and Alexa. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.
[2]
Pamela Blewitt, Keiran M Rump, Stephanie E Shealy, and Samantha A Cook. 2009. Shared book reading: When and how questions affect young children’s word learning.Journal of Educational Psychology 101, 2 (2009), 294.
[3]
Krista Byers-Heinlein. 2013. Parental language mixing: Its measurement and the relation of mixed input to young bilingual children’s vocabulary size. Bilingualism: Language and Cognition 16, 1 (2013), 32–48.
[4]
Bengisu Cagiltay, Rabia Ibtasar, Joseph E Michaelis, Sarah Sebo, and Bilge Mutlu. 2023. From Child-Centered to Family-Centered Interaction Design. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference. 789–791.
[5]
Justine Cassell. 2001. Embodied conversational agents: representation and intelligence in user interfaces. AI magazine 22, 4 (2001), 67–67.
[6]
Yi Cheng, Kate Yen, Yeqi Chen, Sijin Chen, and Alexis Hiniker. 2018. Why doesn’t it work? Voice-driven interfaces and young children’s communication repair strategies. In Proceedings of the 17th ACM conference on interaction design and children. 337–348.
[7]
Victoria Clarke, Virginia Braun, and Nikki Hayfield. 2015. Thematic analysis. Qualitative psychology: A practical guide to research methods 3 (2015), 222–248.
[8]
Graham Crookes. 1990. The utterance, and other basic units for second language discourse analysis. Applied linguistics 11, 2 (1990), 183–199.
[9]
Caroline De Lamo White and Lixian Jin. 2011. Evaluation of speech and language assessment approaches with bilingual children. International Journal of Language & Communication Disorders 46, 6 (2011), 613–627.
[10]
Richa S Deshmukh, Jill M Pentimonti, Tricia A Zucker, and Bridget Curry. 2022. Teachers’ use of scaffolds within conversations during shared book reading. Language, Speech, and Hearing Services in Schools 53, 1 (2022), 150–166.
[11]
Richa S Deshmukh, Tricia A Zucker, Sherine R Tambyraja, Jill M Pentimonti, Ryan P Bowles, and Laura M Justice. 2019. Teachers’ use of questions during shared book reading: Relations to child responses. Early Childhood Research Quarterly 49 (2019), 59–68.
[12]
Rebecca A Dore, Brenna Hassinger-Das, Natalie Brezack, Tara L Valladares, Alexis Paller, Lien Vu, Roberta Michnick Golinkoff, and Kathy Hirsh-Pasek. 2018. The parent advantage in fostering children’s e-book comprehension. Early Childhood Research Quarterly 44 (2018), 24–33.
[13]
Stefania Druga, Randi Williams, Hae Won Park, and Cynthia Breazeal. 2018. How smart are the smart toys? Children and parents’ agent interaction and intelligence attribution. In Proceedings of the 17th ACM Conference on Interaction Design and Children. 231–240.
[14]
Geneva Gay. 2018. Culturally responsive teaching: Theory, research, and practice. teachers college press.
[15]
Sandra M Gonzales. 2019. Cultivating familismo: Belonging and inclusion in one Latina/o learning community. International Journal of Inclusive Education 23, 9 (2019), 937–949.
[16]
Martin Guhn, Constance Milbrath, and Clyde Hertzman. 2016. Associations between child home language, gender, bilingualism and school readiness: A population-based study. Early Childhood Research Quarterly 35 (2016), 95–110.
[17]
Carol Scheffner Hammer and Brook Sawyer. 2016. Effects of a culturally responsive interactive book-reading intervention on the language abilities of preschool dual language learners: A pilot study. HS Dialog: The Research to Practice Journal for the Early Childhood Field 19, 2 (2016).
[18]
Erika Hoff and Cynthia Core. 2013. Input and language development in bilingually developing children. In Seminars in speech and language, Vol. 34. Thieme Medical Publishers, 215–226.
[19]
Zilkia Janer. 2008. Latino food culture. ABC-CLIO.
[20]
Catriona Kennedy and Aoife McLoughlin. 2022. Developing the Emergent Literacy Skills of English Language Learners Through Dialogic Reading: A Systematic Review. Early Childhood Education Journal (2022), 1–16.
[21]
Anthony J Liddicoat. 2021. An introduction to conversation analysis. Bloomsbury Publishing.
[22]
Silvia B Lovato, Anne Marie Piper, and Ellen A Wartella. 2019. Hey Google, do unicorns exist? Conversational agents as a path to answers to children’s questions. In Proceedings of the 18th ACM international conference on interaction design and children. 301–313.
[23]
Nina Markl. 2022. Language variation and algorithmic bias: understanding algorithmic bias in British English automatic speech recognition. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency. 521–534.
[24]
Marco Matassoni, Roberto Gretter, Daniele Falavigna, and Diego Giuliani. 2018. Non-native children speech recognition through transfer learning. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 6229–6233.
[25]
Luis C Moll, Cathy Amanti, Deborah Neff, and Norma Gonzalez. 1992. Funds of knowledge for teaching: Using a qualitative approach to connect homes and classrooms. Theory into practice 31, 2 (1992), 132–141.
[26]
Koichi Mori, Rafael Ballagas, Glenda Revelle, Hayes Raffle, Hiroshi Horii, and Mirjana Spasojevic. 2011. Interactive rich reading: enhanced book reading experience with a conversational agent. In Proceedings of the 19th ACM international conference on Multimedia. 825–826.
[27]
Rahat Naqvi, Anne McKeough, Keoma Thorne, and Christina Pfitscher. 2013. Dual-language books as an emergent-literacy resource: Culturally and linguistically responsive teaching and learning. Journal of Early Childhood Literacy 13, 4 (2013), 501–528.
[28]
Cansu Oranç and Azzurra Ruggeri. 2021. “Alexa, let me ask you something different” Children’s adaptive information search with voice assistants. Human Behavior and Emerging Technologies 3, 4 (2021), 595–605.
[29]
Alison H Paris and Scott G Paris. 2003. Assessing narrative comprehension in young children. Reading Research Quarterly 38, 1 (2003), 36–76.
[30]
Mari Riojas-Cortez and Raquel Cataldo. 2015. Using children’s literature to understand values, traditions, and beliefs within Latino Family Systems. Multicultural literature for Latino bilingual children: Their words, their worlds (2015), 83–100.
[31]
Kimiko Ryokai, Cati Vaucelle, and Justine Cassell. 2003. Virtual peers as partners in storytelling and literacy learning. Journal of computer assisted learning 19, 2 (2003), 195–208.
[32]
Monique Sénéchal and Laura Young. 2008. The effect of family literacy interventions on children’s acquisition of reading from kindergarten to grade 3: A meta-analytic review. Review of educational research 78, 4 (2008), 880–907.
[33]
Suleman Shahid, Emiel Krahmer, and Marc Swerts. 2014. Child–robot interaction across cultures: How does playing a game with a social robot compare to playing a game alone or with a friend?Computers in Human Behavior 40 (2014), 86–100.
[34]
Timothy Shanahan and Christopher J Lonigan. 2010. The National Early Literacy Panel: A summary of the process and the report. Educational Researcher 39, 4 (2010), 279–285.
[35]
Guadalupe Valdés. 2005. Bilingualism, heritage language learners, and SLA research: Opportunities lost or seized?The modern language journal 89, 3 (2005), 410–426.
[36]
Grover J Whitehurst, Francine L Falco, Christopher J Lonigan, Janet E Fischel, Barbara D DeBaryshe, Marta C Valdez-Menchaca, and Marie Caulfield. 1988. Accelerating language development through picture book reading.Developmental psychology 24, 4 (1988), 552.
[37]
Yunhan Wu, Daniel Rough, Anna Bleakley, Justin Edwards, Orla Cooney, Philip R Doyle, Leigh Clark, and Benjamin R Cowan. 2020. See what I’m saying? Comparing intelligent personal assistant use for native and non-native language speakers. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–9.
[38]
Ying Xu, Joseph Aubele, Valery Vigil, Andres S Bustamante, Young-Suk Kim, and Mark Warschauer. 2022. Dialogue with a conversational agent promotes children’s story comprehension via enhancing engagement. Child Development 93, 2 (2022), e149–e167.
[39]
Ying Xu, Stacy Branham, Xinwei Deng, Penelope Collins, and Mark Warschauer. 2021. Are Current Voice Interfaces Designed to Support Children’s Language Development?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.
[40]
Ying Xu, Kunlei He, Valery Vigil, Santiago Ojeda-Ramirez, Xuechen Liu, Julian Levine, Kelsyann Cervera, and Mark Warschauer. 2023. “Rosita Reads With My Family”: Developing A Bilingual Conversational Agent to Support Parent-Child Shared Reading. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference. 160–172.
[41]
Ying Xu, Dakuo Wang, Penelope Collins, Hyelim Lee, and Mark Warschauer. 2021. Same benefits, different communication patterns: Comparing Children’s reading with a conversational agent vs. a human partner. Computers & Education 161 (2021), 104059.
[42]
Andrea A Zevenbergen and Grover J Whitehurst. 2003. Dialogic reading: A shared picture book reading intervention for preschoolers. On reading books to children: Parents and teachers 177 (2003), 200.
Index Terms
- A Home Study of Parent-Child Co-Reading with a Bilingual Conversational Agent
Recommendations
“Rosita Reads With My Family”: Developing A Bilingual Conversational Agent to Support Parent-Child Shared Reading
IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children ConferenceBilingual children have unique needs for school readiness as they navigate between two languages and cultures. A supportive home language environment, where children are frequently exposed to language through conversation and reading, can positively ...
Parent and child problematic media use: The role of maternal postpartum depression and dysfunctional parent-child interactions in young children
AbstractProblematic media use, or media use that interferes with daily functioning, is most often studied in adolescent or young adult age groups. Less research has examined problematic media use within the family system, among parents and ...
Highlights- Problematic media use is seen in children as young as 3–4 years old and in their parents.
Exploring the Design Space for Parent-Child Reading
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsGiven the significant potential of shared book reading to promote children's learning, the design of e-books has focused on maximising this learning experience. However, recent studies have begun to show that shared reading is a broader opportunity for ...
Comments
Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Funding Sources
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 759Total Downloads
- Downloads (Last 12 months)759
- Downloads (Last 6 weeks)201
Reflects downloads up to 26 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format