skip to main content
10.1145/3610978.3640661acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
short-paper

Investigating Causality in Parent-Toddler-Robot Interaction

Published: 11 March 2024 Publication History

Abstract

Human robot interaction is often a very dynamic scenario, where both robots and humans perform verbal and non-verbal behaviors in response to each other. However, most user studies do not analyze the intricate dynamics of the interaction. Here, we present a novel methodology of a multi-participants, multi-dimensional, time-series Granger-causality analysis of a parent-toddler-robot triadic interaction. Our results show a specific causal flow of behaviors, namely, that the parent mediates the toddler-robot interaction by both verbal and non-verbal behaviors. Our proposed novel analysis can highly enrich understanding of the complex dynamics of human robot interaction.

Supplemental Material

MP4 File
Supplemental video

References

[1]
Franziska Babel, Johannes Kraus, Linda Miller, Matthias Kraus, Nicolas Wagner, Wolfgang Minker, and Martin Baumann. 2021. Small Talk with a Robot? The Impact of Dialog Content, Talk Initiative, and Gaze Behavior of a Social Robot on Trust, Acceptance, and Proximity. International Journal of Social Robotics, Vol. 13, 6 (Sept. 2021), 1485--1498. https://doi.org/10.1007/s12369-020-00730-0
[2]
Steven L. Bressler and Anil K. Seth. 2011. Wiener--Granger causality: a well established methodology. Neuroimage, Vol. 58, 2 (2011), 323--329. ISBN: 1053--8119 Publisher: Elsevier.
[3]
Andrew Chang, Steven R. Livingstone, Dan J. Bosnyak, and Laurel J. Trainor. 2017. Body sway reflects leadership in joint music performance. Proceedings of the National Academy of Sciences, Vol. 114, 21 (May 2017), E4134--E4141. https://doi.org/10.1073/pnas.1617657114 Publisher: Proceedings of the National Academy of Sciences.
[4]
Matan Eshed, Matan Epstein, Ada H. Zohar, and Goren Gordon. 2021. Studying Dynamics of Human Information Gathering Behaviors Using Social Robots. Frontiers in Psychology, Vol. 12 (2021), 1954. https://doi.org/10.3389/fpsyg.2021.669198
[5]
Omer Gvirsman, Yaacov Koren, Tal Norman, and Goren Gordon. 2020. Patricc: A Platform for Triadic Interaction with Changeable Characters. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (HRI '20). Association for Computing Machinery, Cambridge, United Kingdom, 399--407. https://doi.org/10.1145/3319502.3374792
[6]
Hui-Ru Ho, Nathan Thomas White, Edward M. Hubbard, and Bilge Mutlu. 2023. Designing Parent-child-robot Interactions to Facilitate In-Home Parental Math Talk with Young Children. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (IDC '23). Association for Computing Machinery, New York, NY, USA, 355--366. https://doi.org/10.1145/3585088.3589358
[7]
Guy Hoffman and Xuan Zhao. 2020. A Primer for Conducting Experiments in Human–Robot Interaction. ACM Transactions on Human-Robot Interaction, Vol. 10, 1 (Oct. 2020), 6:1--6:31. https://doi.org/10.1145/3412374
[8]
Soheil Keshmiri, Hidenobu Sumioka, Takashi Minato, Masahiro Shiomi, and Hiroshi Ishiguro. 2019. Exploring the Causal Modeling of Human-Robot Touch Interaction. In Social Robotics (Lecture Notes in Computer Science ), Miguel A. Salichs, Shuzhi Sam Ge, Emilia Ivanova Barakova, John-John Cabibihan, Alan R. Wagner, Álvaro Castro-González, and Hongsheng He (Eds.). Springer International Publishing, Cham, 235--244. https://doi.org/10.1007/978--3-030--35888--4_22
[9]
Chris L. Kleinke. 1986. Gaze and eye contact: a research review. Psychological bulletin, Vol. 100, 1 (1986), 78. ISBN: 1939--1455 Publisher: American Psychological Association.
[10]
Ann Kring and Denise Sloan. 2007. The Facial Expression Coding System (FACES): Development, Validation, and Utility. Psychological assessment, Vol. 19 (June 2007), 210--24. https://doi.org/10.1037/1040--3590.19.2.210
[11]
Sachiko Matsumoto, Auriel Washburn, and Laurel D. Riek. 2022. A Framework to Explore Proximate Human-Robot Coordination. ACM Transactions on Human-Robot Interaction, Vol. 11, 3 (Sept. 2022), 1--34. https://doi.org/10.1145/3526101 Number: 3.
[12]
Michelle M. Neumann. 2018. Parent scaffolding of young children's use of touch screen tablets. Early Child Development and Care, Vol. 188, 12 (Dec. 2018), 1654--1664. https://doi.org/10.1080/03004430.2016.1278215 Number: 12.
[13]
M. M. Neumann and D. L. Neumann. 2016. An analysis of mother-child interactions during an iPad activity. Parent-child interactions and relationships: Perceptions, practices, and developmental outcomes (2016), 133--148. Publisher: Nova Science Publishers Hauppauge, NY.
[14]
Mariko Okuda, Yasutake Takahashi, and Satoki Tsuichihara. 2020. Effect of Humanoid Robot's Reaction on Human Touch to Robot. In 2020 Joint 11th International Conference on Soft Computing and Intelligent Systems and 21st International Symposium on Advanced Intelligent Systems (SCIS-ISIS). 1--6. https://doi.org/10.1109/SCISISIS50064.2020.9322680
[15]
Nils F. Tolksdorf, Camilla E. Crawshaw, and Katharina J. Rohlfing. 2021. Comparing the effects of a different social partner (social robot vs. human) on children's social referencing in interaction. In Frontiers in Education, Vol. 5. Frontiers Media SA, 569615.
[16]
Jacqueline Urakami and Sujitra Sutthithatip. 2021. Building a Collaborative Relationship between Human and Robot through Verbal and Non-Verbal Interaction. In Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (HRI '21 Companion ). Association for Computing Machinery, New York, NY, USA, 257--261. https://doi.org/10.1145/3434074.3447171
[17]
Peter Wittenburg, Hennie Brugman, Albert Russel, Alex Klassmann, and Han Sloetjes. 2006. ELAN : a professional framework for multimodality research. 1556--1559. https://pure.mpg.de/pubman/faces/ViewItemOverviewPage.jsp?itemId=item_60436
[18]
Tian Linger Xu, Kaya de Barbaro, Drew H. Abney, and Ralf F. A. Cox. 2020. Finding Structure in Time: Visualizing and Analyzing Behavioral Time Series. Frontiers in Psychology, Vol. 11 (2020). https://www.frontiersin.org/articles/10.3389/fpsyg.2020.01457
[19]
Nicola Yelland and Jennifer Masters. 2007. Rethinking scaffolding in the information age. Computers & Education, Vol. 48, 3 (April 2007), 362--382. https://doi.org/10.1016/j.compedu.2005.01.010 Number: 3.
[20]
Chen Yu and Linda B. Smith. 2013. Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination. PLOS ONE, Vol. 8, 11 (Nov. 2013), e79659. https://doi.org/10.1371/journal.pone.0079659 Publisher: Public Library of Science.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction
March 2024
1408 pages
ISBN:9798400703232
DOI:10.1145/3610978
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 March 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Granger Causality
  2. non-verbal communication
  3. toddler robot interaction

Qualifiers

  • Short-paper

Conference

HRI '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 53
    Total Downloads
  • Downloads (Last 12 months)53
  • Downloads (Last 6 weeks)3
Reflects downloads up to 11 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media