skip to main content
Skip header Section
The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 1: Methods, Behavior, CognitionSeptember 2021
Publisher:
  • Association for Computing Machinery
  • New York
  • NY
  • United States
ISBN:978-1-4503-8720-0
Published:02 October 2021
Pages:
538
Appears In:
ACMACM Books
Skip Bibliometrics Section
Reflects downloads up to 09 Jan 2025Bibliometrics
Skip Abstract Section
Abstract

The Handbook on Socially Interactive Agents provides a comprehensive overview of the research fields of Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics. Socially Interactive Agents (SIAs), whether virtually or physically embodied, are autonomous agents that are able to perceive an environment including people or other agents, reason, decide how to interact, and express attitudes such as emotions, engagement, or empathy. They are capable of interacting with people and one another in a socially intelligent manner using multimodal communicative behaviors, with the goal to support humans in various domains.

Written by international experts in their respective fields, the book summarizes research in the many important research communities pertinent for SIAs, while discussing current challenges and future directions. The handbook provides easy access to modeling and studying SIAs for researchers and students, and aims at further bridging the gap between the research communities involved.

In two volumes, the book clearly structures the vast body of research. The first volume starts by introducing what is involved in SIAs research, in particular research methodologies and ethical implications of developing SIAs. It further examines research on appearance and behavior, focusing on multimodality. Finally, social cognition for SIAs is investigated using different theoretical models and phenomena such as theory of mind or pro-sociality. The second volume starts with perspectives on interaction, examined from different angles such as interaction in social space, group interaction, or long-term interaction. It also includes an extensive overview summarizing research and systems of human–agent platforms and of some of the major application areas of SIAs such as education, aging support, autism, and games.

Skip Table Of Content Section
editorial
Free
Foreword

In preparation for writing this foreword, I looked through old emails (really old emails) dating back to early 1998, when we were planning the “First Workshop on Embodied Conversational Characters.” In and amongst detailed menu planning for the workshop (...

introduction
Free
chapter
Appearance
chapter
Gesture Generation
chapter
Emotion
chapter
index
Authors’ Biographies/Index

Cited By

  1. Steinhaeusser S, Zehe A, Schnetter P, Hotho A and Lugrin B (2024). Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language, Journal on Multimodal User Interfaces, 10.1007/s12193-024-00429-w, 18:4, (1-23), Online publication date: 1-Dec-2024.
  2. Zhang C, Burkanova B, Kim L, Yip L, Cupcic U, Lallée S and Lim A (2024). React to This! How Humans Challenge Interactive Agents using Nonverbal Behaviors 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 10.1109/IROS58592.2024.10801673, 979-8-3503-7770-5, (4747-4754)
  3. Calzolari S, Strada F and Bottino A (2024). The Quest for Believability: Exploring FACS Adaptations for Emotion Facial Expressions in Virtual Humans 2024 IEEE Gaming, Entertainment, and Media Conference (GEM), 10.1109/GEM61861.2024.10585460, 979-8-3503-7453-7, (1-6)
  4. Blomsma P, Vaitonyté J, Skantze G and Swerts M (2024). Backchannel behavior is idiosyncratic, Language and Cognition, 10.1017/langcog.2024.1, (1-24)
  5. Broekens J, Hilpert B, Verberne S, Baraka K, Gebhard P and Plaat A (2023). Fine-grained Affective Processing Capabilities Emerging from Large Language Models 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII), 10.1109/ACII59096.2023.10388177, 979-8-3503-2743-4, (1-8)
  6. Ganal E, Siol L and Lugrin B (2023). PePUT: A Unity Toolkit for the Social Robot Pepper 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 10.1109/RO-MAN57019.2023.10309447, 979-8-3503-3670-2, (1012-1019)
  7. Bennett C, Bae Y, Yoon J, Chae Y, Yoon E, Lee S, Ryu U, Kim S and Weiss B (2023). Effects of cross-cultural language differences on social cognition during human-agent interaction in cooperative game environments, Computer Speech and Language, 81:C, Online publication date: 1-Jun-2023.
  8. Stein J and Lugrin B (2023). Virtuelle Realität und sozial interaktive Agenten Digital ist besser?! Psychologie der Online- und Mobilkommunikation, 10.1007/978-3-662-66608-1_18, (261-278),
  9. Roesler E, Steinhaeusser S, Lugrin B and Onnasch L (2022). The Influence of Visible Cables and Story Content on Perceived Autonomy in Social Human–Robot Interaction, Robotics, 10.3390/robotics12010003, 12:1, (3)
  10. ACM
    Menzel T, Botsch M and Latoschik M Automated Blendshape Personalization for Faithful Face Animations Using Commodity Smartphones Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology, (1-9)
  11. Obremski D, Friedrich P, Haak N, Schaper P and Lugrin B (2022). The impact of mixed-cultural speech on the stereotypical perception of a virtual robot, Frontiers in Robotics and AI, 10.3389/frobt.2022.983955, 9
  12. ACM
    Gebhard P, Tsovaltzi D, Schneeberger T and Nunnari F Serious Games with SIAs The Handbook on Socially Interactive Agents, (527-546)
  13. ACM
    Prada R and Rato D Socially Interactive Agents in Games The Handbook on Socially Interactive Agents, (493-526)
  14. ACM
    Aylett R Interactive Narrative and Story-telling The Handbook on Socially Interactive Agents, (463-492)
  15. ACM
    Bickmore T Health-Related Applications of Socially Interactive Agents The Handbook on Socially Interactive Agents, (403-436)
  16. ACM
    Cassell J Socially Interactive Agents as Peers The Handbook on Socially Interactive Agents, (331-366)
  17. ACM
    Lane H and Schroeder N Pedagogical Agents The Handbook on Socially Interactive Agents, (307-330)
  18. ACM
    Hartholt A and Mozgai S Platforms and Tools for SIA Research and Development The Handbook on Socially Interactive Agents, (261-304)
  19. ACM
    Kory-Westlund J, Won Park H, Grover I and Breazeal C Long-Term Interaction with Relational SIAs The Handbook on Socially Interactive Agents, (195-260)
  20. ACM
    Kopp S and Hassan T The Fabric of Socially Interactive Agents: Multimodal Interaction Architectures The Handbook on Socially Interactive Agents, (77-112)
  21. ACM
    Aylett R Foreword The Handbook on Socially Interactive Agents, (xvii-xxiv)
  22. ACM
    Lugrin B, Pelachaud C and Traum D (2022). The Handbook on Socially Interactive Agents, 10.1145/3563659, Online publication date: 27-Oct-2022.
Contributors
  • Julius-Maximilian University of Würzburg
  • Sorbonne University
  • University of Southern California
Index terms have been assigned to the content through auto-classification.

Recommendations