The Handbook on Socially Interactive Agents provides a comprehensive overview of the research fields of Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics. Socially Interactive Agents (SIAs), whether virtually or physically embodied, are autonomous agents that are able to perceive an environment including people or other agents, reason, decide how to interact, and express attitudes such as emotions, engagement, or empathy. They are capable of interacting with people and one another in a socially intelligent manner using multimodal communicative behaviors, with the goal to support humans in various domains.
Written by international experts in their respective fields, the book summarizes research in the many important research communities pertinent for SIAs, while discussing current challenges and future directions. The handbook provides easy access to modeling and studying SIAs for researchers and students, and aims at further bridging the gap between the research communities involved.
In two volumes, the book clearly structures the vast body of research. The first volume starts by introducing what is involved in SIAs research, in particular research methodologies and ethical implications of developing SIAs. It further examines research on appearance and behavior, focusing on multimodality. Finally, social cognition for SIAs is investigated using different theoretical models and phenomena such as theory of mind or pro-sociality. The second volume starts with perspectives on interaction, examined from different angles such as interaction in social space, group interaction, or long-term interaction. It also includes an extensive overview summarizing research and systems of human–agent platforms and of some of the major application areas of SIAs such as education, aging support, autism, and games.
Book Downloads
Foreword
In preparation for writing this foreword, I looked through old emails (really old emails) dating back to early 1998, when we were planning the “First Workshop on Embodied Conversational Characters.” In and amongst detailed menu planning for the workshop (...
Cited By
-
Steinhaeusser S, Zehe A, Schnetter P, Hotho A and Lugrin B (2024). Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language, Journal on Multimodal User Interfaces, 10.1007/s12193-024-00429-w, 18:4, (1-23), Online publication date: 1-Dec-2024.
-
Zhang C, Burkanova B, Kim L, Yip L, Cupcic U, Lallée S and Lim A (2024). React to This! How Humans Challenge Interactive Agents using Nonverbal Behaviors 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 10.1109/IROS58592.2024.10801673, 979-8-3503-7770-5, (4747-4754)
-
Calzolari S, Strada F and Bottino A (2024). The Quest for Believability: Exploring FACS Adaptations for Emotion Facial Expressions in Virtual Humans 2024 IEEE Gaming, Entertainment, and Media Conference (GEM), 10.1109/GEM61861.2024.10585460, 979-8-3503-7453-7, (1-6)
-
Blomsma P, Vaitonyté J, Skantze G and Swerts M (2024). Backchannel behavior is idiosyncratic, Language and Cognition, 10.1017/langcog.2024.1, (1-24)
-
Broekens J, Hilpert B, Verberne S, Baraka K, Gebhard P and Plaat A (2023). Fine-grained Affective Processing Capabilities Emerging from Large Language Models 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII), 10.1109/ACII59096.2023.10388177, 979-8-3503-2743-4, (1-8)
-
Ganal E, Siol L and Lugrin B (2023). PePUT: A Unity Toolkit for the Social Robot Pepper 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 10.1109/RO-MAN57019.2023.10309447, 979-8-3503-3670-2, (1012-1019)
- Bennett C, Bae Y, Yoon J, Chae Y, Yoon E, Lee S, Ryu U, Kim S and Weiss B (2023). Effects of cross-cultural language differences on social cognition during human-agent interaction in cooperative game environments, Computer Speech and Language, 81:C, Online publication date: 1-Jun-2023.
-
Stein J and Lugrin B (2023). Virtuelle Realität und sozial interaktive Agenten Digital ist besser?! Psychologie der Online- und Mobilkommunikation, 10.1007/978-3-662-66608-1_18, (261-278),
-
Roesler E, Steinhaeusser S, Lugrin B and Onnasch L (2022). The Influence of Visible Cables and Story Content on Perceived Autonomy in Social Human–Robot Interaction, Robotics, 10.3390/robotics12010003, 12:1, (3)
- Menzel T, Botsch M and Latoschik M Automated Blendshape Personalization for Faithful Face Animations Using Commodity Smartphones Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology, (1-9)
-
Obremski D, Friedrich P, Haak N, Schaper P and Lugrin B (2022). The impact of mixed-cultural speech on the stereotypical perception of a virtual robot, Frontiers in Robotics and AI, 10.3389/frobt.2022.983955, 9
- Gebhard P, Tsovaltzi D, Schneeberger T and Nunnari F Serious Games with SIAs The Handbook on Socially Interactive Agents, (527-546)
- Prada R and Rato D Socially Interactive Agents in Games The Handbook on Socially Interactive Agents, (493-526)
- Aylett R Interactive Narrative and Story-telling The Handbook on Socially Interactive Agents, (463-492)
- Bickmore T Health-Related Applications of Socially Interactive Agents The Handbook on Socially Interactive Agents, (403-436)
- Cassell J Socially Interactive Agents as Peers The Handbook on Socially Interactive Agents, (331-366)
- Lane H and Schroeder N Pedagogical Agents The Handbook on Socially Interactive Agents, (307-330)
- Hartholt A and Mozgai S Platforms and Tools for SIA Research and Development The Handbook on Socially Interactive Agents, (261-304)
- Kory-Westlund J, Won Park H, Grover I and Breazeal C Long-Term Interaction with Relational SIAs The Handbook on Socially Interactive Agents, (195-260)
- Kopp S and Hassan T The Fabric of Socially Interactive Agents: Multimodal Interaction Architectures The Handbook on Socially Interactive Agents, (77-112)
- Aylett R Foreword The Handbook on Socially Interactive Agents, (xvii-xxiv)
- Lugrin B, Pelachaud C and Traum D (2022). The Handbook on Socially Interactive Agents, 10.1145/3563659, Online publication date: 27-Oct-2022.
Index Terms
- The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 1: Methods, Behavior, Cognition