research-article

Four-participant group conversation

Computer Speech and Language, Volume 33, Issue 1

Pages 1 - 24

https://doi.org/10.1016/j.csl.2014.12.001

Published: 01 September 2015 Publication History

Abstract

HighlightsWe present a framework for facilitation robots in four-participant conversations.The robot regulates imbalanced engagement density as the fourth participant.We propose procedures for obtaining initiatives to control the situation.Conversational situations and facilitation procedures are modeled as POMDP.The experimental results show the evidence of procedures' acceptability. In this paper, we present a framework for facilitation robots that regulate imbalanced engagement density in a four-participant conversation as the forth participant with proper procedures for obtaining initiatives. Four is the special number in multiparty conversations. In three-participant conversations, the minimum unit for multiparty conversations, social imbalance, in which a participant is left behind in the current conversation, sometimes occurs. In such scenarios, a conversational robot has the potential to objectively observe and control situations as the fourth participant. Consequently, we present model procedures for obtaining conversational initiatives in incremental steps to harmonize such four-participant conversations. During the procedures, a facilitator must be aware of both the presence of dominant participants leading the current conversation and the status of any participant that is left behind. We model and optimize these situations and procedures as a partially observable Markov decision process (POMDP), which is suitable for real-world sequential decision processes. The results of experiments conducted to evaluate the proposed procedures show evidence of their acceptability and feeling of groupness.

References

[1]

Bales, R.F., 1950. Interaction Process Analysis, Cambridge, MA.

[2]

Benne, K.D., Sheats, P., 1948. Functional roles of group members. J. Soc. Issues 4 (2), 41-49.

[3]

Bohus, D., Horvitz, E., 2009. Models for multiparty engagement in open-world dialog. In: Proceedings of the SIGDIAL 2009 Conference: The 10th Annua Meeting of the Special Interest Group on Discourse and Dialogue. Association for Computational Linguistics, pp. 225-234.

[4]

Bohus, D., Horvitz, E., 2010. Facilitating multiparty dialog with gaze, gesture, and speech. In: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction. ACM, p. 5.

[5]

Campbell, N., Scherer, S., 2010. Comparing measures of synchrony and alignment in dialogue speech timing with respect to turn-taking activity. In: INTERSPEECH, pp. 2546-2549.

[6]

Chao, C., Thomaz, A.L., 2012. Timing in multimodal turn-taking interactions: control and analysis using timed Petri nets. J. Hum. Robot Interact. 1(1).

[7]

Clark, H.H., 1996. Using Language, vol. 4. Cambridge University Press, Cambridge.

[8]

Dohsaka, K., Asai, R., Higashinaka, R., Minami, Y., Maeda, E., 2009. Effects of conversational agents on human communication in thought-evoking multi-party dialogues. In: Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue. Association for Computational Linguistics, pp. 217-224.

[9]

Fleiss, J.L., Levin, B., Paik, M.C., 2013. Statistical Methods for Rates and Proportions. John Wiley & Sons.

[10]

Fujie, S., Yamahata, T., Kobayashi, T., 2006. Conversation robot with the function of gaze recognition. In: 2006 6th IEEE-RAS International Conference on Humanoid Robots. IEEE, pp. 364-369.

[11]

Gatica-Perez, D., McCowan, I., Zhang, D., Bengio, S., 2005. Detecting group interest-level in meetings. In: ICASSP, vol. 1. Citeseer, pp. 4 89-492.

[12]

Goffman, E., 1981. Forms of Talk. University of Pennsylvania Press.

[13]

Johansson, M., Skantze, G., Gustafson, J., 2013. Head pose patterns in multiparty human-robot team-building interactions. In: Social Robotics. Springer, pp. 351-360.

[14]

Jokinen, K., 2011. Turn taking, utterance density, and gaze patterns as cues to conversational activity. In: Proceedings of ICMI 2011 Workshop Multimodal Corpora for Machine Learning: Taking Stock and Road mapping the Future, Alicante, Spain, pp. 31-36.

[15]

Jovanovic, N., Nijholt, A., et al., 2006. Addressee Identification in Face-to-Face Meetings. Association for Computational Linguistics.

[16]

Katzenmaier, M., Stiefelhagen, R., Schultz, T., 2004. Identifying the addressee in human-human-robot interactions based on head pose and speech. In: Proceedings of the 6th International Conference on Multimodal Interfaces. ACM, pp. 144-151.

[17]

Kobayashi, T., Fujie, S., 2013. Conversational robots: an approach to conversation protocol issues that utilizes the paralinguistic information available in a robot-human setting. Acoust. Sci. Technol. 34 (2), 64-72.

[18]

Kumar, R., Beuth, J.L., Rose, C.P., 2011. Conversational strategies that support idea generation productivity. In: Groups, 9th Intl. Conf. on Computer Supported Collaborative Learning, Hong Kong, p. 160; Kumar, R., Rose, C.P., 2010. Conversational tutors with rich interactive behaviors that support collaborative learning. In: Workshop on Opportu, Citeseer, 2011.

[19]

Martin, J.R., White, P.R.R., 2005. The Language of Evaluation. Palgrave Macmillan, Basingstoke/New York.

[20]

Matsusaka, Y., Tsuyoshi, T., Kobayashi, T., 2003. Conversation robot participating in group conversation. IEICE Trans. Inf. Syst. 86 (1), 26-36.

[21]

Matsuyama, Y., Taniyama, H., Fujie, S., Kobayashi, T., 2008. Designing communication activation system in group communication. In: 8thIEEE-RAS International Conference on Humanoid Robots, 2008. Humanoids 2008. IEEE, pp. 629-634.

[22]

Matsuyama, Y., Hosoya, K., Taniyama, H., Tsuboi, H., Fujie, S., Kobayashi, T., 2009. SCHEMA: multi-party interaction-oriented humanoid robot. In: ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation. ACM, p. 82.

[23]

Matsuyama, Y., Fujie, S., Taniyama, H., Kobayashi, T., 2010. Psychological evaluation of a group communication activation robot in a party game. In: Eleventh Annual Conference of the International Speech Communication Association, pp. 3046-3049.

[24]

Matsuyama, Y., Saito, A., Fujie, S., Kobayashi, T., 2014. Automatic expressive opinion sentence generation for enjoyable conversational systems. IEEE/ACM Transactions on Audio, Speech, and Language Processing, http://dx.doi.org/10.1109/TASLP.2014.2363589.

[25]

Nakano, T., Fujie, S., Kobayashi, T., 2006. MONEA: message-oriented networked-robot architecture. In: Proceedings 2006 IEEE International Conference on Robotics and Automation. ICRA 2006. IEEE, pp. 194-199.

[26]

Raux, A., Eskenazi, M., 2009. A finite-state turn-taking model for spoken dialog systems. In: Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, pp. 629-637.

[27]

Sacks, H., Jefferson, G., Schegloff, E.A., 1995. Lectures on Conversation, vol. 1. Blackwell, Oxford.

[28]

Schegloff, E.A., Sacks, H., 1973. Opening up closings. Semiotica 8 (4), 289-327.

[29]

Schegloff, E.A., 2007. Sequence Organization in Interaction, vol. 1: A Primer in Conversation Analysis. Cambridge University Press.

[30]

Sidner, C.L., Kidd, C.D., Lee, C., Lesh, N., 2004. Where to look: a study of human-robot engagement. In: Proceedings of the 9th International Conference on Intelligent User Interfaces. ACM, pp. 78-84.

[31]

Smith, T., Simmons, R., 2012. Point-Based POMDP Algorithms: Improved Analysis and Implementation, arXiv:1207.1412.

[32]

Whittaker, S., Stenton, P., 1988. Cues and control in expert-client dialogues. In: Proceedings of the 26th Annual Meeting on Association for Computational Linguistics, ACL'88. Association for Computational Linguistics, Stroudsburg, PA, USA, pp. 123-130.

[33]

Williams, J., Young, S., 2007. Partially observable Markov decision processes for spoken dialog systems. Comput. Speech Lang. 21 (2), 393-422.

Digital Library

Cited By

Gillet SVázquez MAndrist SLeite ISebo S(2024)Interaction-Shaping Robotics: Robots That Influence Interactions between Other AgentsACM Transactions on Human-Robot Interaction10.1145/364380313:1(1-23)Online publication date: 2-Feb-2024
https://dl.acm.org/doi/10.1145/3643803
Kim HHan BKim JLubis MKim GHwang J(2024)Engaged and Affective Virtual Agents: Their Impact on Social Presence, Trustworthiness, and Decision-Making in the Group DiscussionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642917(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642917
Ohshima NTokunaga HFujimori RKaneko HMukawa N(2024)Designing Conversational Human-Robot Collaborations in SilenceDesign, User Experience, and Usability10.1007/978-3-031-61353-1_7(97-113)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-61353-1_7
Show More Cited By

Recommendations

Annotating participant reference in English spoken conversation
LAW IV '10: Proceedings of the Fourth Linguistic Annotation Workshop

In conversational language, references to people (especially to the conversation participants, e.g., I, you, and we) are an essential part of many expressed meanings. In most conversational settings, however, many such expressions have numerous ...
Simple multi-party video conversation system focused on participant eye gaze: "Ptolemaeus" provides participants with smooth turn-taking
Gaze-In '12: Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

This paper shows a prototype system that provides a natural multi-party conversation environment among participants in different places. Eye gaze is an important feature for maintaining smooth multi-party conversations because it indicates whom the ...
A generative model of group conversation
FDG '17: Proceedings of the 12th International Conference on the Foundations of Digital Games

Conversations with non-player characters (NPCs) in games are typically confined to dialogue between a human player and a virtual agent, where the conversation is initiated and controlled by the player. To create richer, more believable environments for ...

Comments

Information & Contributors

Information

Published In

cover image Computer Speech and Language

Computer Speech and Language Volume 33, Issue 1

September 2015

154 pages

ISSN:0885-2308

Issue’s Table of Contents

Copyright © The Authors.

Publisher

Academic Press Ltd.

United Kingdom

Publication History

Published: 01 September 2015

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gillet SVázquez MAndrist SLeite ISebo S(2024)Interaction-Shaping Robotics: Robots That Influence Interactions between Other AgentsACM Transactions on Human-Robot Interaction10.1145/364380313:1(1-23)Online publication date: 2-Feb-2024
Kim HHan BKim JLubis MKim GHwang J(2024)Engaged and Affective Virtual Agents: Their Impact on Social Presence, Trustworthiness, and Decision-Making in the Group DiscussionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642917(1-17)Online publication date: 11-May-2024
Ohshima NTokunaga HFujimori RKaneko HMukawa N(2024)Designing Conversational Human-Robot Collaborations in SilenceDesign, User Experience, and Usability10.1007/978-3-031-61353-1_7(97-113)Online publication date: 29-Jun-2024
Steenstra IMurali PPerkins RJoseph NPaasche-Orlow MBickmore TLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)Changing Parent Attitudes Towards HPV Vaccination by Including Adolescents in Multiparty Counseling using Virtual AgentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607294(1-8)Online publication date: 19-Sep-2023
Chew JNakamura KCastellano GRiek LCakmak MLeite I(2023)Who to Teach a Robot to Facilitate Multi-party Social Interactions?Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3580056(127-131)Online publication date: 13-Mar-2023
Murali PSteenstra IYun HShamekhi ABickmore T(2023)Improving Multiparty Interactions with a Robot Using Large Language ModelsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585602(1-8)Online publication date: 19-Apr-2023
Miyake TWang YYang PSugano S(2023)Feasibility Study on Parameter Adjustment for a Humanoid Using LLM Tailoring Physical CareSocial Robotics10.1007/978-981-99-8715-3_20(230-243)Online publication date: 3-Dec-2023
Gillet SVázquez MPeters CYang FLeite I(2022)Multiparty Interaction Between Humans and Socially Interactive AgentsThe Handbook on Socially Interactive Agents10.1145/3563659.3563665(113-154)Online publication date: 27-Oct-2022
Mizrahi EDanzig NGordon G(2022)vRobotatorProceedings of the ACM on Human-Computer Interaction10.1145/35555736:CSCW2(1-22)Online publication date: 11-Nov-2022
(2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents