research-article

Footing in human-robot conversations: how robots might shape participant roles using gaze cues

Authors:

Toshiyuki Shiwa,

Takayuki Kanda,

Hiroshi Ishiguro,

Norihiro HagitaAuthors Info & Claims

HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction

Pages 61 - 68

https://doi.org/10.1145/1514095.1514109

Published: 09 March 2009 Publication History

Abstract

During conversations, speakers establish their and others' participant roles (who participates in the conversation and in what capacity)--or "footing" as termed by Goffman-using gaze cues. In this paper, we study how a robot can establish the participant roles of its conversational partners using these cues. We designed a set of gaze behaviors for Robovie to signal three kinds of participant roles: addressee, bystander, and overhearer. We evaluated our design in a controlled laboratory experiment with 72 subjects in 36 trials. In three conditions, the robot signaled to two subjects, only by means of gaze, the roles of (1) two addressees, (2) an addressee and a bystander, or (3) an addressee and an overhearer. Behavioral measures showed that subjects' participation behavior conformed to the roles that the robot communicated to them. In subjective evaluations, significant differences were observed in feelings of groupness between addressees and others and liking between overhearers and others. Participation in the conversation did not affect task performance-measured by recall of information presented by the robot-but affected subjects' ratings of how much they attended to the task.

References

[1]

Argyle, M. and Dean, J. Eye-contact, distance and affiliation. Sociometry, 28 (3), 289--304, 1965

[2]

Argyle, M. and Ingham, R. Gaze, mutual gaze and proximity. Semiotica, 6, 32--49, 1972.

[3]

Bailenson, J. N. et al. Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Human Communication Research, 31 (4), 511--537, 2005.

[4]

Bales, R. F. et al. Channels of communication in small groups. American Sociological Review, 16 (4), 461--68, 1951.

[5]

Bales, R. F. Personality and Interpersonal Behavior. Holt, Rinehart, and Winston, 1970.

[6]

Beattie, G. The role of language production processes in the organization of behavior in face-to-face interaction. In B. Butterworth (Ed.) Language Production, 1, 69--107, 1980.

[7]

Bennewitz, M. et al. Towards a humanoid museum guide robot that interacts with multiple persons. In Proc. HUMANOIDS'05, 2005.

[8]

Cassell, J. et al. Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In Computer Graphics Proc., 413--420, 1994.

Digital Library

[9]

Cassell, J. et al. Embodiment in conversational interfaces: Rea. In Proc. CHI'99, 520--527, 1999.

Digital Library

[10]

Clark, H. H. and Carlson, T. B. Hearers and Speech Acts. Language, 58 (2), 332--373, 1982.

[11]

Clark, H. H. Using Language. Cambridge University Press, 1996.

[12]

Dictionary.com. Unabridged (v 1.1). Retrieved July 21, 2008, from http://dictionary.reference.com/browse/footing, 2008.

[13]

Duncan, S. Some signals and rules for taking speaking turns in conversations. In Nonverbal Communication: Readings with Commentary, Oxford University Press, 1974

[14]

Efran, J. S. Looking for approval: effects on visual behavior of approbation from persons differing in importance. J. Personality and Social Psychology, 10 (1), 21--25, 1968.

[15]

Evers, V. et al. Relational vs. group self-construal: untangling the role of national culture in HRI. In Proc. HRI'08, 255--262, 2008

Digital Library

[16]

Exline, R. V. Explorations in the process of person perception: visual interaction in relation to competition, sex and need for affiliation. Journal of Personality, 31, 1--20, 1963.

[17]

Goffman, E. On face-work. Psychiatry, 18 (3), 213--231, 1955.

[18]

Goffman, E. Behavior in Public Places. The Free Press, 1963.

[19]

Goffman, E. Footing. Semiotica, 25 (1/2), 1--29, 1979.

[20]

Levinson, S. C. Putting linguistics on a proper footing: Explorations in Goffman's concepts of participation. In P. Drew and A. Wootton (Eds.) Erving Goffman: Exploring the Interaction Order, 161--227. Polity, 1982.

[21]

Garau, M. et al. The impact of eye gaze on communication using humanoid avatars. In Proc. CHI'01, 2001.

Digital Library

[22]

Colburn, A. et al. The role of eye gaze in avatar mediated conversational interfaces. Microsoft Research Report, 81, 2000.

[23]

Goodwin, C. Restarts, pauses, and the achievement of mutual gaze at turn-beginning. Sociological Inquiry, 50, 272--302, 1980.

[24]

Goodwin, C. Conversational Organization: Interaction between Speakers and Hearers. Academic Press, 1981.

[25]

Hanks, W. Language and Communicative Practices. Westview, 1996.

[26]

Heylen, D. et al. Controlling the Gaze of Conversational Agents. In J. van Kuppevelt, L. et al (Eds.), Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems. Kluwer, 2005.

[27]

Hymes, D. Models of the Interaction of Language and Social Life. In J. J. Gumperz and D. Hymes (Eds.), Directions in Sociolinguistics: The Ethnography of Comm., 35--77. Holt, Rinehalt & Winston, 1972.

[28]

Imai, M. et al. Robot mediated round table: Analysis of the effect of robot's gaze. In Proc. ROMAN'02, 411--416, 2002

[29]

Kanda, T. et al. Body Movement Analysis of Human-Robot Interaction. In Proc. IJCAI'03, 177--182, 2003.

Digital Library

[30]

Kendon, A. Some functions of gaze-direction in social interaction. Acta Psychol (Amst), 26 (1), 22--63, 1967.

[31]

Kuno, Y. et al. Museum guide robot based on sociological interaction analysis. In Proc. CHI'07, 2007.

Digital Library

[32]

Libby, W. L. Eye contact and direction of looking as stable individual differences. J. Exp. Research in Personality, 4, 303--312, 1970.

[33]

Matsusaka, Y. et al. Modeling of Conversational Strategy for the Robot Participating in the Group Conversation. In Proc. EUROSPEECH'01, 2001.

[34]

Mutlu, B. et al. A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior. In Proc. of HUMANOIDS'06, 2006.

[35]

Nielsen, G. Studies in Self-Confrontation. Monksgaard, 1962.

[36]

Rehm, M. and Andre, E. Where do they look? Gaze behaviors of multiple users interacting with an embodied conversational agent. In Proc. of IVA'05, 2005

Digital Library

[37]

Sacks, H. et al. A simplest systematics for the organization of turn-taking for conversation. Language, 50 (4), 696--735, 1974.

[38]

Schegloff, E. A. Sequencing in Conversational Openings. American Anthropologist, 70 (6), 1075--1095, 1968.

[39]

Schegloff, E. A. Overlapping talk and the organization of turn-taking for conversation. Language in Society, 29 (1), 1--63, 2000.

[40]

Sidner, C. L., et al. Where to look: A study of human-robot engagement. In Proc. IUI'04, 2004.

Digital Library

[41]

Trafton, J. G., et al. Integrating vision and audition withing a cognitive architecture to track conversations. In Proc. HRI'08, 2008.

Digital Library

[42]

Vertegaal, R., et al. Effects of Gaze on Multiparty Mediated Communication. In Proc. Graphics Interface'00, 92--102, 2000.

[43]

Vertegaal, R. et al. Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes. In Proc. CHI'01, 2001.

Digital Library

[44]

Weisbrod, R. M. Looking behavior in a discussion group. Unpublished paper, Department of Psychology, Cornell University, 1965.

[45]

Wilkes-Gibbs, D. and Clark, H. H. Coordinating beliefs in conversation. J. Memory and Language, 31 (2), 183--194, 1992.

[46]

Yamazaki, A. et al. Precision timing in human-robot interaction: Coordination of head movement and utterance. In Proc. CHI'08, 2008.

Digital Library

[47]

Yoshikawa, Y. et al. Responsive robot gaze to interaction partner. In Proc. Robotics: Science and Systems, 2006.

Cited By

Karwowski JSzynkiewicz WNiewiadomska-Szynkiewicz E(2024)Bridging Requirements, Planning, and Evaluation: A Review of Social Robot NavigationSensors10.3390/s2409279424:9(2794)Online publication date: 27-Apr-2024
https://doi.org/10.3390/s24092794
Zhao RWang YLuo SShou STang P(2024)Gaze-Swin: Enhancing Gaze Estimation with a Hybrid CNN-Transformer Network and Dropkey MechanismElectronics10.3390/electronics1302032813:2(328)Online publication date: 12-Jan-2024
https://doi.org/10.3390/electronics13020328
Ren YClement J(2024)Augmenting Human Teams with Robots in Knowledge Work Settings: Insights from the LiteratureACM Transactions on Human-Robot Interaction10.1145/364988413:2(1-34)Online publication date: 14-Jun-2024
https://dl.acm.org/doi/10.1145/3649884
Show More Cited By

Index Terms

Footing in human-robot conversations: how robots might shape participant roles using gaze cues
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Conversational gaze mechanisms for humanlike robots

During conversations, speakers employ a number of verbal and nonverbal mechanisms to establish who participates in the conversation, when, and in what capacity. Gaze cues and mechanisms are particularly instrumental in establishing the participant roles ...
Identification and Engagement of Passive Subjects in Multiparty Conversations by a Humanoid Robot
HRI '21 Companion: Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction

In this work, we present a novel human-robot interaction (HRI) method to detect and engage passive subjects in multiparty conversations using a humanoid robot. Voice activity detection and speaker localization are combined with facial recognition to ...
Spontaneous spoken dialogues with the furhat human-like robot head
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

Furhat [1] is a robot head that deploys a back-projected animated face that is realistic and human-like in anatomy. Furhat relies on a state-of-the-art facial animation architecture allowing accurate synchronized lip movements with speech, and the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '09: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction

March 2009

348 pages

ISBN:9781605584041

DOI:10.1145/1514095

General Chairs:
Matthias Scheutz
Indiana University, USA
,
François Michaud
Université de Sherbrooke, Canada
,
Program Chairs:
Pamela Hinds
Stanford University, USA
,
Brian Scassellati
Yale University, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HRI09

Sponsor:

HRI09: International Conference on Human Robot Interaction

March 9 - 13, 2009

California, La Jolla, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

253
Total Citations
View Citations
2,401
Total Downloads

Downloads (Last 12 months)149
Downloads (Last 6 weeks)19

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Karwowski JSzynkiewicz WNiewiadomska-Szynkiewicz E(2024)Bridging Requirements, Planning, and Evaluation: A Review of Social Robot NavigationSensors10.3390/s2409279424:9(2794)Online publication date: 27-Apr-2024
https://doi.org/10.3390/s24092794
Zhao RWang YLuo SShou STang P(2024)Gaze-Swin: Enhancing Gaze Estimation with a Hybrid CNN-Transformer Network and Dropkey MechanismElectronics10.3390/electronics1302032813:2(328)Online publication date: 12-Jan-2024
https://doi.org/10.3390/electronics13020328
Ren YClement J(2024)Augmenting Human Teams with Robots in Knowledge Work Settings: Insights from the LiteratureACM Transactions on Human-Robot Interaction10.1145/364988413:2(1-34)Online publication date: 14-Jun-2024
https://dl.acm.org/doi/10.1145/3649884
Gillet SVázquez MAndrist SLeite ISebo S(2024)Interaction-Shaping Robotics: Robots That Influence Interactions between Other AgentsACM Transactions on Human-Robot Interaction10.1145/364380313:1(1-23)Online publication date: 2-Feb-2024
https://dl.acm.org/doi/10.1145/3643803
Erel HVázquez MSebo SSalomons NGillet SScassellati B(2024)RoSI: A Model for Predicting Robot Social InfluenceACM Transactions on Human-Robot Interaction10.1145/364151513:2(1-22)Online publication date: 14-Jun-2024
https://dl.acm.org/doi/10.1145/3641515
Claure HCandon KClark OVázquez MGrollman DBroadbent EJu WSoh HWilliams T(2024)Multiplayer Space Invaders: A Platform for Studying Evolving Fairness Perceptions in Human-Robot InteractionCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640687(347-350)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640687
Kim CLee CMutlu BGrollman DBroadbent EJu WSoh HWilliams T(2024)Understanding Large-Language Model (LLM)-powered Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634966(371-380)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634966
Hou YCheon EJung MGrollman DBroadbent EJu WSoh HWilliams T(2024)Power in Human-Robot InteractionProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634949(269-282)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634949
Sivridag FMani NGrollman DBroadbent EJu WSoh HWilliams T(2024)Children's Word Learning from Socially Contingent Robots Under Active vs. Passive Learning ConditionsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634931(669-677)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610977.3634931
Uchida TKameo NIshiguro H(2024)Improving the closing sequences of interaction between human and robot through conversation analysisScientific Reports10.1038/s41598-024-81353-714:1Online publication date: 28-Nov-2024
https://doi.org/10.1038/s41598-024-81353-7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents