demonstration

A social interaction system for studying humor with the Robot NAO

Authors:

Laurence Y. Devillers,

Mariette SouryAuthors Info & Claims

ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction

Pages 313 - 314

https://doi.org/10.1145/2522848.2531756

Published: 09 December 2013 Publication History

Get Access

Abstract

The video of our demonstrator presents a social interaction system for studying humor with the Aldebaran robot NAO. Our application records and analyzes audio and video stream to provide real-time feedback. Using this dialog system during show & tell sessions at Interspeech 2013, we have collected different kind of laughter (positive and negative) from 45 subjects. The participants were involved in a verbal exchange with NAO, including tongue-twisters games and jokes, as well as witty remarks and laughs from the robot. The conversation data captured is used here to study subject behaviors from various personalities and cultural backgrounds.

References

[1]

Reeves B., Nass, C., The media equation: How people treat computers, television, and new media like real people and places. New York, NY: Cambridge Univ. Press, 1996.

Digital Library

Google Scholar

[2]

Schröder, M. Experimental study of affect bursts, Speech Communication -- Special session on speech and emotion, vol. 40, Issue 1--2. 2003.

Digital Library

Google Scholar

[3]

Krumhuber E., Scherer, K., Affect bursts: Dynamic patterns of facial expressions, Journal of Emotion. 2011 Aug; 11 (4):742.

Google Scholar

[4]

Carter, A., Automatic acoustic laughter detection, Master Thesis, Keele University, 2000.

Google Scholar

[5]

Trouvain, J., Segmenting phonetic units in laughter, in conf. Phonetic Sciences, Barcelona, 2003 pp. 2793--2796.

Google Scholar

[6]

Schuller, B., Steidl S., Batliner, A., Vinciarelli A., Scherer K., Ringeval, F., Chetouani, M., Weninger, F., Eyben, F., Marchi, E., Mortillaro, M., Salamin, H., Polychroniou, A., Valente F., Kim, S, The INTERSPEECH2013 Computational Paralinguistics Challenge Social Signals, Conflict, Emotion, Autism; Interspeech 2013.

Google Scholar

[7]

Devillers, L. Vidrascu L., Positive and negative emotional states behind the laughs in spontaneous spoken dialogs. Workshop Laughter 2007 of ICPHs 2007.

Google Scholar

[8]

Szameitat, D. P., et al. Differentiation of Emotions in Laughter at the Behavioral Level. 2009 Emotion 9 (3), 399.

Google Scholar

[9]

McKeown, G. Cowie, R., Curran, W., Ruch, W., Douglas-Cowie E., ILHAIRE Laughter Database. Proceedings of the 4th International Workshop on EMOTION SENTIMENT & SOCIAL SIGNALS, LREC 2012, Istanbul, Turkey, ELRA.

Google Scholar

[10]

Soury, M., Gossart, C., Adda, M., Devillers L., A tool to elicit and collect multicultural and multimodal laughter, Show & Tell, Proceedings of Interspeech, 2013.

Google Scholar

Cited By

View all

Steinhaeusser SKnauer LLugrin B(2024)What a Laugh! – Effects of Voice and Laughter on a Social Robot’s Humorous Appeal and Recipients’ Transportation and Emotions in Humorous Robotic Storytelling2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731342(2131-2138)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731342
Mirnig NStadler SStollnberger GGiuliani MTscheligi M(2016)Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2016.7745106(166-171)Online publication date: Aug-2016
https://doi.org/10.1109/ROMAN.2016.7745106

Index Terms

A social interaction system for studying humor with the Robot NAO
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Conversational speech synthesis and the need for some laughter

This paper reports progress in the synthesis of conversational speech, from the viewpoint of work carried out on the analysis of a very large corpus of expressive speech in normal everyday situations. With recent developments in concatenative techniques,...
Classification of social laughter in natural conversational speech

We report progress towards developing a sensor module that categorizes types of laughter for application in dialogue systems or social-skills training situations. The module will also function as a component to measure discourse engagement in natural ...
Looking for Laughs: Gaze Interaction with Laughter Pragmatics and Coordination
ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

Laughter and gaze have an important role in managing and coordi-nating social interactions. In the current work, using a multimodal corpus of dyadic taste-testing interactions, we explore whether laughs performing different pragmatic functions are ...

Comments

Information & Contributors

Information

Published In

ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction

December 2013

630 pages

ISBN:9781450321297

DOI:10.1145/2522848

General Chairs:
Julien Epps
The University of New South Wales, Australia
,
Fang Chen
National ICT Australia, Australia
,
Sharon Oviatt
Incaa Designs, USA
,
Kenji Mase
Nagoya University, Japan
,
Program Chairs:
Andrew Sears
Rochester Institute of Technology, USA
,
Kristiina Jokinen
University of Helsinki, Finland
,
Björn Schuller
Technische Universität München, Germany

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 December 2013

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

ICMI '13

Sponsor:

SIGCHI

ICMI '13: 2013 International Conference on Multimodal Interaction

December 9 - 13, 2013

Sydney, Australia

Acceptance Rates

ICMI '13 Paper Acceptance Rate 49 of 133 submissions, 37%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
203
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Steinhaeusser SKnauer LLugrin B(2024)What a Laugh! – Effects of Voice and Laughter on a Social Robot’s Humorous Appeal and Recipients’ Transportation and Emotions in Humorous Robotic Storytelling2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731342(2131-2138)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731342
Mirnig NStadler SStollnberger GGiuliani MTscheligi M(2016)Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2016.7745106(166-171)Online publication date: Aug-2016
https://doi.org/10.1109/ROMAN.2016.7745106

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Conversational speech synthesis and the need for some laughter

Classification of social laughter in natural conversational speech

Looking for Laughs: Gaze Interaction with Laughter Pragmatics and Coordination

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations