research-article

Manipulation of an emotional experience by real-time deformed facial feedback

Authors:

Shigeo Yoshida,

Tomohiro Tanikawa,

Michitaka Hirose,

Takuji NarumiAuthors Info & Claims

AH '13: Proceedings of the 4th Augmented Human International Conference

Pages 35 - 42

https://doi.org/10.1145/2459236.2459243

Published: 07 March 2013 Publication History

Abstract

The main goals of this paper involved assessing the efficacy of computer-generated emotion and establishing a method for integrating emotional experience. Human internal processing mechanisms for evoking an emotion by a relevant stimulus have not been clarified. Therefore, there are few reliable techniques for evoking an intended emotion in order to reproduce this process.

However, in the field of cognitive science, the ability to alter a bodily response has been shown to unconsciously generate emotions. We therefore hypothesized emotional experience could be manipulated by having people recognize pseudo-generated facial expressions as changes to their own facial expressions. Our results suggest that this system was able to manipulate an emotional state via visual feedback from artificial facial expressions. We proposed the Emotion Evoking system based on the facial feedback hypothesis.

References

[1]

W. James: The principles of psychology, vol. 2. Dover Publications, New York, 1950.

[2]

S. Schachter, L. Berkowits(Ed.): The interaction of cognitive and physiological determinants of emotional state, Advances in Experimental Social Psychology; Academic Press, New York, vol.1, 1964.

[3]

S. Tomkins: Affect, imagery, and consciousness: The Positive affects; Springer, New York, vol.1, 1962.

[4]

C. Simion and S. Shimojo: Interrupting the cascade-orienting contributes to decision making even in the absence of visual stimulation; Perception and Psychophysics, vol.69, no.4, pp.591--595, 2007.

[5]

P. Ekman and K. Scherer: Expression and the Nature of Emotion, Approaches to emotion; Lawrence Erlbaum, Hillsdale, 1984.

[6]

A. R. Damasio: Looking for Spinoza: Joy, Sorrow, and the Feeling Brain; Houghton Mifflin Harcourt, Boston, 2003.

[7]

F. Strack, F. Martin and S. Stepper: Inhibiting and facilitating conditions of the human smile: A non-obtrusive test of the facial feedback hypothesis; Journal of Personality and Social Psychology, vol.54, no.5, pp.768--777, 1988.

[8]

C. L. Kleinke, T. R. Peterson and T. R. Rutledge: Effects of self-generated facial expressions on mood; Journal of Personality and Social Psychology, vol.74, no.1, pp.272--279, 1998.

[9]

D. Dutton and A. Aron: Some evidence for heightened sexual attraction under conditions of high anxiety; Journal of Personality and Social Psychology, vol.30, no.4, pp. 510--517, 1974.

[10]

S. Valins: Cognitive Effects of False Heart-Rate Feedback; Journal of Personality and Social Psychology, vol.4, no.4, pp.400--408, 1966.

[11]

N. Nishimura, A. Ishi, M. Sato, S. Fukushima and H. Kajimoto: Facilitation of Affection by Tactile Feedback of False Heartbeat; In Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems, pp.2321--2326, 2012.

Digital Library

[12]

T. Narumi, T. Akagawa, Y. A. Seong and M. Hirose: An Entertainment System using Thermal Feedback for Increasing Communication and Social Skills, The 4th International Conference on E-Learning and Games, pp.184--195, 2009.

Digital Library

[13]

H. Tsujita and J. Rekimoto: Smiling Makes Us Happier: Enhancing Positive Mood and Communication with Smile-Encouraging Digital Appliances; In Proceedings of the 13th international conference on Ubiquitous computing. ACM, pp.1--10, 2011.

Digital Library

[14]

Tear machine: http://www.weststarland.com/wp/2011/04/tear-machine-tearful-reflection/

[15]

P. Ekman and W. Friesen: The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, vol.1, pp.49--98, 1969.

[16]

P. Ekman and W. Friesen: Facial Action Coding System: A Technique for the Measurement of Facial Movement; Consulting Psychologists Press, Palo Alto, 1978.

[17]

J. Saragih, S. Lucey and J. Cohn: Deformable Model Fitting by Regularized Landmark Mean-Shifts; International Journal of Computer Vision, 2010.

Digital Library

[18]

S. Schaefer, T. McPhail and J. Warren: Image deformation using moving least squares; ACM Trans. Graph, vol.25, no.3, pp.533--540, 2006.

Digital Library

[19]

P. Ekman and W. Friesen: Unmasking the Face; Prentice Hall, Inc., Englewood Cliffs, New Jersey, 1975.

[20]

L. A. Clark and D. Watson: Mood and the mundane: Relations between daily life events and self-reported mood; Journal of Personality and Social Psychology, vol.54, pp.296--308, 1988.

[21]

D. Watson, L. A. Clark and A. Tellegen: Cross-cultural convergence in the structure of mood: A Japanese replication and comparison with U. S. findings; Journal of Personality and Social Psychology, vol.47, pp.127--144, 1984.

[22]

L. A. Clark and D. Watson: The Japanese Positive and Negative Affect Schedule: Factor-based scales for the assessment of mood; unpublished manuscript. University of Iowa, 1989.

[23]

A. Criminisi, J. Shotton, A. Blake, and P. H. S. Torr. 2003. Gaze Manipulation for One-to-one Teleconferencing. In Proceedings of the Ninth IEEE International Conference on Computer Vision, Vol. 2, pp.191--198, 2003.

Digital Library

[24]

R. Yang and Z. Zhang: Eye Gaze Correction with Stereovision for Video-Teleconferencing; IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.26, no.7, pp.956--960, July, 2004.

Digital Library

[25]

C. Kuster, T. Popa, J. Bazin, C. Gotsman and M. Gross: Gaze Correction for Home Video Conferencing; ACM Trans. Graph. (Proc. of ACM SIGGRAPH ASIA), vol.31, no.6, pp.174--180, 2012.

Digital Library

Cited By

Kato YKimura RNakajima T(2024)TippyMirror: Recollecting People’s Positive Moments Based on Mirror MetaphorInformation Integration and Web Intelligence10.1007/978-3-031-78093-6_14(167-183)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/978-3-031-78093-6_14
Jain AChoi KIshii HMaes P(2023)Modulating Interoceptive Signals for Influencing the Conscious ExperienceExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585791(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585791
Yang CYoshida SKuzuoka HNarumi TYamashita N(2023)Affective Profile Pictures: Exploring the Effects of Changing Facial Expressions in Profile Pictures on Text-Based CommunicationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581061(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581061
Show More Cited By

Index Terms

Manipulation of an emotional experience by real-time deformed facial feedback
1. Human-centered computing

Recommendations

Facial design for humanoid robot
APCHI '12: Proceedings of the 10th asia pacific conference on Computer human interaction

In this research, the authors succeeded in creating facial expressions made with the minimum necessary elements for recognizing a face. The elements are two eyes and a mouth made using precise circles, which are transformed to make facial expressions ...
Emotional facial expression interface: effects of displayed facial designs
Ergo'IA '10: Proceedings of the Ergonomie et Informatique Avancee Conference

In supporting the visual-mediated emotional recognition, little research has centred on analysing the effect of presenting different combinatorial facial designs. Moreover, in the theoretical field of emotions, research on the recognition of emotional ...
The communicative role of non-face emojis

Emojis have evolved from imitations of facial expressions meant to communicate affect into pictures of objects, food, and places that are not directly linked to affect. While emojis that resemble facial expressions are well-researched, emojis that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AH '13: Proceedings of the 4th Augmented Human International Conference

March 2013

254 pages

ISBN:9781450319041

DOI:10.1145/2459236

General Chair:
Albrecht Schmidt
University of Stuttgart, Germany
,
Program Chairs:
Andreas Bulling
Max Planck Institute for Informatics Saarbrücken, Germany
,
Christian Holz
Hasso Plattner Institute, Germany

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SimTech: SimTech
Universität Stuttgart: Universität Stuttgart

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministry of Education, Culture, Sports, Science, and Technology

Conference

AH'13

Sponsor:

SimTech
Universität Stuttgart

AH'13: 4th Augmented Human International Conference

March 7 - 8, 2013

Stuttgart, Germany

Acceptance Rates

AH '13 Paper Acceptance Rate 49 of 69 submissions, 71%;

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
903
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kato YKimura RNakajima T(2024)TippyMirror: Recollecting People’s Positive Moments Based on Mirror MetaphorInformation Integration and Web Intelligence10.1007/978-3-031-78093-6_14(167-183)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/978-3-031-78093-6_14
Jain AChoi KIshii HMaes P(2023)Modulating Interoceptive Signals for Influencing the Conscious ExperienceExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585791(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585791
Yang CYoshida SKuzuoka HNarumi TYamashita N(2023)Affective Profile Pictures: Exploring the Effects of Changing Facial Expressions in Profile Pictures on Text-Based CommunicationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581061(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581061
Leong JPerteneder FRajvee MMaes P(2023)“Picture the Audience...”: Exploring Private AR Face Filters for Online Public SpeakingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581039(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581039
Shimizu KNaruse SNishida JKasahara S(2023)Morphing Identity: Exploring Self-Other Identity Continuum through Interpersonal Facial Morphing ExperienceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580853(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580853
Futami KYanase SMurao KTerada T(2022)Unconscious Other’s Impression Changer: A Method to Manipulate Cognitive Biases That Subtly Change Others’ Impressions Positively/Negatively by Making AI Bias in Emotion Estimation AISensors10.3390/s2224996122:24(9961)Online publication date: 17-Dec-2022
https://doi.org/10.3390/s22249961
Futami KKawahigashi DMurao K(2022)Mindless Memorization Booster: A Method to Influence Memorization Power Using Attention Induction Phenomena Caused by Visual Interface Modulation and Its Application to Memorization Support for English Vocabulary LearningElectronics10.3390/electronics1114227611:14(2276)Online publication date: 21-Jul-2022
https://doi.org/10.3390/electronics11142276
Futami KSeki TMurao K(2022)Unconscious load changer: Designing method to subtly influence load perception by simply presenting modified myoelectricity sensor informationFrontiers in Computer Science10.3389/fcomp.2022.9145254Online publication date: 17-Oct-2022
https://doi.org/10.3389/fcomp.2022.914525
Ban YKarasawa HFukui RWarisawa S(2022)Development of a Cushion-Shaped Device to Induce Respiratory Rhythm and Depth for Enhanced Relaxation and Improved CognitionFrontiers in Computer Science10.3389/fcomp.2022.7707014Online publication date: 24-Mar-2022
https://doi.org/10.3389/fcomp.2022.770701
Jain ASchoeller FZhang EMaes P(2022)Frisson: Leveraging Metasomatic Interactions for Generating Aesthetic ChillsProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556626(148-158)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556626
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten