Constructionist steps towards an autonomously empathetic system
Article No.: 4, Pages 1 - 6
Abstract
Prior efforts to create an autonomous computer system capable of predicting what a human being is thinking or feeling from facial expression data have been largely based on outdated, inaccurate models of how emotions work that rely on many scientifically questionable assumptions. In our research, we are creating an empathetic system that incorporates the latest provable scientific understanding of emotions: that they are constructs of the human mind, rather than universal expressions of distinct internal states. Thus, our system uses a user-dependent method of analysis and relies heavily on contextual information to make predictions about what subjects are experiencing. Our system's accuracy and therefore usefulness are built on provable ground truths that prohibit the drawing of inaccurate conclusions that other systems could too easily make.
References
[1]
Tadas Baltrušaitis, Marwa Mahmoud, Peter Robinson. 2015. Cross-dataset learning and person-specific normalisation for automatic Action Unit detection. In Proc. 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG '15), 1--6.
[2]
Tadas Baltrušaitis, Peter Robinson, Louis-Philippe Morency. 2013. Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild. In Proc. International Conference on Computer Vision Workshops, 300 Faces in-the-Wild Challenge (ICCVW '13).
[3]
Tadas Baltrušaitis, Amir Zadeh, Yao Chong Lim, Louis-Philippe Morency. 2018. OpenFace 2.0: Facial Behavior Analysis Toolkit. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FG '18), 59--66.
[4]
Lisa Feldman Barrett. 2017. How Emotions are Made: The Secret Life of the Brain. Houghton Mifflin Harcourt Publishing Company, Boston, MA.
[5]
Paul Ekman, Wallace Friesen, Joseph C. Hager. 2002. Facial Action Coding System: The Manual on CD ROM. A Human Face, Salt Lake City, UT.
[6]
Paul Ekman, Wallace V. Friesen. 1971. Constants Across Cultures in the Face and Emotion. Journal of Personality and Social Psychology. 17, 2: 129--149.
[7]
Carl-Herman Hjortsjö. 1970. Man's face and mimic language. Student Research. Universitäts und Landesbibliothek Tirol, Lund, Sweden.
[8]
Michael Xuelin Huang, Grace Ngai, Kien A. Hua, Stephen Chan, and Hong Va Leong. 2015. Identifying User-Specific Facial Affects from Spontaneous Expressions with Minimal Annotation. IEEE Transactions on Affective Computing. 7, 4: 99.
[9]
G. Littlewort, M. S. Bartlett, I. Fasel, J. Susskind, and J. Movellan. 2004. Dynamics of facial expression extracted automatically from video. In Proc. Conf. Comput. Vis. Pattern Recog. Workshop (CVPR '04). 80.
[10]
Daniel McDuff, Marwa Mahmoud, Ntombikayise Banda, Peter Robinson, Rana el Kaliouby, Rosalind Picard, Tadas Baltrušaitis. 2011. Real-time inference of mental states from facial expressions and body gestures. In Proc. IEEE Face and Gesture Conference (FG '11), 1--6.
[11]
Oveneke, Meshia & Gonzalez, Isabel & Enescu, Valentin & Jiang, Dongmei & Sahli, Hichem. 2017. Leveraging the Bayesian Filtering Paradigm for Vision-Based Facial Affective State Estimation. IEEE Transactions on Affective Computing, PP: 1--1.
[12]
P. Michel and R. El Kaliouby. 2003. Real time facial expression recognition in video using support vector machines. In Proc. 5th Int. Conf. Multimodal Interfaces (ICMI '03). 258--264.
[13]
Pedregosa et al. 2011 Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12: 2825--2830.
[14]
M. F. Valstar, M. Mehu, B. Jiang, M. Pantic, and K. Scherer. 2012. Meta- analysis of the first facial expression recognition challenge. In IEEE Trans. Syst. Man. Cybern. B. Cybern. 42, 4: 966--979.
[15]
Amir Zadeh, Tadas Baltrušaitis, Louis-Philippe Morency. 2017. Convolutional Experts Constrained Local Model for Facial Landmark Detection. In Proc. IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '17), 2051--2059.
[16]
Zheng Zhang, Jeff Girard, Yue Wu, Xing Zhang, Peng Liu, Umur Ciftci, Shaun Canavan, Michael Reale, Andy Horowitz, Huiyuan Yang, Jeff Cohn, Qiang Ji, and Lijun Yin. 2016. Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR '16).
[17]
Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In Proc. 22nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York, NY, USA, 95--108.
Recommendations
Towards Empathetic Car Interfaces: Emotional Triggers while Driving
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsMonitoring the emotions of drivers can play a critical role to reduce road accidents and enable novel driver-car interactions. To help understand the possibilities, this work systematically studies the in-road triggers that may lead to different ...
Developing an affective working companion utilising GSR data
Proceedings of the 15th WSEAS international conference on ComputersAffective Computing field is in its second decade and is showing great achievements and promising results. Affective computing is mainly related to detecting and modifying a person's affective state. This paper presents a review on the fields of emotion ...
Emotion development system by interacting with human EEG and natural scene understanding
In this paper, we propose a mental development system for understanding the emotional status of humans, and sharing emotions with human subjects. According to the relationship between emotional factors and characteristics of an image, we incorporate the ...
Comments
Information & Contributors
Information
Published In
October 2018
62 pages
ISBN:9781450360029
DOI:10.1145/3281151
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 October 2018
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ICMI '18
Sponsor:
Acceptance Rates
Overall Acceptance Rate 453 of 1,080 submissions, 42%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 74Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in