Article

Statistical synthesis of facial expressions for the portrayal of emotion

Authors:

Lisa Gralewski,

Neill Campbell,

David GibsonAuthors Info & Claims

GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

Pages 190 - 198

https://doi.org/10.1145/988834.988867

Published: 15 June 2004 Publication History

Abstract

This paper presents a novel technique for the generation of 'video textures' to display human emotion. This is achieved by a method which uses existing video footage to synthesise new sequences of coherent facial expression and head motions.An 'expression space' which is defined by sets of emotion models is constructed using principal components analysis (PCA) and the application of an auto-regressive process (ARP). Using this expression space a tool has been developed which enables this space to be navigated, and to view new video sequences generated from it. This tool provides an intuitive interface, which allows a nonspecialist user easy traversal of the highly dimensional expression space and enables them to select an emotion and automatically generate new facial expression sequences.

References

[1]

B. ABBOUD, F. DAVOINE, M. D. 2003. Statistical modelling for facial expression analysis and synthesis.

[2]

BOOKSTEIN, F. L. 1989. Principle warps: Thin plate splines and the decomposition of deformations. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. II(6), 567--585.

Digital Library

[3]

CAMPBELL, N. W., DALTON, C. J., GIBSON, D. P., AND THOMAS, B. T. 2002. Practical generation of video textures using the auto-regressive. In Proceedings of the British Machine Vision Conference 2002, BMVA, P. L. Rosin and D. Marshall, Eds., 434--443.

Digital Library

[4]

COHEN, I., GARG, A., AND HUANG, T., 2000. Emotion recognition from facial expressions using multilevel hmm.

[5]

COOTES, T., AND TAYLOR, C. 1999. Statistical models of appearance for computer vision. Tech. rep.

[6]

COOTES, T. F., EDWARDS, G. J., AND TAYLOR, C. J. 1998. Active appearance models. In European Conference on Computer Vision, springer, H. Burkhardt and B. Neumann, Eds., vol. 2, 484--498.

Digital Library

[7]

DI FIORE, F., AND VAN REETH, F. 2003. Mimicing 3D transformations of emotional stylized animation with minimal 2D input. In Proceedings of GRAPHITE 2003, 21--28.

Digital Library

[8]

DONATO, G., BARTLETT, M. S., HAGER, J. C., EKMAN, P., AND SEJNOWSKI, T. J. 1999. Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 10, 974--989.

Digital Library

[9]

ESSA, I., AND BASU, S., 1996. Modeling, tracking and interactive animation of facial expressions and head movements using input from video.

Digital Library

[10]

EVANS, D. 2001. Emotion. Oxford University Press.

[11]

FLEXER, A. 1999. On the use of self-organizing maps for clustering and visualization. In Principles of Data Mining and Knowledge Discovery, 80--88.

Digital Library

[12]

GIBSON, D. P., CAMPBELL, N. W., DALTON, C. J., AND THOMAS, B. T. 2000. Extraction of motion data from image sequences to assist animators. In Proceedings of the British Machine Vision Conference 2000, BMVA, M. Mirmehdi and B. Thomas, Eds., 302--311.

Digital Library

[13]

KANADE, COHN, T. 2000. Comprehensive database for facial expression analysis.

Digital Library

[14]

KATSIKITIS, M. 2003. The Human Face. Kluwer Academic Publishers.

[15]

OATES, T., FIROIU, L., AND COHEN, P., 1999. Clustering time series with hidden markov models and dynamic time warping.

[16]

PADGETT, C., AND COTTRELL, G., 1995. Identifying emotion in static face images.

[17]

RUTTKAY, Z., NOOT, H., AND TEN HAGEN, P., 2003. Emotion disc and emotion squares: Tools to explore the facial expression space.

[18]

SCHNEIDER, T., AND NEUMAIER, A. 2001. Algorithm 808: Arfit - a mat-lab package for the estimation of parameters and eigenmodes of multivariate autoregressive models. In ACM Transactions on Mathematical Software, vol. 27, 58--65.

Digital Library

[19]

SCHÄODL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. 2000. Video textures. In Siggraph 2000, Computer Graphics Proceedings, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, K. Akeley, Ed., 489--498.

Digital Library

[20]

TURAGA, D., AND CHEN, T. 2002. Face recognition using mixtures of principal components. In International conference on image processing.

[21]

TURK, AND PENTLAND. 1991. Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 1, 71--86.

Digital Library

[22]

VICON, 2003. http://www.vicon.com/entertainment/index.shtml.

Cited By

Kocoń MEmirsajłow Z(2009)Facial expression animation overviewIFAC Proceedings Volumes10.3182/20090819-3-PL-3002.0005542:13(312-317)Online publication date: 2009
https://doi.org/10.3182/20090819-3-PL-3002.00055
Jaeckel PCampbell NMelhuish C(2007)Towards Realistic Facial Behaviour in Humanoids - Mapping from Video Footage to a Robot Head2007 IEEE 10th International Conference on Rehabilitation Robotics10.1109/ICORR.2007.4428521(833-840)Online publication date: Jun-2007
https://doi.org/10.1109/ICORR.2007.4428521
Li XChang CChang S(2007)Face alive iconJournal of Visual Languages and Computing10.1016/j.jvlc.2007.02.00818:4(440-453)Online publication date: 1-Aug-2007
https://dl.acm.org/doi/10.1016/j.jvlc.2007.02.008
Show More Cited By

Index Terms

Statistical synthesis of facial expressions for the portrayal of emotion
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

Do all facial emojis communicate emotion? The impact of facial emojis on perceived sender emotion and text processing
Abstract
Facial emojis can express a variety of positive and negative emotions, and are commonly used in digital, written communication. However, little is known about how emojis impact text processing and how different emoji-text combinations give rise ...
Highlights
- We investigated how facial emojis impact text comprehension using behavioral ratings and EEG.
- In ratings, negative emojis communicate specific mental states, while positive emojis communicate general positive emotion.
- In ERPs, the ...
Emotion recognition using facial expressions with active appearance models
HCI '08: Proceedings of the Third IASTED International Conference on Human Computer Interaction

Recognizing emotion using facial expressions is a key element in human communication. In this paper we discuss a framework for the classification of emotional states, based on still images of the face. The technique we present involves the creation of ...
Cross-cultural design of facial expressions for humanoids: is there cultural difference between Japan and Denmark?
MMAsia '20: Proceedings of the 2nd ACM International Conference on Multimedia in Asia

In this research, the authors succeeded in creating facial expressions made with the minimum necessary elements for recognizing a face. The elements are two eyes and a mouth made using precise circles, which are transformed to make facial expressions ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

June 2004

267 pages

ISBN:1581138830

DOI:10.1145/988834

Conference Chair:
Yong Tsui Lee
Nanyang Technological University, Singapore
,
Editor:
Stephen N. Spencer
The University of Washington
,
Program Chairs:
Alan Chalmers,
Hock Soon Seah

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

GRAPHITE04

Sponsor:

SIGGRAPH

GRAPHITE04: International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia

June 15 - 18, 2004

Singapore

Acceptance Rates

GRAPHITE '04 Paper Acceptance Rate 39 of 65 submissions, 60%;

Overall Acceptance Rate 124 of 241 submissions, 51%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
879
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kocoń MEmirsajłow Z(2009)Facial expression animation overviewIFAC Proceedings Volumes10.3182/20090819-3-PL-3002.0005542:13(312-317)Online publication date: 2009
https://doi.org/10.3182/20090819-3-PL-3002.00055
Jaeckel PCampbell NMelhuish C(2007)Towards Realistic Facial Behaviour in Humanoids - Mapping from Video Footage to a Robot Head2007 IEEE 10th International Conference on Rehabilitation Robotics10.1109/ICORR.2007.4428521(833-840)Online publication date: Jun-2007
https://doi.org/10.1109/ICORR.2007.4428521
Li XChang CChang S(2007)Face alive iconJournal of Visual Languages and Computing10.1016/j.jvlc.2007.02.00818:4(440-453)Online publication date: 1-Aug-2007
https://dl.acm.org/doi/10.1016/j.jvlc.2007.02.008
Song IGovernatori G(2006)Affective web service designProceedings of the 9th Pacific Rim international conference on Artificial intelligence10.5555/1757898.1757910(71-80)Online publication date: 7-Aug-2006
https://dl.acm.org/doi/10.5555/1757898.1757910
Song IGovernatori G(2006)Affective Web Service DesignPRICAI 2006: Trends in Artificial Intelligence10.1007/978-3-540-36668-3_10(71-80)Online publication date: 2006
https://doi.org/10.1007/978-3-540-36668-3_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten