Article

The evaluation of stylized facial expressions

Authors:

Christian Wallraven,

Douglas W. Cunningham,

Heinrich H. BülthoffAuthors Info & Claims

APGV '06: Proceedings of the 3rd symposium on Applied perception in graphics and visualization

Pages 85 - 92

https://doi.org/10.1145/1140491.1140509

Published: 28 July 2006 Publication History

Abstract

Stylized rendering aims to abstract information in an image making it useful not only for artistic but also for visualization purposes. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery efficiently. So far, however, few attempts have been made to characterize the perceptual impact and effectiveness of stylization. In this paper, we report several experiments that evaluate three different stylization techniques in the context of dynamic facial expressions. Going beyond the usual questionnaire approach, the experiments compare the techniques according to several criteria ranging from introspective measures (subjective preference) to task-dependent measures (recognizability, intensity). Our results shed light on how stylization of image contents affects the perception and subjective evaluation of facial expressions.

References

[1]

Adolphs, R. 2002. Recognizing Emotions from Facial Expressions: Psychological and Neurological Mechanisms. Behavioral and Cognitive Neuroscience Reviews 1, 1, 21--61.

[2]

Agrawala, M., and Stolte, C. 2001. Rendering Effective Route Maps: Improving Usability Through Generalization. In Proc. of ACM SIGGRAPH, ACM Press, New York, NY, USA, 241--249.

Digital Library

[3]

Breidt, M., Wallraven, C., Cunningham, D. W., and Bülthoff, H. H. 2003. Facial Animation Based on 3D Scans and Motion Capture. SIGGRAPH '03 Sketches & Applications.

[4]

Bull, P. 2001. State of the art: Nonverbal communication. The Psychologist 14, 644--647.

[5]

Cunningham, D. W., Breidt, M., Kleiner, M., Wallraven, C., and Bülthoff, H. H. 2003. How Believable are Real Faces: Towards a Perceptual Basis for Conversational Animation. In Computer Animation and Social Agents 2003, 23--39.

Digital Library

[6]

Cunningham, D., Nusseck, M., Wallraven, C., and Bülthoff, H. 2004. The Role of Image Size in the Recognition of Conversational Facial Expressions. Computer Animation & Virtual Worlds 15, 3-4 (07), 305--310.

Digital Library

[7]

Cunningham, D., Kleiner, M., Wallraven, C., and Bülthoff, H. 2005. Manipulating Video Sequences to Determine the Components of Conversational Facial Expressions. ACM Transactions on Applied Perception 2, 3 (07), 251--269.

Digital Library

[8]

DeCarlo, D., and Santella, A. 2002. Stylization and Abstraction of Photographs. In Proc. of ACM SIGGRAPH, 769--776.

Digital Library

[9]

Ekman, P. 1972. Universal and Cultural Differences in Facial Expressions of Emotion. University of Nebraska Press, 207--283.

[10]

Ferwerda, J. 2003. Three Varieties of Realism in Computer Graphics. In Proc. of SPIE Human Vision and Electronic Imaging, 290--297.

[11]

Fischer, J., and Bartz, D. 2005. Real-time Cartoon-like Stylization of AR Video Streams on the GPU. Technical Report WSI-2005-18, Wilhelm Schickard Institute for Computer Science, Graphical-Interactive Systems (WSI/GRIS), University of Tübingen, September.

[12]

Fischer, J., Bartz, D., and Strasser, W. 2005. Artistic Reality: Fast Brush Stroke Stylization for Augmented Reality. In Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST), 155--158.

Digital Library

[13]

Fischer, J., Bartz, D., and Strasser, W. 2005. Illustrative Display of Hidden Iso-Surface Structures. In Proc. of IEEE Visualization, 663--670.

[14]

Fischer, J., Cunningham, D., Bartz, D., Wallraven, C., Bülthoff, H., and Strasser, W. 2006. Measuring the Discernability of Virtual Objects in Conventional and Stylized Augmented Reality. In Eurographics Symposium on Virtual Environments (EGVE).

Digital Library

[15]

Fischer, J., Eichler, M., Bartz, D., and Strasser, W. 2006. Model-based Hybrid Tracking for Medical Augmented Reality. In Eurographics Symposium on Virtual Environments (EGVE).

Digital Library

[16]

Freudenberg, B., Masuch, M., and Strothotte, T. 2002. Real-Time Halftoning: A Primitive for Non-Photorealistic Shading. In Proc. of Eurographics Workshop on Rendering, 227--231.

Digital Library

[17]

Gooch, A. A., and Willemsen, P. 2002. Evaluating Space Perception in NPR Immersive Environments. In NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, ACM Press, New York, NY, USA, 105--110.

Digital Library

[18]

Gooch, B., Reinhard, E., and Gooch, A. 2004. Human Facial Illustrations: Creation and Psychophysical Evaluation. ACM Trans. Graph. 23, 1, 27--44.

Digital Library

[19]

Haeberli, P. 1990. Paint By Numbers: Abstract Image Representations. In Proc. of ACM SIGGRAPH, 207--214.

Digital Library

[20]

Litwinowicz, P. 1997. Processing Images and Video for an Impressionist Effect. In Proc. of ACM SIGGRAPH, 407--414.

Digital Library

[21]

Santella, A., and DeCarlo, D. 2004. Visual Interest and NPR: An Evaluation and Manifesto. In NPAR '04: Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, ACM Press, New York, NY, USA, 71--150.

Digital Library

[22]

Stokes, W. A., Ferwerda, J. A., Walter, B., and Greenberg, D. P. 2004. Perceptual illumination components: a new approach to efficient, high quality global illumination rendering. ACM Trans. Graph. 23, 3, 742--749.

Digital Library

[23]

Strothotte, T., and Schlechtweg, S. 2002. Non-Photorealistic Computer Graphics - Modelling, Rendering, and Animation. Morgan Kaufmann Publishers.

Digital Library

[24]

Tomasi, C., and Manduchi, R. 1998. Bilateral Filtering for Gray and Color Images. In Proc. of IEEE International Conference on Computer Vision (ICCV), 839--846.

Digital Library

[25]

Wallraven, C., Cunningham, D., Breidt, M., and Bülthoff, H. 2004. View Dependence of Complex Versus Simple Facial Motions. ACM SIGGRAPH, H. H. Blthoff and H. Rushmeier, Eds., 181.

Digital Library

[26]

Wallraven, C., Breidt, M., Cunningham, D. W., and Bülthoff, H. H. 2005. Psychophysical Evaluation of Animated Facial Expressions. In Proc. of APGV '05, ACM Press, New York, NY, USA, 17--24.

Digital Library

[27]

Yip, A. W., and Sinha, P. 2002. Contribution of Color to Face Recognition. Perception 31, 8, 995--1003.

Cited By

Ma XDeng Z(2012)A Statistical Quality Model for Data-Driven Speech AnimationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.6718:11(1915-1927)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.67
Lee SCarlson GJones SJohnson ALeigh JRenambot L(2010)Designing an expressive avatar of a real personProceedings of the 10th international conference on Intelligent virtual agents10.5555/1889075.1889085(64-76)Online publication date: 20-Sep-2010
https://dl.acm.org/doi/10.5555/1889075.1889085
Marcos SGómez-García-Bermejo JZalama E(2010)A realistic, virtual head for human-computer interactionInteracting with Computers10.1016/j.intcom.2009.12.00222:3(176-192)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1016/j.intcom.2009.12.002
Show More Cited By

Index Terms

The evaluation of stylized facial expressions
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Computing methodologies
  1. Computer graphics
    1. Animation

Recommendations

Evaluation of real-world and computer-generated stylized facial expressions

The goal of stylization is to provide an abstracted representation of an image that highlights specific types of visual information. Recent advances in computer graphics techniques have made it possible to render many varieties of stylized imagery ...
Psychophysical investigation of facial expressions using computer animated faces
APGV '07: Proceedings of the 4th symposium on Applied perception in graphics and visualization

The human face is capable of producing a large variety of facial expressions that supply important information for communication. As was shown in previous studies using unmanipulated video sequences, movements of single regions like mouth, eyes, and ...
Psychophysical evaluation of animated facial expressions
APGV '05: Proceedings of the 2nd symposium on Applied perception in graphics and visualization

The human face is capable of producing an astonishing variety of expressions---expressions for which sometimes the smallest difference changes the perceived meaning noticably. Producing realistic-looking facial animations that are able to transport this ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

APGV '06: Proceedings of the 3rd symposium on Applied perception in graphics and visualization

July 2006

181 pages

ISBN:1595934294

DOI:10.1145/1140491

Conference Chairs:
Roland W. Fleming
MPI for Biological Cybernetics
,
Sunghee Kim
Gettysburg College

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 July 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

APGV06

Sponsor:

SIGGRAPH

APGV06: ACM Symposium on Applied Perception in Graphics and Visualization

July 28 - 29, 2006

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 19 of 33 submissions, 58%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
562
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ma XDeng Z(2012)A Statistical Quality Model for Data-Driven Speech AnimationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.6718:11(1915-1927)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.67
Lee SCarlson GJones SJohnson ALeigh JRenambot L(2010)Designing an expressive avatar of a real personProceedings of the 10th international conference on Intelligent virtual agents10.5555/1889075.1889085(64-76)Online publication date: 20-Sep-2010
https://dl.acm.org/doi/10.5555/1889075.1889085
Marcos SGómez-García-Bermejo JZalama E(2010)A realistic, virtual head for human-computer interactionInteracting with Computers10.1016/j.intcom.2009.12.00222:3(176-192)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1016/j.intcom.2009.12.002
Lee SCarlson GJones SJohnson ALeigh JRenambot L(2010)Designing an Expressive Avatar of a Real PersonIntelligent Virtual Agents10.1007/978-3-642-15892-6_8(64-76)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15892-6_8
Sloan RCook MRobinson B(2009)Considerations for Believable Emotional Facial Expression AnimationProceedings of the 2009 Second International Conference in Visualisation10.1109/VIZ.2009.28(61-66)Online publication date: 15-Jul-2009
https://dl.acm.org/doi/10.1109/VIZ.2009.28
Xu SLau FPan Y(2009)Final Fantasies for Digital Painting and CalligraphyA Computational Approach to Digital Chinese Painting and Calligraphy10.1007/978-3-540-88148-3_12(327-351)Online publication date: 2009
https://doi.org/10.1007/978-3-540-88148-3_12
Arruda FPorto VAlencar Jr. JGomes HQueiroz JMoroney N(2008)A New NPR Approach for Image StylizationProceedings of the 2008 International Conference on Computational Intelligence for Modelling Control & Automation10.1109/CIMCA.2008.48(1065-1070)Online publication date: 10-Dec-2008
https://dl.acm.org/doi/10.1109/CIMCA.2008.48

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents