research-article

To stylize or not to stylize?: the effect of shape and material stylization on the perception of computer-generated faces

Authors:

Diego Gutierrez,

Rachel McDonnell,

Mario BotschAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 34, Issue 6

Article No.: 184, Pages 1 - 12

https://doi.org/10.1145/2816795.2818126

Published: 02 November 2015 Publication History

Abstract

Virtual characters contribute strongly to the entire visuals of 3D animated films. However, designing believable characters remains a challenging task. Artists rely on stylization to increase appeal or expressivity, exaggerating or softening specific features. In this paper we analyze two of the most influential factors that define how a character looks: shape and material. With the help of artists, we design a set of carefully crafted stimuli consisting of different stylization levels for both parameters, and analyze how different combinations affect the perceived realism, appeal, eeriness, and familiarity of the characters. Moreover, we additionally investigate how this affects the perceived intensity of different facial expressions (sadness, anger, happiness, and surprise). Our experiments reveal that shape is the dominant factor when rating realism and expression intensity, while material is the key component for appeal. Furthermore our results show that realism alone is a bad predictor for appeal, eeriness, or attractiveness.

Supplementary Material

ZIP File (a184-zell.zip)

Supplemental files.

Download
56.92 MB

References

[1]

Alexander, O., Rogers, M., Lambeth, W., Chiang, J.-Y., Ma, W.-C., Wang, C.-C., and Debevec, P. 2010. The Digital Emily project: Achieving a photorealistic digital actor. IEEE Computer Graphics and Applications 30, 4.

Digital Library

[2]

Alley, T. R., and Cunningham, M. R. 1991. Averaged faces are attractive, but very attractive faces are not average. Psychological Science 2, 2.

[3]

Beeler, T., Bickel, B., Beardsley, P., Sumner, B., and Gross, M. 2010. High-quality single-shot capture of facial geometry. ACM Transactions on Graphics 29, 4.

Digital Library

[4]

Benson, P., and Perrett, D. 1992. Face to face with the perfect image. New Scientist 133, 1809.

[5]

Burleigh, T. J., Schoenherr, J. R., and Lacroix, G. L. 2013. Does the Uncanny Valley exist? An empirical test of the relationship between eeriness and the human likeness of digitally created faces. Computers in Human Behavior 29, 3.

Digital Library

[6]

Calder, A. J. 1996. Facial emotion recognition after bilateral amygdala damage: Differentially severe impairment of fear. Cognitive Neuropsychology 13, 5.

[7]

Chen, H., Russell, R., and Nakayama, K. 2010. Crossing the "Uncanny Valley": Adaptation to cartoon faces can influence perception of human faces. Perception, 39.

[8]

Cunningham, D., and Wallraven, C. 2011. Experimental Design: From User Studies to Psychophysics. AK Peters/CRC Press.

Digital Library

[9]

Dill, V., Flach, L. M., Hocevar, R., Lykawka, C., Musse, S. R., and Pinho, M. S. 2012. Evaluation of the Uncanny Valley in CG characters. In Intelligent Virtual Agents.

Digital Library

[10]

Ekman, P. 1972. Universal and cultural differences in facial expression of emotion. Proceedings of Nebraska Symposium on Motivation 19.

[11]

Fan, S., Ng, T.-T., Herberg, J. S., Koenig, B. L., and Xin, S. 2012. Real or fake? Human judgments about photographs and computer-generated images of faces. In SIGGRAPH Asia 2012 Technical Briefs.

Digital Library

[12]

Ferrey, A. E., Burleigh, T. J., and Fenske, M. J. 2015. Stimulus-category competition, inhibition, and affective devaluation: a novel account of the uncanny valley. Frontiers in psychology 6.

[13]

Fink, B., and Matts, P. J. 2008. The effects of skin colour distribution and topography cues on the perception of female facial age and health. Journal of the European Academy of Dermatology and Venereology 22, 4.

[14]

Fink, B., Grammer, K., and Matts, P. J. 2006. Visible skin color distribution plays a role in the perception of age, attractiveness, and health in female faces. Evolution and Human Behavior 27, 6.

[15]

Fink, B., Bunse, L., Matts, P. J., and D'Emiliano, D. 2012. Visible skin colouration predicts perception of male facial age, health and attractiveness. International Journal of Cosmetic Science 34, 4.

[16]

Geller, T. 2008. Overcoming the Uncanny Valley. IEEE Computer Graphics and Applications 28, 4.

Digital Library

[17]

Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics 23, 1.

Digital Library

[18]

Green, R. D., MacDorman, K. F., Ho, C.-C., and Vasudevan, S. 2008. Sensitivity to the proportions of faces that vary in human likeness. Computers in Human Behavior 24, 5.

Digital Library

[19]

Hanson, D. 2005. Expanding the Aesthetics Possibilities for Humanlike Robots. In Proceedings of IEEE Humanoid Robotics Conference, special session on the Uncanny Valley.

[20]

Ho, C.-C., and MacDorman, K. F. 2010. Revisiting the uncanny valley theory: Developing and validating an alternative to the godspeed indices. Computers in Human Behavior 26, 6.

Digital Library

[21]

Jack, D. R., Garrod, M. O., and Schyns, P. 2014. Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time. Current Biology 24, 2.

[22]

Jimenez, J., Zsolnai, K., Jarabo, A., Freude, C., Auzinger, T., Wu, X.-C., von der Pahlen, J., Wimmer, M., and Gutierrez, D. 2015. Separable subsurface scattering. Computer Graphics Forum.

[23]

Klehm, O., Rousselle, F., Papas, M., Bradley, D., Hery, C., Bickel, B., Jarosz, W., and Beeler, T. 2015. Recent advances in facial appearance capture. Computer Graphics Forum (Proceedings of Eurographics) 34, 2.

Digital Library

[24]

Little, A. C., and Hancock, P. J. 2002. The role of masculinity and distinctiveness in judgments of human male facial attractiveness. British Journal of Psychology 93, 4.

[25]

MacDorman, K. F., Green, R. D., Ho, C.-C., and Koch, C. T. 2009. Too real for comfort? Uncanny responses to computer generated faces. Computers in Human Behavior 25, 3.

Digital Library

[26]

MacDorman, K. F. 2006. Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: An exploration of the Uncanny Valley. In Proceedings of ICCS/CogSci Long Symposium: Toward Social Mechanisms of Android Science.

[27]

McCloud, S. 1993. Understanding Comics. William Morrow Paperbacks.

[28]

McDonnell, R., Breidt, M., and Bülthoff, H. H. 2012. Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 4.

Digital Library

[29]

Mori, M., MacDorman, K. F., and Kageki, N. 2012. The Uncanny Valley {From the field}. IEEE Robotics and Automation Magazine 19, 2.

[30]

Nitzsche, B., and Rose, K. 2011. Bodyshop: The Photoshop Retouching Guide for the Face and Body. Wiley.

Digital Library

[31]

Saygin, A., Chaminade, T., Ishiguro, H., Driver, J., and Frith, C. 2012. The thing that should not be: Predictive coding and the Uncanny Valley in perceiving human and humanoid robot actions. Social Cognitive Affective Neuroscience 7, 4.

[32]

Schneider, E., Wang, Y., and Yang, S. 2007. Exploring the Uncanny Valley with japanese video game characters. In Situated Play: Proceedings of the Digital Games Research Association Conference.

[33]

Seyama, J., and Nagayama, R. S. 2007. The Uncanny Valley: Effect of realism on the impression of artificial human faces. Presence: Teleoperators and Virtual Environments 16, 4.

Digital Library

[34]

Tinwell, A., and Grimshaw, M. 2009. Bridging the uncanny: An impossible traverse? In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era.

Digital Library

[35]

Tinwell, A., Grimshaw, M., Nabi, D. A., and Williams, A. 2011. Facial expression of emotion and perception of the Uncanny Valley in virtual characters. Computers in Human Behavior 27, 2.

Digital Library

[36]

Tinwell, A., Grimshaw, M., and Williams, A. 2011. The Uncanny Wall. International Journal of Arts and Technology 4, 3.

[37]

Tinwell, A. 2014. The Uncanny Valley in Games and Animation. AK Peters / CRC Press.

[38]

Wallraven, C., Bülthoff, H. H., Cunningham, D. W., Fischer, J., and Bartz, D. 2007. Evaluation of real-world and computer-generated stylized facial expressions. ACM Transactions on Applied Perception 4, 3.

Digital Library

[39]

Wallraven, C., Breidt, M., Cunningham, D. W., and Bülthoff, H. H. 2008. Evaluating the perceptual realism of animated facial expressions. ACM Transactions on Applied Perceptiona 4, 4.

Digital Library

[40]

Weise, T., Bouaziz, S., Li, H., and Pauly, M. 2011. Real-time performance-based facial animation. ACM Transactions on Graphics 30, 4.

Digital Library

[41]

Zell, E., and Botsch, M. 2013. ElastiFace: Matching and blending textured faces. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering.

Digital Library

[42]

Zhu, J.-Y., Agarwala, A., Efros, A. A., Shechtman, E., and Wang, J. 2014. Mirror mirror: Crowdsourcing better portraits. ACM Transactions on Graphics 33, 6.

Digital Library

[43]

Zibrek, K., and McDonnell, R. 2014. Does render style affect perception of personality in virtual humans? In Proceedings of the ACM Symposium on Applied Perception.

Digital Library

Cited By

Montanha RRaupp GSchmitt AAraujo VMusse S(2025)Micro and macro facial expressions by driven animations in realistic Virtual HumansEntertainment Computing10.1016/j.entcom.2024.10085352(100853)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100853
Wisessing PMcDonnell R(2024)Blinded by the light: Does portrait lighting design affect perception of realistic virtual humans?ACM Symposium on Applied Perception 202410.1145/3675231.3675245(1-10)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675231.3675245
Rekik RWuhrer SHoyet LZibrek KOlivier A(2024)A Survey on Realistic Virtual Human Animations: Definitions, Features and EvaluationsComputer Graphics Forum10.1111/cgf.1506443:2Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15064
Show More Cited By

Index Terms

To stylize or not to stylize?: the effect of shape and material stylization on the perception of computer-generated faces
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Animated Agents’ Facial Emotions: Does the Agent Design Make a Difference?
Augmented Reality, Virtual Reality, and Computer Graphics
Abstract
The paper reports ongoing research toward the design of multimodal affective pedagogical agents that are effective for different types of learners and applications. In particular, the work reported in the paper investigated the extent to which the ...
A Layered Authoring Tool for Stylized 3D animations
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Guided by the 12 principles of animation, stylization is a core 2D animation feature but has been utilized mainly by experienced animators. Although there are tools for stylizing 2D animations, creating stylized 3D animations remains a challenging ...
Pixar’s OUT: Experimental Look Development in the SparkShorts program
SIGGRAPH '21: ACM SIGGRAPH 2021 Talks

Pixar’s OUT, released summer 2020 on Disney+, is a short film with a highly stylized look, produced under the in-house SparkShorts program. The program champions new creative voices and storytelling via tight-knit production teams that work with ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 34, Issue 6

November 2015

944 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2816795

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2015

Published in TOG Volume 34, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

92
Total Citations
View Citations
1,585
Total Downloads

Downloads (Last 12 months)177
Downloads (Last 6 weeks)28

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Montanha RRaupp GSchmitt AAraujo VMusse S(2025)Micro and macro facial expressions by driven animations in realistic Virtual HumansEntertainment Computing10.1016/j.entcom.2024.10085352(100853)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100853
Wisessing PMcDonnell R(2024)Blinded by the light: Does portrait lighting design affect perception of realistic virtual humans?ACM Symposium on Applied Perception 202410.1145/3675231.3675245(1-10)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675231.3675245
Rekik RWuhrer SHoyet LZibrek KOlivier A(2024)A Survey on Realistic Virtual Human Animations: Definitions, Features and EvaluationsComputer Graphics Forum10.1111/cgf.1506443:2Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15064
Canales RRoble DNeff M(2024)The Impact of Avatar Stylization on Trust2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00063(418-428)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00063
Martin JHoyet LPinsard EPaillat JPettré J(2024)Virtual Crowds Rheology: Evaluating the Effect of Character Representation on User Locomotion in CrowdsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345618330:11(7008-7019)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456183
Lee YJi Y(2024)Effects of Visual Realism on Avatar Perception in Immersive and Non-Immersive Virtual EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351713(1-14)Online publication date: 14-May-2024
https://doi.org/10.1080/10447318.2024.2351713
Chen YStephani TBagdasarian MHilsmann AEisert PVillringer ABosse SGaebler MNikulin V(2024)Realness of face images can be decoded from non-linear modulation of EEG responsesScientific Reports10.1038/s41598-024-56130-114:1Online publication date: 7-Mar-2024
https://doi.org/10.1038/s41598-024-56130-1
Di Natale ALa Rocca SSimonetti MBricolo E(2024)Using computer-generated faces in experimental psychology: The role of realism and exposureComputers in Human Behavior Reports10.1016/j.chbr.2024.100397(100397)Online publication date: Mar-2024
https://doi.org/10.1016/j.chbr.2024.100397
Fraser ABranson IHollett RSpeelman CRogers S(2024)Do realistic avatars make virtual reality better? Examining human-like avatars for VR social interactionsComputers in Human Behavior: Artificial Humans10.1016/j.chbah.2024.1000822:2(100082)Online publication date: Aug-2024
https://doi.org/10.1016/j.chbah.2024.100082
Knob PPinho GSilva GMontanha RPeres VAraujo VMusse S(2024)Surveying the evolution of virtual humans expressiveness toward real humansComputers & Graphics10.1016/j.cag.2024.104034123(104034)Online publication date: Oct-2024
https://doi.org/10.1016/j.cag.2024.104034
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents