Facial parameters and their influence on subjective impression in the context of keyframe extraction from home video contents
Pages 76 - 86
Abstract
In this paper, we investigate the influence of facial parameters on the subjective impression that is created when looking at photographs containing people in the context of keyframe extraction from home video. Hypotheses about the influence of investigated parameters on the impression are experimentally validated with respect to a given viewing perspective. Based on the findings from a conducted user experiment, we propose a novel human-centric image scoring method based on weighted face parameters. As a novelty to the field of keyframe extraction, the proposed method considers facial expressions besides other parameters. We evaluate its effectiveness in terms of correlation between the image score and a ground truth user impression score. The results show that the consideration of facial expressions in the proposed method improves the correlation compared to image scores that rely on commonly used face parameters such as size and location.
References
[1]
Truong, B.T., Venkatesh, S.: Video abstraction: A systematic review and classification. ACM TOMCCAP 3, 1 (2007)
[2]
Gale, A.: Human response to visual stimuli. In: Hendee, W., Wells, P. (eds.) The Perception of Visual Information, pp. 127-147. Springer, Heidelberg (1997)
[3]
Senders, J.: Distribution of attention in static and dynamic scenes. SPIE 3016, 186-194 (1997)
[4]
Russ, J.C.: The Image Processing Handbook. CRC Press, Boca Raton (2006)
[5]
Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20(3), 21-36 (2003)
[6]
Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. In: ACM SIGGRAPH 2006, pp. 787-794 (2006)
[7]
Zhang, T.: Intelligent Keyframe Extraction for Video Printing. In: Proc. of SPIE Conference on Internet Multimedia Management Systems V, vol. 5601, pp. 25-35 (2004)
[8]
Luo, J., Papin, C., Costello, K.: Towards Extracting Semantically Meaningful Key Frames From Personal Video Clips: From Humans to Computers. IEEE Trans. Circuits Syst. Video Techn. 19(2), 289-301 (2009)
[9]
Martinet, J., Satoh, S., Chiaramella, Y., Mulhem, P.: Media objects for usercentered similarity matching. Multimedia Tools Appl. 39(2), 263-291 (2008)
[10]
Ekman, P., Keltner, D.: Universal facial expressions of emotion. In: Segerstrale, U., Molnar, P. (eds.) Nonverbal Communication, pp. 27-46. LEA, Mahwah (1997)
[11]
Kowalik, U., Hidaka, K., Irie, G., Kojima, A.: Creating joyful digests by exploiting smile/laughter facial expressions present in video. In: International Workshop on Advanced Image Technology (2009)
[12]
ClipLife, http://cliplife.goo.ne.jp/
[13]
Lim, J.H., Tian, Q., Mulhem, P.: Home photo content modeling for personalized event-based retrieval. IEEE Multimedia 10(4), 28-37 (2003)
[14]
Wiskott, L., Fellous, J.-M., Kruger, N., von der Malsburg, C.: Face Recognition by Elastic Bunch Graph Matching. IEEE Trans. PAMI 19(7), 775-779 (1997)
[15]
Ando, S., Suzuki, A., Takahashi, Y., Yasuno, T.: A Fast Object Detection and Recognition Algorithm Based on Joint Probabilistic ISC. In: MIRU 2007 (2007) (in Japanese)
Recommendations
Dynamic Face Movement Texture Enhances the Perceived Realism of Facial Expressions of Emotion
IVA '20: Proceedings of the 20th ACM International Conference on Intelligent Virtual AgentsMost socially interactive virtual agents that generate facial expressions lack critical visual features such as expressive wrinkles, which could reduce their realistic appearance. Here, we examined the impact of dynamic facial texture on perceptions of ...
Detecting depression based on facial cues elicited by emotional stimuli in video
AbstractRecently, depression research has received considerable attention and there is an urgent need for objective and validated methods to detect depression. Depression detection based on facial expressions may be a promising adjunct to depression ...
Highlights- Detecting depression from facial information captured under video stimulus paradigm stimulation.
- Combining depression-related AUs and defined facial proportions eliminates redundant facial information.
- Multimodal fusion of facial ...
Assessment of blurring and facial expression effects on facial image recognition
ICB'06: Proceedings of the 2006 international conference on Advances in BiometricsIn this paper we present methods for assessing the quality of facial images, degraded by blurring and facial expressions, for recognition. To assess the blurring effect, we measure the level of blurriness in the facial images by statistical analysis in ...
Comments
Information & Contributors
Information
Published In
January 2010
801 pages
ISBN:3642113001
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 06 January 2010
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025