How to browse through my large video data: face recognition & prioritizing for lifelog video
Authors: 
Katrin Wolf, 
Yomna Abdelrahman, 
Mathias Landwehr, Geoff Ward, 
Albrecht SchmidtAuthors Info & Claims
Katrin Wolf, Yomna Abdelrahman, Mathias Landwehr, Geoff Ward, Albrecht SchmidtAuthors Info & ClaimsPages 169 - 173
Abstract
Due to the rise of lifelog cameras, we have personal video data that is too large to be watched. Video indexing has the potential to provide meta-information for faster video search. This work aims to support lifelog video indexing through automated face priority rating. In a user study, we identified parameters that allow for rating the importance of persons in a video. We implemented these findings to automatically predict the person's importance in video. We show that our algorithm predicts similar person priority ratings like the participants had given. Hence, we contribute to video-based lifelogging through indicating, implementing, and testing face indexing rules that predict how important a person in a video is perceived. Our findings can help to build video players that support users navigating through their large video data and reviewing sequences that recall important moments of life.
References
[1]
Abir Al-Hajri, Gregor Miller, Matthew Fong, and Sidney S. Fels. 2014. Visualization of Personal History for Video Navigation. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1187--1196.
[2]
Lawrence W Barsalou. 1988. The content and organization of autobiographical memories. Remembering reconsidered: Ecological and traditional approaches to the study of memory (1988), 193--243.
[3]
Peter N. Belhumeur, João P. Hespanha, and David J. Kriegman. 1997. Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7 (July 1997), 711--720.
[4]
Christopher DB Burt. 1992. Retrieval characteristics of autobiographical memories: Event and date information. Applied Cognitive Psychology 6, 5 (1992), 389--404.
[5]
Michael G. Christel. 2008. Supporting Video Library Exploratory Search: When Storyboards Are Not Enough. In Proceedings of the 2008 International Conference on Content-based Image and Video Retrieval (CIVR '08). ACM, New York, NY, USA, 447--456.
[6]
Aiden R Doherty, Niamh Caprani, Ciarán Ó Conaire, Vaiva Kalnikaite, Cathal Gurrin, Alan F Smeaton, and Noel E OConnor. 2011. Passively recognising human activities through lifelogging. Computers in Human Behavior 27, 5 (2011), 1948--1958.
[7]
Yong Gao, Tao Wang, Jianguo Li, YangZhou Du, Wei Hu, Yimin Zhang, and HaiZhou Ai. 2007. Cast Indexing for Videos by NCuts and Page Ranking. In Proceedings of the 6th ACM International Conference on Image and Video Retrieval (CIVR '07). ACM, New York, NY, USA, 441--447.
[8]
Jim Gemmell, Gordon Bell, and Roger Lueder. 2006. MyLifeBits: A Personal Database for Everything. Commun. ACM 49, 1 (Jan. 2006), 88--95.
[9]
Hyowon Lee, Alan F Smeaton, Noel E OConnor, Gareth Jones, Michael Blighe, Daragh Byrne, Aiden Doherty, and Cathal Gurrin. 2008. Constructing a SenseCam visual diary as a media process. Multimedia Systems 14, 6 (2008), 341--349.
[10]
He Ma, Roger Zimmermann, and Seon Ho Kim. 2012. HUGVid: Handling, Indexing and Querying of Uncertain Geo-tagged Videos. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems (SIGSPATIAL '12). ACM, New York, NY, USA, 319--328.
[11]
Ahonen Timo, H Abdenour, and P Matti. 2004. Face recognition with local binary patterns. In Proceedings of the ECCV. 469--481.
[12]
Matthew Turk and Alex Pentland. 1991. Eigenfaces for recognition. Journal of cognitive neuroscience 3, 1 (1991), 71--86.
[13]
Paul Viola and Michael J Jones. 2004. Robust real-time face detection. International journal of computer vision 57, 2 (2004), 137--154.
[14]
Willem A Wagenaar. 1986. My memory: A study of autobiographical memory over six years. Cognitive psychology 18, 2 (1986), 225--252.
[15]
Katrin Wolf, Albrecht Schmidt, Agon Bexheti, and Marc Langheinrich. 2014. Lifelogging: You're Wearing a Camera? IEEE Pervasive Computing 13, 3 (2014), 8--12.
Index Terms
- How to browse through my large video data: face recognition & prioritizing for lifelog video
Recommendations
Face Recognition Based Person Specific Identification for Video Surveillance Applications
WCI '15: Proceedings of the Third International Symposium on Women in Computing and InformaticsFace detection is an important aspect for applications like biometrics, video surveillance and human computer interaction. Videos provide abundant information and also that can be leveraged by temporal variations in pose, expression changes and ...
A Novel Elastic Window for Face Detection and Recognition from Video
CICN '14: Proceedings of the 2014 International Conference on Computational Intelligence and Communication NetworksSince the past several years, face recognition from video has received significant attention due to wide range of commercial and law enforcement applications, such as surveillance systems, closed circuit TV (CCTV) monitoring, etc. Human face detection ...
A video-based door monitoring system using local appearance-based face models
In this paper, we present a real-time video-based face recognition system. The developed system identifies subjects while they are entering a room. This application scenario poses many challenges. Continuous, uncontrolled variations of facial appearance ...
Comments
Information & Contributors
Information
Published In
Copyright © 2016 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 December 2016
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
MUM '16
MUM '16: 15th International Conference on Mobile and Ubiquitous Multimedia
December 12 - 15, 2016
Rovaniemi, Finland
Acceptance Rates
MUM '16 Paper Acceptance Rate 35 of 77 submissions, 45%;
Overall Acceptance Rate 190 of 465 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 110Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 07 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in