Space-time flexible kernel for recognizing activities from wearable cameras
Pages 843 - 852
Abstract
Recognizing activities of daily living is useful for ambient assisted living. In this regard, the use of wearable cameras is a promising technology. In this paper, we propose a novel approach for recognizing activities of daily living using egocentric viewpoint video clips. First, in every frame, the appearing objects are detected and labelled depending if they are being used or not by the subject. Later, the video clip is divided into spatiotemporal bins created with an object-centric cut. Finally, a support vector machine classifier is computed using a spatiotemporal flexible kernel between video clips. The validity of the proposed method has been proved by conducting experiments in the ADL dataset. Results confirm the suitability of using the space-time location of objects as information for the classification of activities using an egocentric viewpoint.
References
[1]
Economic and Financial Affairs (2017) The 2018 ageing report: underlying assumptions and projection methodologies. Technical report, European Commission
[2]
Colby S, Ortman JM (2015) Projections of the size and composition of the U.S. population 2014 to 2060. Department of Commerce, Economics and Statistics Administration, technical report, U.S., p 2015
[3]
Cardinaux F, Bhowmik D, Abhayaratne C, and Hawley MS Video based technology for ambient assisted living: a review of the literature J Ambient Intell Smart Environ 2011 3 253-269
[4]
Nguyen T-H-C, Nebel J-C, and Florez-Revuelta F Recognition of activities of daily living with egocentric vision: a review Sensors 2016 16 1 72
[5]
Hodges S, Berry E, and Wood K Sensecam: a wearable camera that stimulates and rehabilitates autobiographical memory Memory 2011 19 7 685-696
[6]
Rodriguez M, Orrite C, Medrano C, and Makris D A time flexible kernel framework for video-based activity recognition Image Vis Comput 2016 48 26-36
[7]
Queiros A, Dias A, Silva AG, and Rocha NP Ambient assisted living and health-related outcomes: a systematic literature review Informatics 2017 4 3 19
[8]
Blackman S, Matlo C, Bobrovitskiy C, Waldoch A, Fang ML, Jackson P, Mihailidis A, Nygård L, Astell A, and Sixsmith A Ambient assisted living technologies for aging well: a scoping review J Intell Syst 2016 25 1 55-69
[9]
Reissner L, Gabriella F, List R, Giovanoli P, and Calcagni M Assessment of hand function during activities of daily living using motion tracking cameras: a systematic review Proc Inst Mech Eng H J Eng Med 2019 233 095441191985130
[10]
Martin SK and Jude HD Hand posture and gesture recognition techniques for virtual reality applications: a survey Virtual Real 2017 21 2 91-107
[11]
Rodríguez M, Orrite C, Medrano C, Makris D (2017) Fast simplex-hmm for one-shot learning activity recognition. In: 2017 IEEE conference on computer vision and pattern recognition workshops, CVPR workshops 2017, Honolulu, HI, USA, July 21–26, 2017. IEEE Computer Society, pp 1259–1266
[12]
Martin SK and Jude HD A probabilistic model for state sequence analysis in hidden Markov model for hand gesture recognition Comput Intell 2019 35 1 59-81
[13]
Pirsiavash H, Ramanan D (2012) Detecting activities of daily living in first-person camera views. In: IEEE conference on computer vision and pattern recognition (CVPR). IEEE
[14]
McCandless T, Grauman K (2013) Object-centric spatio-temporal pyramids for egocentric activity recognition. In: British machine vision conference, BMVC 2013, Bristol, UK, September 9–13, 2013
[15]
Matsuo K, Yamada K, Ueno S, Naito S (2014) An attention-based activity recognition for egocentric video. In: IEEE conference on computer vision and pattern recognition, CVPR workshops 2014, Columbus, OH, USA, June 23–28, 2014, pp 565–570
[16]
Wang H, Schmid C (2013) Action recognition with improved trajectories. In: 2013 IEEE international conference on computer vision, IEEE, Sydney, Australia, Dec 1–8 2013.
[17]
Fathi A, Farhadi A, Rehg JM (2011) Understanding egocentric activities. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 407–414
[18]
Lazebnik S, Schmid C, and Ponce J Beyond bags of features: spatial pyramid matching for recognizing natural scene categories IEEE Conf Comput Vis Pattern Recognit (CVPR) 2006 2 2169-2178
[19]
Zhou Y, Ni B, Hong R, Yang X, Tian Q (2016) Cascaded interactional targeting network for egocentric video analysis. In: 2016 IEEE conference on computer vision and pattern recognition, CVPR 2016, Las Vegas, NV, USA, June 27–30, 2016. IEEE Computer Society, pp 1904–1913
[20]
Wang M, Luo C, Ni B, Yuan J, Wang J, and Yan S First-person daily activity recognition with manipulated object proposals and non-linear feature fusion IEEE Trans Circuits Syst Video Technol 2018 28 10 2946-2955
[21]
Zou Z, Shi Z, Guo Y, Ye J (2019) Object detection in 20 years: a survey. CoRR. arXiv:1905.05055
[22]
Liu L, Ouyang W, Wang X, Fieguth PW, Chen J, Liu X, and Pietikäinen M Deep learning for generic object detection: a survey Int J Comput Vis 2020 128 2 261-318
[23]
Jiao L, Zhang F, Liu F, Yang S, Li L, Feng Z, and Rong Q A survey of deep learning-based object detection IEEE Access 2019 7 128837-128868
[24]
Rodriguez M, Orrite C, and Medrano C Alexandre LA, Sánchez JS, and Rodrigues JMF Space-time flexible kernel for recognizing activities from wearable cameras Pattern recognition and image analysis 2017 Cham Springer 511-518
[25]
Jebara T, Kondor R, and Howard A Probability product kernels J Mach Learn Res 2004 5 819-844
[26]
Bishop CM Pattern recognition and machine learning (information science and statistics) 2006 New York Springer
[27]
Choi J, Wang Z, Lee S-C, and Jeon WJ A spatio-temporal pyramid matching for video retrieval Comput Vis Image Underst 2013 117 6 660-669
[28]
Zhang S, Nugent C, Lundström J, and Sheng M Ambient assisted living for improvement of health and quality of life Informatics 2018 5 1 4
[29]
Damen D, Doughty H, Farinella GM, Fidler S, Furnari A, Kazakos E, Moltisanti D, Munro J, Perrett T, Price W, Wray M (2020) The EPIC-KITCHENS dataset: collection, challenges and baselines. CoRR. arXiv:2005.00343
Recommendations
Recognizing water-based activities in the home through infrastructure-mediated sensing
UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous ComputingActivity recognition in the home has been long recognized as the foundation for many desirable applications in fields such as home automation, sustainability, and healthcare. However, building a practical home activity monitoring system remains a ...
Fusion of Multiple Sensors Sources in a Smart Home to Detect Scenarios of Activities in Ambient Assisted Living
This work takes place within the framework of Smart Homes, with the goal to monitor the activities of elderly people, living independently at home, in order to continuously assess their level of activity and therefore their autonomy. A method is ...
Recognising activities of daily living from patterns of object use
To provide assistance and support to the elderly disabled and cognitively impaired, the recognition of their activities of daily living (ADL) must be accurate and precise with regards to the object use for the activity situations. Current ...
Comments
Information & Contributors
Information
Published In
© Springer-Verlag London Ltd., part of Springer Nature 2020.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 May 2021
Accepted: 09 November 2020
Received: 19 February 2018
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Dec 2024