skip to main content
research-article
Public Access

Device-free Personalized Fitness Assistant Using WiFi

Published: 27 December 2018 Publication History

Abstract

There is a growing trend for people to perform regular workouts in home/office environments because work-at-home people or office workers can barely squeeze in time to go to dedicated exercise places (e.g., gym). To provide personalized fitness assistance in home/office environments, traditional solutions, e.g., hiring personal coaches incur extra cost and are not always available, while new trends requiring wearing smart devices around the clock are cumbersome. In order to overcome these limitations, we develop a device-free fitness assistant system in home/office environments using existing WiFi infrastructure. Our system aims to provide personalized fitness assistance by differentiating individuals, automatically recording fine-grained workout statistics, and assessing workout dynamics. In particular, our system performs individual identification via deep learning techniques on top of workout interpretation. It further assesses the workout by analyzing both short and long-term workout quality, and provides workout reviews for users to improve their daily exercises. Additionally, our system adopts a spectrogram-based workout detection algorithm along with a Cumulative Short Time Energy (CSTE)-based workout segmentation method to ensure its robustness. Extensive experiments involving 20 participants demonstrate that our system can achieve a 93% accuracy on workout recognition and a 97% accuracy for individual identification.

Supplementary Material

guo (guo.zip)
Supplemental movie, appendix, image and software files for, Device-free Personalized Fitness Assistant Using WiFi

References

[1]
2014. Fitbit. http://www.fitbit.com/.
[2]
Fadel Adib, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D Tracking via Body Radio Reflections. In 11th USENIX Symposium on Networked Systems Design and Implementation (USENIX NSDI), Vol. 14. 317--329.
[3]
Juliane Arney. 2005. You should be in pictures! Experts share tips on how to produce a quality fitness video for any purpose. IDEA Fitness Journal 2, 1 (2005), 86--90.
[4]
RG Bachu, S Kopparthi, B Adapa, and Buket D Barkana. 2010. Voiced/unvoiced decision for speech signals based on zero-crossing rate and energy. In Advanced Techniques in Computing Sciences and Software Engineering. Springer, 279--282.
[5]
Christopher M Bishop. 2006. Pattern recognition. Machine Learning 128 (2006).
[6]
Oya Çeliktutan, Ceyhun Burak Akgul, Christian Wolf, and Bülent Sankur. 2013. Graph-based analysis of physical exercise actions. In ACM international workshop on Multimedia indexing and information retrieval for healthcare (ACM MIIRH). 23--32.
[7]
Keng-hao Chang, Mike Y Chen, and John Canny. 2007. Tracking Free-Weight Exercises. In Proceedings of the 9th international conference on Ubiquitous computing (ACM UbiComp).
[8]
Xi Chen, Chen Ma, Michel Allegue, and Xue Liu. 2017. Taming the inconsistency of Wi-Fi fingerprints for device-free passive indoor localization. In INFOCOM 2017-IEEE Conference on Computer Communications, IEEE. IEEE, 1--9.
[9]
Heng-Tze Cheng, Feng-Tso Sun, Martin Griss, Paul Davis, Jianguo Li, and Di You. 2013. Nuactiv: Recognizing unseen new activities using semantic attribute-based learning. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services (ACM Mobisys).
[10]
Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning. ACM, 160--167.
[11]
Han Ding, Longfei Shangguan, Zheng Yang, Jinsong Han, Zimu Zhou, Panlong Yang, Wei Xi, and Jizhong Zhao. 2015. Femo: A platform for free-weight exercise monitoring with rfids. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (ACM Sensys). 141--154.
[12]
Xiaonan Guo, Liu Jian, and Yingying. Chen. 2017. FitCoach: Virtual Fitness Coach Empowered by Wearable Mobile Devices. In Proceedings of the International Conference on Computer Communications (IEEE INFOCOM).
[13]
Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2010. Predictable 802.11 packet delivery from wireless channel measurements. In ACM SIGCOMM Computer Communication Review, Vol. 40. ACM, 159--170.
[14]
Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool release: Gathering 802.11 n traces with channel state information. ACM SIGCOMM Computer Communication Review 41, 1 (2011), 53--53.
[15]
Hristo D Hristov. 2000. Fresnal Zones in Wireless Links, Zone Plate Lenses and Antennas. Artech House, Inc.
[16]
Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y Ng. 2009. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the 26th annual international conference on machine learning. ACM, 609--616.
[17]
Haochao Li, Eddie CL Chan, Xiaonan Guo, Jiang Xiao, Kaishun Wu, and Lionel M Ni. 2015. Wi-counter: smartphone-based people counter using crowdsourced wi-fi signal data. IEEE Transactions on Human-Machine Systems 45, 4 (2015), 442--452.
[18]
Cihang Liu, Lan Zhang, Zongqian Liu, Kebin Liu, Xiangyang Li, and Yunhao Liu. 2016. Lasagna: towards deep hierarchical understanding and searching over mobile sensing data. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (ACM MobiCom). 334--347.
[19]
American College of Sports Medicine et al. 2013. ACSM's guidelines for exercise testing and prescription. Lippincott Williams & Wilkins.
[20]
Bruno A Olshausen and David J Field. 1997. Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision research 37, 23 (1997), 3311--3325.
[21]
Sinno Jialin Pan, Qiang Yang, et al. 2010. A survey on transfer learning. IEEE Transactions on knowledge and data engineering 22, 10 (2010), 1345--1359.
[22]
Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home gesture recognition using wireless signals. In Proceedings of the 19th annual international conference on Mobile computing and networking (ACM MobiCom). 27--38.
[23]
Sreemanananth Sadanand and Jason J Corso. 2012. Action bank: A high-level representation of activity in video. In IEEE Conference on Computer Vision and Pattern Recognition (IEEE CVPR). 1234--1241.
[24]
Ruhi Sarikaya, Geoffrey E Hinton, and Anoop Deoras. 2014. Application of deep belief networks for natural language understanding. IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP) 22, 4 (2014), 778--784.
[25]
Richard Socher, Yoshua Bengio, and Chris Manning. 2013. Deep learning for NLP. Tutorial at Association of Computational Logistics (ACL), 2012, and North American Chapter of the Association of Computational Linguistics (NAACL) (2013).
[26]
Chuan-Jun Su, Chang-Yu Chiang, and Jing-Yan Huang. 2014. Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic. Applied Soft Computing 22 (2014), 652--666.
[27]
Yi Sun, Xiaogang Wang, and Xiaoou Tang. 2014. Deep learning face representation from predicting 10,000 classes. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1891--1898.
[28]
Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research 11 (2010), 3371--3408.
[29]
Naiyan Wang and Dit-Yan Yeung. 2013. Learning a deep compact image representation for visual tracking. In Advances in neural information processing systems. 809--817.
[30]
Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st annual international conference on mobile computing and networking (ACM MobiCom). 65--76.
[31]
Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures. In Proceedings of the 20th annual international conference on Mobile computing and networking (ACM MobiCom). 617--628.
[32]
Jianxin Wu, Adebola Osuntogun, Tanzeem Choudhury, Matthai Philipose, and James M Rehg. 2007. A scalable approach to activity recognition based on object use. In 11th International Conference on Computer Vision (IEEE ICCV). 1--8.
[33]
Junyuan Xie, Linli Xu, and Enhong Chen. 2012. Image denoising and inpainting with deep neural networks. In Advances in Neural Information Processing Systems. 341--349.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 4
December 2018
1169 pages
EISSN:2474-9567
DOI:10.1145/3301777
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 December 2018
Accepted: 01 October 2018
Revised: 01 August 2018
Received: 01 May 2018
Published in IMWUT Volume 2, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. channel state information
  2. device-free
  3. personalized fitness assistant

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)176
  • Downloads (Last 6 weeks)25
Reflects downloads up to 15 Sep 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media