research-article

Boosting fine-grained activity sensing by embracing wireless multipath effects

Authors:

Daqing ZhangAuthors Info & Claims

CoNEXT '18: Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies

Pages 139 - 151

https://doi.org/10.1145/3281411.3281425

Published: 04 December 2018 Publication History

Abstract

With a big success in data communication, wireless signals are now exploited for fine-grained contactless activity sensing including human respiration monitoring, finger gesture recognition, subtle chin movement tracking when speaking, etc. Different from coarsegrained body and limb movements, these fine-grained movements are in the scale of millimetres and are thus difficult to be sensed. While good sensing performance can be achieved at one location, the performance degrades dramatically at a very nearby location. In this paper, by revealing the effect of static multipaths in sensing, we propose a novel method to add man-made "virtual" multipath to significantly improve the sensing performance. With carefully designed "virtual" multipath, we are able to boost the sensing performance at each location purely in software without any extra hardware.

We demonstrate the effectiveness of the proposed method on three fine-grained sensing applications with just one Wi-Fi transceiver-pair, each equipped with a single antenna. For respiration monitoring, we can remove the "blind spots" and achieve full coverage respiration sensing. For finger gesture recognition, our system can significantly increase the recognition accuracy from 33% to 81%. For chin movement tracking, we are able to count the number of spoken syllables in a sentence at an accuracy of 92.8%.

Supplementary Material

ZIP File (p139-niu.zip)

Supplemental material.

Download
85.08 MB

MP4 File (p139-niu.mp4)

Download
256.81 MB

References

[1]

2017. Mango Communications. http://mangocomm.com. Online, accessed 1-October-2017.

[2]

2017. WARP Project. https://warpproject.org. Online, accessed 1-October-2017.

[3]

2017. WARPLab 7. https://warpproject.org/trac/wiki/WARPLab. Online, accessed 1-October-2017.

[4]

2018. Raspberry Pi 3 Model B. https://www.raspberrypi.org/products/raspberry-pi-3-model-b/. Online, accessed 21-June-2018.

[5]

Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-Person Localization via RF Body Reflections. In NSDI. 279--292.

Digital Library

[6]

Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 837--846.

Digital Library

[7]

Kamran Ali, Alex X Liu, Wei Wang, and Muhammad Shahzad. 2017. Recognizing keystrokes using WiFi devices. IEEE Journal on Selected Areas in Communications 35, 5 (2017), 1175--1190.

Digital Library

[8]

Yibo Chen and Rong Luo. 2007. Design and implementation of a wifi-based local locating system. In Portable Information Devices, 2007. PORTABLE07. IEEE International Conference on. IEEE, 1--5.

[9]

Chen-Yu Hsu, Aayush Ahuja, Shichao Yue, Rumen Hristov, Zachary Kabelac, and Dina Katabi. 2017. Zero-Effort In-Home Sleep and Insomnia Monitoring using Radio Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 59.

Digital Library

[10]

Chen-Yu Hsu, Yuchen Liu, Zachary Kabelac, Rumen Hristov, Dina Katabi, and Christine Liu. 2017. Extracting Gait Velocity and Stride Length from Surrounding Radio Signals. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2116--2126.

Digital Library

[11]

Yann LeCun, LD Jackel, Leon Bottou, A Brunot, Corinna Cortes, JS Denker, Harris Drucker, I Guyon, UA Muller, Eduard Sackinger, et al. 1995. Comparison of learning algorithms for handwritten digit recognition. In International conference on artificial neural networks, Vol. 60. Perth, Australia, 53--60.

[12]

Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. WiFinger: talk to your smart devices with finger-grained gesture. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 250--261.

Digital Library

[13]

Mengyuan Li, Yan Meng, Junyi Liu, Haojin Zhu, Xiaohui Liang, Yao Liu, and Na Ruan. 2016. When CSI meets public WiFi: Inferring your mobile phone password via WiFi signals. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security. ACM, 1068--1079.

Digital Library

[14]

Xiang Li, Shengjie Li, Daqing Zhang, Jie Xiong, Yasha Wang, and Hong Mei. 2016. Dynamic-music: accurate device-free indoor localization. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 196--207.

Digital Library

[15]

Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 72.

Digital Library

[16]

Jian Liu, Yan Wang, Yingying Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015. Tracking vital signs during sleep leveraging off-the-shelf wifi. In Proceedings of the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing. ACM, 267--276.

Digital Library

[17]

Xuefeng Liu, Jiannong Cao, Shaojie Tang, and Jiaqi Wen. 2014. Wi-Sleep: Contact-less sleep monitoring via WiFi signals. In Real-Time Systems Symposium (RTSS), 2014 IEEE. IEEE, 346--355.

[18]

Huadong Ma, Chengbin Zeng, and Charles X Ling. 2012. A reliable people counting system via multiple cameras. ACM Transactions on Intelligent Systems and Technology (TIST) 3, 2 (2012), 31.

Digital Library

[19]

Pedro Melgarejo, Xinyu Zhang, Parameswaran Ramanathan, and David Chu. 2014. Leveraging directional antenna capabilities for fine-grained gesture recognition. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 541--551.

Digital Library

[20]

Jochen Penne, Christian Schaller, Joachim Hornegger, and Torsten Kuwert. 2008. Robust real-time 3D respiratory motion detection using time-of-flight cameras. International Journal of Computer Assisted Radiology and Surgery 3, 5 (2008), 427--431.

[21]

Kun Qian, Chenshu Wu, Zimu Zhou, Yue Zheng, Zheng Yang, and Yunhao Liu. 2017. Inferring motion direction using commodity wi-fi for interactive exergames. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1961--1972.

Digital Library

[22]

Ronald W Schafer. 2011. What is a Savitzky-Golay filter?{lecture notes}. IEEE Signal Processing Magazine 4 (2011), 111 117.

[23]

Longfei Shangguan, Zimu Zhou, and Kyle Jamieson. 2017. Enabling gesture-based interactions with objects. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 239--251.

Digital Library

[24]

Liyuan Song, Hongliang Zou, and Tingting Zhang. 2015. A low complexity asynchronous UWB TDOA localization method. International Journal of Distributed Sensor Networks 11, 10 (2015), 675490.

Digital Library

[25]

Li Sun, Souvik Sen, Dimitrios Koutsonikolas, and Kyu-Han Kim. 2015. Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 77--89.

Digital Library

[26]

Swaroop Venkatesh, Christopher R Anderson, Natalia V Rivera, and R Michael Buehrer. 2005. Implementation and analysis of respiration-rate estimation using impulse-based UWB. In Military Communications Conference, 2005. MILCOM 2005. IEEE. IEEE, 3314--3320.

[27]

Aditya Virmani and Muhammad Shahzad. 2017. Position and Orientation Agnostic Gesture Recognition Using WiFi. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 252--264.

Digital Library

[28]

Guanhua Wang, Yongpan Zou, Zimu Zhou, Kaishun Wu, and Lionel M Ni. 2016. We can hear you with wi-fi! IEEE Transactions on Mobile Computing 15, 11 (2016), 2907--2920.

Digital Library

[29]

Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 25--36.

Digital Library

[30]

Hao Wang, Daqing Zhang, Kai Niu, Qin Lv, Yuanhuai Liu, Dan Wu, Ruiyang Gao, and Bing Xie. 2017. MFDL: A Multicarrier Fresnel Penetration Model based Device-Free Localization System leveraging Commodity Wi-Fi Cards. arXiv preprint arXiv:1707.07514 (2017).

[31]

Hao Wang, Daqing Zhang, Yasha Wang, Junyi Ma, Yuxiang Wang, and Shengjie Li. 2017. RT-Fall: A real-time and contactless fall detection system with commodity WiFi devices. IEEE Transactions on Mobile Computing 16, 2 (2017), 511--526.

Digital Library

[32]

Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: low human-effort, device-free localization with fine-grained subcarrier information. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 243--256.

Digital Library

[33]

Wei Wang, Alex X Liu, and Muhammad Shahzad. 2016. Gait recognition using wifi signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 363--373.

Digital Library

[34]

Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 65--76.

Digital Library

[35]

Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures. In Proceedings of the 20th annual international conference on Mobile computing and networking. ACM, 617--628.

Digital Library

[36]

Teng Wei and Xinyu Zhang. 2015. mtrack: High-precision passive tracking using millimeter wave radios. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 117--129.

Digital Library

[37]

Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine 55, 10 (2017), 91--97.

[38]

Dan Wu, Daqing Zhang, Chenren Xu, Yasha Wang, and Hao Wang. 2016. WiDir: walking direction estimation using wireless signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 351--362.

Digital Library

[39]

Jie Xiong, Karthikeyan Sundaresan, and Kyle Jamieson. 2015. Tonetrack: Leveraging frequency-agile radios for time-based indoor wireless localization. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 537--549.

Digital Library

[40]

Yunze Zeng, Parth H Pathak, and Prasant Mohapatra. 2016. WiWho: wifi-based person identification in smart spaces. In Proceedings of the 15th International Conference on Information Processing in Sensor Networks. IEEE Press, 4.

Digital Library

[41]

Daqing Zhang, Hao Wang, and Dan Wu. 2017. Toward centimeter-scale human activity sensing with Wi-Fi signals. Computer 50, 1 (2017), 48--57.

Digital Library

[42]

Fusang Zhang, Daqing Zhang, Jie Xiong, Hao Wang, Kai Niu, Beihong Jin, and Yuxiang Wang. 2018. From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 53 (2018).

Digital Library

[43]

Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 95--108.

Digital Library

[44]

Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S Jaakkola, and Matt T Bianchi. 2017. Learning sleep stages from radio signals: A conditional adversarial architecture. In International Conference on Machine Learning. 4100--4109.

Digital Library

Cited By

Wang ZChen ZZhang YGeng CSong WSun ZGuo BYu ZChen L(2024)GrainSense: A Wireless Grain Moisture Sensing System Based on Wi-Fi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785898:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678589
Weng YWu GZheng TYang YLuo JShu YLiu JTan RHe YChen J(2024)Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity RecognitionProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699349(436-449)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699349
Wang XWang JNiu KXiong JZhang FYi EYu AYao ZZhang DShu YLiu JTan RHe YChen J(2024)Wi2DMeasure: WiFi-based 2D Object Size MeasurementProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699336(253-266)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699336
Show More Cited By

Index Terms

Boosting fine-grained activity sensing by embracing wireless multipath effects
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools
    2. Ubiquitous and mobile computing theory, concepts and paradigms
      1. Ubiquitous computing

Recommendations

On multipath fading channels at high SNR

A noncoherent multipath fading channel is considered, where neither the transmitter nor the receiver is cognizant of the realization of the path gains, but both are cognizant of their statistics. It is shown that if the delay spread is large in the ...
Wireless sensing applications with Wi-Fi Channel State Information, preprocessing techniques, and detection algorithms: A survey
Abstract
Recently, using Wi-Fi devices as sensing technology has garnered significant attention and found numerous applications. This trend has given birth to what is known as Wi-Fi sensing. This innovative approach has been made possible by analyzing the ...
Group-blind intersymbol multiuser detection for downlink CDMA with multipath

Group-blind multiuser detectors for uplink code-division multiple-access (CDMA) were recently developed by Wang and Host-Madsen. These detectors make use of the spreading sequences of known users to construct a group constraint to suppress the intracell ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '18: Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies

December 2018

408 pages

ISBN:9781450360807

DOI:10.1145/3281411

General Chairs:
Xenofontas Dimitropoulos
University of Crete and FORTH, Greece
,
Alberto Dainotti
CAIDA, University of California, San Diego
,
Program Chairs:
Laurent Vanbever
ETH Zurich, Switzerland
,
Theophilus Benson
Brown University

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 December 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
National Key Research and Development Plan
Young Scientists Fund of the National Natural Science Foundation of China

Conference

CoNEXT '18

Sponsor:

SIGCOMM

CoNEXT '18: The 14th International Conference on emerging Networking EXperiments and Technologies

December 4 - 7, 2018

Heraklion, Greece

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
922
Total Downloads

Downloads (Last 12 months)84
Downloads (Last 6 weeks)15

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang ZChen ZZhang YGeng CSong WSun ZGuo BYu ZChen L(2024)GrainSense: A Wireless Grain Moisture Sensing System Based on Wi-Fi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785898:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678589
Weng YWu GZheng TYang YLuo JShu YLiu JTan RHe YChen J(2024)Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity RecognitionProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699349(436-449)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699349
Wang XWang JNiu KXiong JZhang FYi EYu AYao ZZhang DShu YLiu JTan RHe YChen J(2024)Wi2DMeasure: WiFi-based 2D Object Size MeasurementProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699336(253-266)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699336
Dong HCui MWang NQiu LXiong JWang WGanesan DLane NShi W(2024)GPSense: Passive Sensing with Pervasive GPS SignalsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690674(1000-1014)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690674
Yao ZWang XNiu KZheng RWang JZhang DGanesan DShi W(2024)WiProfile: Unlocking Diffraction Effects for Sub-Centimeter Target Profiling Using Commodity WiFi DevicesProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649355(185-199)Online publication date: 29-May-2024
https://dl.acm.org/doi/10.1145/3636534.3649355
Wang XYu ANiu KShi WWang JYao ZShah RLu HZhang D(2024)Understanding the Diffraction Model in Static Multipath-Rich Environments for WiFi Sensing System DesignIEEE Transactions on Mobile Computing10.1109/TMC.2024.337770823:11(10393-10410)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TMC.2024.3377708
Zhuo HZhong TWu XYu BFeng SZhong QZhang H(2024)Exploiting Dynamic Phase Information for Respiration Monitoring During Sleep via WiFi2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)10.1109/EMBC53108.2024.10782642(1-5)Online publication date: 15-Jul-2024
https://doi.org/10.1109/EMBC53108.2024.10782642
Armenta-Garcia JGonzalez-Navarro FCaro-Gutierrez J(2024)Wireless sensing applications with Wi-Fi Channel State Information, preprocessing techniques, and detection algorithmsComputer Communications10.1016/j.comcom.2024.06.011224:C(254-274)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.comcom.2024.06.011
Wang XNiu KYu AXiong JYao ZWang JLi WZhang D(2023)WiMeasureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962507:2(1-26)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596250
Xie BCui MGanesan DChen XXiong JHui PAmiri Sani ANurmi PLiu Y(2023)Boosting the Long Range Sensing Potential of LoRaProceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services10.1145/3581791.3596847(177-190)Online publication date: 18-Jun-2023
https://dl.acm.org/doi/10.1145/3581791.3596847
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents