skip to main content
10.1145/3522783.3529521acmconferencesArticle/Chapter ViewAbstractPublication PageswisecConference Proceedingsconference-collections
research-article
Open access

Online Stream Sampling for Low-Memory On-Device Edge Training for WiFi Sensing

Published: 16 May 2022 Publication History

Abstract

Deploying machine learning models on-board edge devices allows for low latency model inference and data privacy by keeping sensor data local to the computation rather than at a central server. However, typical TinyML systems train a single global model which is duplicated across all edge devices. This leads to a model that is generalized to the training data, but not specialized to the unique physical environment where the device is deployed. In this work, we evaluate how we can train machine learning models on-board low-memory edge devices with streams of incoming data. When using these low-memory devices, storage space is at a minimum and as such, representative data samples from the data stream must be captured to ensure that the models can improve even with a limited set of available training samples. We propose the Variable Low/High Loss sampling method for selecting representative data samples from a data stream and demonstrate that our methods are able to increase the accuracy of the machine learning model compared to state-of-the-art methods. We demonstrate the applicability of our proposed method for WiFi sensing based human activity detection, where WiFi signals are used to predict human activities in a given environment without requiring sensors on their bodies.

References

[1]
REFERENCES [1] Maria Francesca Alati, Giancarlo Fortino, Juan Morales, Jose M Cecilia, and Pietro Manzoni. 2022. Time series analysis for temperature forecasting using TinyML. In 2022 IEEE 19th Annual Consumer Communications & Networking Conference (CCNC). IEEE, 691--694.
[2]
Yunhao Bai and Xiaorui Wang. 2020. CARIN: Wireless CSI-based Driver Activity Recognition under the Interference of Passengers. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--28.
[3]
Han Cai, Chuang Gan, Ligeng Zhu, and Song Han. 2020. TinyTL: Reduce Activations, Not Trainable Parameters for Efficient On-Device Learning. arXiv preprint arXiv:2007.11622 (2020).
[4]
Lachit Dutta and Swapna Bharali. 2021. TinyML Meets IoT: A Comprehensive Survey. Internet of Things 16 (2021), 100461.
[5]
Lingchao Guo, Zhaoming Lu, Shuang Zhou, Xiangming Wen, and Zhihong He. 2021. Emergency Semantic Feature Vector Extraction From WiFi Signals for InHome Monitoring of Elderly. IEEE Journal of Selected Topics in Signal Processing 15, 6 (2021), 1423--1438.
[6]
Steven M. Hernandez and Eyuphan Bulut. 2020. Lightweight and standalone IoT based WiFi sensing for active repositioning and mobility. In 2020 IEEE 21st International Symposium on" A World of Wireless, Mobile and Multimedia Networks"(WoWMoM). IEEE, 277--286.
[7]
Steven M. Hernandez and Eyuphan Bulut. 2021. WiFederated: Scalable WiFi Sensing using Edge Based Federated Learning. Internet of Things Journal (2021).
[8]
Steven M Hernandez, Deniz Erdag, and Eyuphan Bulut. 2021. Towards Dense and Scalable Soil Sensing Through Low-Cost WiFi Sensing Networks. In 2021 IEEE 46th Conference on Local Computer Networks (LCN). IEEE, 549--556.
[9]
Hongbo Jiang, Chao Cai, Xiaoqiang Ma, Yang Yang, and Jiangchuan Liu. 2018. Smart Home Based on WiFi Sensing: A Survey. IEEE Access 6 (2018), 13317--13325.
[10]
Kavya Kopparapu and Eric Lin. 2021. TinyFedTL: Federated Transfer Learning on Tiny Devices. arXiv preprint arXiv:2110.01107 (2021).
[11]
Wamiq Raza, Anas Osman, Francesco Ferrini, and Francesco De Natale. 2021. Energy-Efficient Inference on the Edge Exploiting TinyML Capabilities for UAVs. Drones 5, 4 (2021), 127.
[12]
Haoyu Ren, Darko Anicic, and Thomas A Runkler. 2021. TinyOL: TinyML with Online-Learning on Microcontrollers. In International Joint Conference on Neural Networks (IJCNN). IEEE, 1--8.
[13]
Haoyu Ren, Darko Anicic, and Thomas A. Runkler. 2021. TinyOL: TinyML with Online-Learning on Microcontrollers. In International Joint Conference on Neural Networks (IJCNN). IEEE.
[14]
Yu Rong, Andrew Herschfelt, Jacob Holtom, and Daniel W. Bliss. 2021. Cardiac and Respiratory Sensing from a Hovering UAV Radar Platform. In IEEE Statistical Signal Processing Workshop (SSP). IEEE.
[15]
A. Navaas Roshan, B. Gokulapriyan, C. Siddarth, and Priyanka Kokil. 2021. Adaptive Traffic Control With TinyML. In Sixth International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET). IEEE.
[16]
Vatsal Shah, Xiaoxia Wu, and Sujay Sanghavi. 2020. Choosing the sample with lowest loss makes sgd robust. In International Conference on Artificial Intelligence and Statistics. PMLR, 2120--2130.
[17]
Jeffrey S. Vitter. 1985. Random sampling with a reservoir. ACM Trans. Math. Software 11, 1 (1985), 37--57.
[18]
Xiao Zeng, Ming Yan, and Mi Zhang. 2021. Mercury: Efficient On-Device Distributed DNN Training via Stochastic Importance Sampling. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. ACM.
[19]
Taiyu Zhu, Lei Kuang, John Daniels, Pau Herrero, Kezhi Li, and Pantelis Georgiou. 2022. IoMT-Enabled Real-time Blood Glucose Prediction with Deep Learning and Edge Computing. Internet of Things Journal (2022)

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WiseML '22: Proceedings of the 2022 ACM Workshop on Wireless Security and Machine Learning
May 2022
93 pages
ISBN:9781450392778
DOI:10.1145/3522783
  • General Chair:
  • Murtuza Jadliwala
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 May 2022

Check for updates

Author Tags

  1. edge learning
  2. importance sampling
  3. on-device machine learning
  4. tinyml
  5. wifi sensing

Qualifiers

  • Research-article

Funding Sources

  • National Science Foundation Graduate Research Fellowship Program (NSF-GRFP)
  • Commonwealth Cyber Initiative (CCI)

Conference

WiSec '22

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)175
  • Downloads (Last 6 weeks)14
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Wireless Sensing-based Daily Activity Tracking System Deployment in Low-Income Senior Housing EnvironmentsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3698115(2260-2267)Online publication date: 4-Dec-2024
  • (2024)Autonomous On-Device Protocols: Empowering Wireless with Self-Driven Capabilities2024 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC57260.2024.10571037(1-6)Online publication date: 21-Apr-2024
  • (2023)WiFi Sensing with Single-Antenna Devices for Ambient Assisted LivingProceedings of the 8th international Workshop on Sensor-Based Activity Recognition and Artificial Intelligence10.1145/3615834.3615841(1-8)Online publication date: 21-Sep-2023
  • (2023)Wi-Alert: WiFi Sensing for Real-time Package Theft Alerts at Residential DoorstepsProceedings of the Twenty-fourth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing10.1145/3565287.3617615(424-429)Online publication date: 23-Oct-2023
  • (2023)WiFi Sensing on the Edge: Signal Processing Techniques and Challenges for Real-World SystemsIEEE Communications Surveys & Tutorials10.1109/COMST.2022.320914425:1(46-76)Online publication date: 1-Jan-2023

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media