research-article

Beamforming for Sensing: Hybrid Beamforming based on Transmitter-Receiver Collaboration for Millimeter-Wave Sensing

Authors:

Sanglu LuAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 8, Issue 2

Article No.: 75, Pages 1 - 27

https://doi.org/10.1145/3659619

Published: 15 May 2024 Publication History

Abstract

Previous mmWave sensing solutions assumed good signal quality. Ensuring an unblocked or strengthened LoS path is challenging. Therefore, finding an NLoS path is crucial to enhancing perceived signal quality. This paper proposes Trebsen, a Transmitter-REceiver collaboration-based Beamforming scheme SENsing using commercial mmWave radars. Specifically, we define the hybrid beamforming problem as an optimization challenge involving beamforming angle search based on transmitter-receiver collaboration. We derive a comprehensive expression for parameter optimization by modeling the signal attenuation variations resulting from the propagation path. To comprehensively assess the perception signal quality, we design a novel metric perceived signal-to-interference-plus-noise ratio (PSINR), combining the carrier signal and baseband signal to quantify the fine-grained sensing motion signal quality. Considering the high time cost of traversing or randomly searching methods, we employ a search method based on deep reinforcement learning to quickly explore optimal beamforming angles at both transmitter and receiver. We implement Trebsen and evaluate its performance in a fine-grained sensing application (i.e., heartbeat). Experimental results show that Trebsen significantly enhances heartbeat sensing performance in blocked or misaligned LoS scenes. Comparing non-beamforming, Trebsen demonstrates a reduction of 23.6% in HR error and 27.47% in IBI error. Moreover, comparing random search, Trebsen exhibits a 90% increase in search speed.

References

[1]

2023. AWR6843 single-chip 60-GHz to 64-GHz automotive radar sensor. [Online]. https://www.ti.com/tool/AWR6843ISK.

[2]

2023. Handheld and Wearable ECG Monitor ER2. [Online]. https://www.viatomtech.com/er2.

[3]

2023. mmWave cascade imaging radar DSP evaluation module. [Online]. https://www.ti.com/tool/MMWCAS-DSP-EVM.

[4]

2023. mmWave cascade imaging radar RF evaluation module. [Online]. https://www.ti.com/tool/MMWCAS-DSP-EVM.

[5]

Mohammed Abdelghany, Ali A. Farid, Maryam Eslami Rasekh, Upamanyu Madhow, and Mark J. W. Rodwell. 2021. A Design Framework for All-Digital mmWave Massive MIMO With per-Antenna Nonlinearities. IEEE Transactions on Wireless Communications 20, 9 (2021), 5689--5701. https://doi.org/10.1109/TWC.2021.3069378

[6]

Aakriti Adhikari, Hem Regmi, Sanjib Sur, and Srihari Nelakuditi. 2022. MiShape: Accurate Human Silhouettes and Body Joints from Commodity Millimeter-Wave Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 96 (sep 2022), 31 pages. https://doi.org/10.1145/3550300

Digital Library

[7]

D. Berry, R. Malech, and W. Kennedy. 1963. The reflectarray antenna. IEEE Transactions on Antennas and Propagation 11, 6 (1963), 645--651. https://doi.org/10.1109/TAP.1963.1138112

[8]

Dongjiang Cao, Ruofeng Liu, Hao Li, Shuai Wang, Wenchao Jiang, and Chris Xiaoxuan Lu. 2022. Cross Vision-RF Gait Re-Identification with Low-Cost RGB-D Cameras and MmWave Radars. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 102 (sep 2022), 25 pages. https://doi.org/10.1145/3550325

Digital Library

[9]

Baicheng Chen, Huining Li, Zhengxiong Li, Xingyu Chen, Chenhan Xu, and Wenyao Xu. 2020. ThermoWave: A New Paradigm of Wireless Passive Temperature Monitoring via MmWave Sensing. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (London, United Kingdom) (MobiCom '20). Association for Computing Machinery, New York, NY, USA, Article 27, 14 pages. https://doi.org/10.1145/3372224.3419184

Digital Library

[10]

V.C. Chen, F. Li, S.-S. Ho, and H. Wechsler. 2006. Micro-Doppler effect in radar: phenomenon, model, and simulation study. IEEE Trans. Aerospace Electron. Systems 42, 1 (2006), 2--21. https://doi.org/10.1109/TAES.2006.1603402

[11]

Peter Delos, Bob Broughton, and Jon Kraft. 2020. Phased array antenna patterns---part 2: grating lobes and beam squint. Analog Dialogue 54, 2 (2020), 1--4.

[12]

Long Fan, Lei Xie, Xinran Lu, Yi Li, Chuyu Wang, and Sanglu Lu. 2023. mmMIC: Multi-modal Speech Recognition based on mmWave Radar. In IEEE INFOCOM 2023 - IEEE Conference on Computer Communications. IEEE INFOCOM 2023, New York City, NY, USA, 1--10. https://doi.org/10.1109/INFOCOM53939.2023.10229085

[13]

Yiwen Feng, Kai Zhang, Chuyu Wang, Lei Xie, Jingyi Ning, and Shijia Chen. 2023. mmEavesdropper: Signal Augmentation-based Directional Eavesdropping with mmWave Radar. In IEEE INFOCOM 2023 - IEEE Conference on Computer Communications. IEEE INFOCOM 2023, New York City, NY, USA, 1--10. https://doi.org/10.1109/INFOCOM53939.2023.10229095

[14]

H.T. Friis. 1946. A Note on a Simple Transmission Formula. Proceedings of the IRE 34, 5 (1946), 254--256. https://doi.org/10.1109/JRPROC.1946.234568

[15]

A.B. Gershman, E. Nemeth, and J.F. Bohme. 2000. Experimental performance of adaptive beamforming in a sonar environment with a towed array and moving interfering sources. IEEE Transactions on Signal Processing 48, 1 (2000), 246--250. https://doi.org/10.1109/78.815495

Digital Library

[16]

Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. 2018. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. CoRR abs/1801.01290 (2018). arXiv:1801.01290 http://arxiv.org/abs/1801.01290

[17]

Shuangfeng Han, Chih-lin I, Zhikun Xu, and Corbett Rowell. 2015. Large-scale antenna systems with hybrid analog and digital beamforming for millimeter wave 5G. IEEE Communications Magazine 53, 1 (2015), 186--194. https://doi.org/10.1109/MCOM.2015.7010533

Digital Library

[18]

Srikrishna Iyer, Leo Zhao, Manoj Prabhakar Mohan, Joe Jimeno, Mohammed Yakoob Siyal, Arokiaswami Alphones, and Muhammad Faeyz Karim. 2022. mm-Wave Radar-Based Vital Signs Monitoring and Arrhythmia Detection Using Machine Learning. Sensors 22, 9 (2022). https://doi.org/10.3390/s22093106

[19]

Matthias Kronauge and Hermann Rohling. 2013. Fast Two-Dimensional CFAR Procedure. IEEE Trans. Aerospace Electron. Systems 49, 3 (2013), 1817--1823. https://doi.org/10.1109/TAES.2013.6558022

[20]

Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. ACM Trans. Graph. 35, 4, Article 142 (jul 2016), 19 pages. https://doi.org/10.1145/2897824.2925953

Digital Library

[21]

Haipeng Liu, Yuheng Wang, Anfu Zhou, Hanyue He, Wei Wang, Kunpeng Wang, Peilin Pan, Yixuan Lu, Liang Liu, and Huadong Ma. 2020. Real-Time Arm Gesture Recognition in Smart Home Scenarios via Millimeter Wave Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 4, Article 140 (dec 2020), 28 pages. https://doi.org/10.1145/3432235

Digital Library

[22]

Jia Liu, Min Chen, Shigang Chen, Qingfeng Pan, and Lijun Chen. 2017. Tag-compass: Determining the spatial direction of an object with small dimensions. In IEEE INFOCOM 2017 - IEEE Conference on Computer Communications. 1--9. https://doi.org/10.1109/INFOCOM.2017.8057159

[23]

Tiantian Liu, Ming Gao, Feng Lin, Chao Wang, Zhongjie Ba, Jinsong Han, Wenyao Xu, and Kui Ren. 2021. Wavoice: A Noise-Resistant Multi-Modal Speech Recognition System Fusing MmWave and Audio Signals. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems (Coimbra, Portugal) (SenSys '21). Association for Computing Machinery, New York, NY, USA, 97--110. https://doi.org/10.1145/3485730.3485945

Digital Library

[24]

Chris Xiaoxuan Lu, Muhamad Risqi U. Saputra, Peijun Zhao, Yasin Almalioglu, Pedro P. B. de Gusmao, Changhao Chen, Ke Sun, Niki Trigoni, and Andrew Markham. 2020. MilliEgo: Single-Chip MmWave Radar Aided Egomotion Estimation via Deep Sensor Fusion. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems (Virtual Event, Japan) (SenSys '20). Association for Computing Machinery, New York, NY, USA, 109--122. https://doi.org/10.1145/3384419.3430776

Digital Library

[25]

Andreas F. Molisch, Vishnu V. Ratnam, Shengqian Han, Zheda Li, Sinh Le Hong Nguyen, Linsheng Li, and Katsuyuki Haneda. 2017. Hybrid Beamforming for Massive MIMO: A Survey. IEEE Communications Magazine 55, 9 (2017), 134--141. https://doi.org/10.1109/MCOM.2017.1600400

Digital Library

[26]

Panneer Selvam Santhalingam, Al Amin Hosain, Ding Zhang, Parth Pathak, Huzefa Rangwala, and Raja Kushalnagar. 2020. MmASL: Environment-Independent ASL Gesture Recognition Using 60 GHz Millimeter-Wave Signals. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 1, Article 26 (mar 2020), 30 pages. https://doi.org/10.1145/3381010

Digital Library

[27]

Zhenguo Shi, Tao Gu, Yu Zhang, and Xi Zhang. 2023. MmBP: Contact-Free Millimetre-Wave Radar Based Approach to Blood Pressure Measurement. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (Boston, Massachusetts) (SenSys '22). Association for Computing Machinery, New York, NY, USA, 667--681. https://doi.org/10.1145/3560905.3568506

Digital Library

[28]

Mohsen Tajallifar, Ahmad R. Sharafat, and Halim Yanikomeroglu. 2023. Robust and Feasible QoS-Aware mmWave Massive MIMO Hybrid Beamforming. IEEE Transactions on Wireless Communications (2023), 1--1. https://doi.org/10.1109/TWC.2023.3290141

Digital Library

[29]

Chao Wang, Feng Lin, Zhongjie Ba, Fan Zhang, Wenyao Xu, and Kui Ren. 2022. Wavesdropper: Through-Wall Word Detection of Human Speech via Commercial MmWave Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 77 (jul 2022), 26 pages. https://doi.org/10.1145/3534592

Digital Library

[30]

Chuyu Wang, Lei Xie, Keyan Zhang, Wei Wang, Yanling Bu, and Sanglu Lu. 2019. Spin-Antenna: 3D Motion Tracking for Tag Array Labeled Objects via Spinning Antenna. In IEEE INFOCOM 2019 - IEEE Conference on Computer Communications. 1--9. https://doi.org/10.1109/INFOCOM.2019.8737372

Digital Library

[31]

Teng Wei and Xinyu Zhang. 2015. MTrack: High-Precision Passive Tracking Using Millimeter Wave Radios. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (Paris, France) (MobiCom '15). Association for Computing Machinery, New York, NY, USA, 117--129. https://doi.org/10.1145/2789168.2790113

Digital Library

[32]

Chenshu Wu, Feng Zhang, Beibei Wang, and K. J. Ray Liu. 2020. MmTrack: Passive Multi-Person Localization Using Commodity Millimeter Wave Radio. In IEEE INFOCOM 2020 - IEEE Conference on Computer Communications (Toronto, ON, Canada). IEEE Press, 2400--2409. https://doi.org/10.1109/INFOCOM41043.2020.9155293

Digital Library

[33]

Chenhan Xu, Huining Li, Zhengxiong Li, Hanbin Zhang, Aditya Singh Rathore, Xingyu Chen, Kun Wang, Ming-chun Huang, and Wenyao Xu. 2021. CardiacWave: A MmWave-Based Scheme of Non-Contact and High-Definition Heart Activity Computing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 135 (sep 2021), 26 pages. https://doi.org/10.1145/3478127

Digital Library

[34]

Weiye Xu, Wenfan Song, Jianwei Liu, Yajie Liu, Xin Cui, Yuanqing Zheng, Jinsong Han, Xinhuai Wang, and Kui Ren. 2022. Mask Does Not Matter: Anti-Spoofing Face Authentication Using MmWave without on-Site Registration. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking (Sydney, NSW, Australia) (MobiCom '22). Association for Computing Machinery, New York, NY, USA, 310--323. https://doi.org/10.1145/3495243.3560515

Digital Library

[35]

Xiangyu Xu, Jiadi Yu, Chengguang Ma, Yanzhi Ren, Hongbo Liu, Yanmin Zhu, Yi-Chao Chen, and Feilong Tang. 2022. MmECG: Monitoring Human Cardiac Cycle in Driving Environments Leveraging Millimeter Wave. In IEEE INFOCOM 2022 - IEEE Conference on Computer Communications (London, United Kingdom). IEEE Press, 90--99. https://doi.org/10.1109/INFOCOM48880.2022.9796912

Digital Library

[36]

Hongfei Xue, Qiming Cao, Yan Ju, Haochen Hu, Haoyu Wang, Aidong Zhang, and Lu Su. 2023. M4esh: MmWave-Based 3D Human Mesh Construction for Multiple Subjects. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (Boston, Massachusetts) (SenSys '22). Association for Computing Machinery, New York, NY, USA, 391--406. https://doi.org/10.1145/3560905.3568545

Digital Library

[37]

Cunzhuo Zhao, Yunlong Cai, An Liu, Minjian Zhao, and Lajos Hanzo. 2020. Mobile Edge Computing Meets mmWave Communications: Joint Beamforming and Resource Allocation for System Delay Minimization. IEEE Transactions on Wireless Communications 19, 4 (2020), 2382--2396. https://doi.org/10.1109/TWC.2020.2964543

[38]

Xin Zhao, Xue Jia, Tao Zhang, Yahui Cao, and Tianwei Liu. 2023. Evolutionary Algorithms With Blind Fitness Evaluation for Solving Optimization Problems With Only Fuzzy Fitness Information. IEEE Transactions on Fuzzy Systems 31, 11 (2023), 3995--4009. https://doi.org/10.1109/TFUZZ.2023.3273308

Digital Library

Cited By

Feng YZhao JWang CXie LLu S(2024)3D Bounding Box Estimation Based on COTS mmWave Radar via Moving ScanningProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997588:4(1-27)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699758
Li YWang CXie LJin QFan LNing JLu S(2024)Facial Landmark Detection Based on High Precision Spatial Sampling via Millimeter-wave RadarProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997398:4(1-26)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699739

Index Terms

Beamforming for Sensing: Hybrid Beamforming based on Transmitter-Receiver Collaboration for Millimeter-Wave Sensing
1. Computer systems organization
  1. Embedded and cyber-physical systems
2. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Hybrid beamforming for downlink multiuser millimetre wave MIMO‐OFDM systems

In this study, the authors consider multi‐user millimetre wave (mmWave) multiple‐input multiple‐output (MIMO) downlink communications for multi‐carrier scenarios, e.g. orthogonal frequency‐division multiplexing (OFDM) a common analogue precoder and ...
Hybrid beamforming for millimetre wave massive MU‐MIMO systems with IQ imbalance

The downlink communication of a single‐cell millimetre wave (mmWave) massive multi‐user multiple‐input multiple‐output (MU‐MIMO) system with hybrid beamforming (HBF) is studied. The authors consider the system with in‐phase and quadrature‐phase imbalance (...
Performance analysis of multi user massive MIMO hybrid beamforming systems at millimeter wave frequency bands
Abstract
Millimeter-wave (mmWave) and massive multi-input–multi-output (mMIMO) communications are the most key enabling technologies for next generation wireless networks to have large available spectrum and throughput. mMIMO is a promising technique for ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 8, Issue 2

June 2024

1330 pages

EISSN:2474-9567

DOI:10.1145/3665317

Issue’s Table of Contents

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 May 2024

Published in IMWUT Volume 8, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Collaborative Innovation Center of Novel Software Technology and Industrialization
National Key Research and Development Program of China
National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
387
Total Downloads

Downloads (Last 12 months)387
Downloads (Last 6 weeks)51

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Feng YZhao JWang CXie LLu S(2024)3D Bounding Box Estimation Based on COTS mmWave Radar via Moving ScanningProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997588:4(1-27)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699758
Li YWang CXie LJin QFan LNing JLu S(2024)Facial Landmark Detection Based on High Precision Spatial Sampling via Millimeter-wave RadarProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997398:4(1-26)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699739

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents