skip to main content
10.1145/3264492.3264501acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

mm-Wave Radar Based Gesture Recognition: Development and Evaluation of a Low-Power, Low-Complexity System

Published: 01 October 2018 Publication History

Abstract

Gesture recognition is gaining attention as an attractive feature for the development of ubiquitous, context-aware, IoT applications. Use of radars as a primary or secondary system is tempting, as they can operate in darkness, high light intensity environments, and longer distances than many competitor systems. Starting from this observation, we present a generic, low-cost, mm-wave radar-based gesture recognition system. Among potential benefits of mm-wave radars are a high spatial resolution due to small wavelength, the availability of multiple antennas in a small area and the low interference due to the natural attenuation of mm-wave radiation. We experimentally evaluate our COTS solution considering eight different gestures and using two low-complexity classification algorithms: the unsupervised Self Organized Map (SOM) and the supervised Learning Vector Quantization (LVQ). To test robustness, we consider gestures performed by a human hand and a human body, at short and long distance. From our preliminary evaluations, we observe that LVQ and SOM correctly detect 75% and 60% of all gestures, respectively, from the raw, unprocessed data. The detection rate is significantly higher (>90%) for selected gesture groups. We argue that performance suffers due to inaccurate AoA estimation. Accordingly, we evaluate our system employing a two-radar setup that increases the estimation accuracy by 8-9%.

References

[1]
2018. OmniRadar RIC60a. http://www.omniradar.com/products/
[2]
H. Abdelnasser et al. 2015. WiGest: A Ubiquitous WiFi-based Gesture Recognition System. In Proc. IEEE INFOCOM.
[3]
K. Ali et al. 2015. Keystroke Recognition Using WiFi Signals. In Proc. ACM MobiCom.
[4]
L. Anitori et al. 2009. FMCW Radar for Life-Sign Detection. In Proc. IEEE RadarConf.
[5]
T. Kohonen. 1997. Self-Organizing Maps, 2nd Ed. Springer.
[6]
J. Lien et al. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. ACM Trans. Graph. 35, 4 (Jul. 2016).
[7]
P. Molchanov et al. 2015. Multi-Sensor System for Driver's Hand- Gesture Recognition. In Proc. IEEE FG.
[8]
P. Molchanov et al. 2015. Short-range FMCW Monopulse Radar for Hand-Gesture Sensing. In Proc. IEEE RadarConf.
[9]
A. Patra et al. 2017. mmRTI: Radio Tomographic Imaging using Highly- Directional Millimeter-Wave Devices for Accurate and Robust Indoor Localization. In Proc. IEEE PIMRC.
[10]
Q. Pu et al. 2013. Whole-home Gesture Recognition Using Wireless Signals. In Proc. ACM MobiCom.
[11]
T. Rappaport et al. 2011. State of the Art in 60-GHz Integrated Circuits and Systems for Wireless Communications. Proc. IEEE 99, 8 (Aug. 2011).
[12]
S. Singh et al. 2011. Interference Analysis for Highly Directional 60- GHz Mesh Networks: The Case for Rethinking Medium Access Control. IEEE/ACM Trans. Netw. 19, 5 (Oct. 2011).
[13]
Q. Wan et al. 2014. Gesture Recognition for Smart Home Applications using Portable Radar Sensors. In Proc. IEEE EMBS.
[14]
Y. Wang et al. 2014. E-eyes: Device-free Location-oriented Activity Identification Using Fine-grained WiFi Signatures. In Proc. ACM Mobi- Com.
[15]
T. Wei and X. Zhang. 2015. mTrack: High-Precision Passive Tracking Using Millimeter Wave Radios. In Proc. ACM MobiCom.
[16]
H. Yoon et al. 2001. Hand Gesture Recognition using Combined Features of Location, Angle and Velocity. Elsevier Patt. Recog. 34, 7 (2001).
[17]
H. Yoon et al. 2002. Real-time Gesture Recognition System and Application. Elsevier Image and Vision Computing 20, 13 (2002).

Cited By

View all

Index Terms

  1. mm-Wave Radar Based Gesture Recognition: Development and Evaluation of a Low-Power, Low-Complexity System

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      mmNets '18: Proceedings of the 2nd ACM Workshop on Millimeter Wave Networks and Sensing Systems
      October 2018
      75 pages
      ISBN:9781450359283
      DOI:10.1145/3264492
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 01 October 2018

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. gesture recognition
      2. machine learning
      3. mm-wave
      4. radar

      Qualifiers

      • Research-article

      Conference

      MobiCom '18
      Sponsor:

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)65
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 18 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media