research-article

WiSh: Towards a Wireless Shape-aware World using Passive RFIDs

Authors:

Jason HongAuthors Info & Claims

MobiSys '18: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services

Pages 428 - 441

https://doi.org/10.1145/3210240.3210328

Published: 10 June 2018 Publication History

Abstract

This paper presents WiSh, a solution that makes ordinary surfaces shape-aware, relaying their real-time geometry directly to a user's handheld device. WiSh achieves this using inexpensive, light-weight and battery-free RFID tags attached to these surfaces tracked from a compact single-antenna RFID reader. In doing so, WiSh enables several novel applications: shape-aware clothing that can detect a user's posture, interactive shape-aware toys or even shape-aware bridges that report their structural health.

WiSh's core algorithm infers the shape of ordinary surfaces using the wireless channels of signals reflected off RFID tags received at a single-antenna RFID reader. Indeed, locating every RFID tag using a single channel measurement per-tag is challenging, given that neither their 3-D coordinates nor orientation are known a priori. WiSh presents a novel algorithm that models the geometric constraints between the coordinates of the RFID tags based on flexibility of the surface upon which they are mounted. By inferring surface curvature parameters rather than the locations of individual RFID tags, we greatly reduce the number of variables our system needs to compute. Further, WiSh overcomes a variety of system-level challenges stemming from signal multipath, stretching of fabric and modeling large surfaces. We implement WiSh on commodity RFID readers and tags attached to a variety of surfaces and demonstrate mm-accurate shape-tracking across various applications.

Supplementary Material

WEBM File (p428-jin.webm)

Download
130.26 MB

References

[1]

10th st (philip murray) bridge. http://historicbridges.org/bridges/browser/?bridgebrowser=pennsylvania/10th/. Accessed: 2018-04-25.

[2]

Bézier curve - wikipedia. https://en.wikipedia.org/wiki/B%C3%A9zier_curve. (Accessed on 12/09/2017).

[3]

Open source augmented reality sdk | artoolkit.org. https://www.artoolkit.org/. (Accessed on 12/07/2017).

[4]

D. Agdas, J. A. Rice, J. R. Martinez, and I. R. Lasa. Comparison of visual inspection and structural-health monitoring as bridge condition assessment methods. Journal of Performance of Constructed Facilities, 30(3):04015049, 2015.

[5]

A. Agrawal, G. J. Anderson, M. Shi, and R. Chierichetti. Tangible play surface using passive rfid sensor array. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, CHI EA '18, pages D101:1-D101:4, New York, NY, USA, 2018. ACM.

Digital Library

[6]

F. Ansari. Sensing issues in civil structural health monitoring. Springer, 2005.

[7]

AtlasRFIDstore. Impinj rhcp far field rfid antenna (fcc/etsi). https://www.atlasrfidstore.com/impinj-rhcp-far-field-rfid-antenna-fcc-etsi/. (Accessed on 04/30/2018).

[8]

L. Buechley. Sensormania - mediamatic. https://www.mediamatic.net/en/page/27491/sensormania, 2017. (Accessed on 11/29/2017).

[9]

A. Dementyev, H.-L. C. Kao, and J. A. Paradiso. Sensortape: Modular and programmable 3d-aware dense sensor network on a tape. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pages 649--658. ACM, 2015.

Digital Library

[10]

H. Ding, L. Shangguan, Z. Yang, J. Han, Z. Zhou, P. Yang, W. Xi, and J. Zhao. Femo: A platform for free-weight exercise monitoring with rfids. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems, pages 141--154. ACM, 2015.

Digital Library

[11]

G. E. Farin. Curves and surfaces for CAGD: a practical guide. Morgan Kaufmann, 2002.

Digital Library

[12]

S. Follmer, D. Leithinger, A. Olwal, N. Cheng, and H. Ishii. Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices. In Proceedings of the 25th annual ACM symposium on User interface software and technology, pages 519--528. ACM, 2012.

Digital Library

[13]

N. S. Foundation. Futures of the scientific imagination | explore a safer, fashion-forward future. https://www.nsf.gov/news/special_reports/futures/. (Accessed on 11/29/2017).

[14]

A. Gastineau, T. Johnson, and A. Schultz. Bridge health monitoring and inspections--a survey of methods. 2009.

[15]

J. Hong. Toward a safe and secure internet of things - new america. https://www.newamerica.org/cybersecurity-initiative/policy-papers/toward-a-safe-and-secure-internet-of-things/, June, 2016. (Accessed on 05/03/2018).

[16]

Y. Hou, Y. Wang, and Y. Zheng. Tagbreathe: Monitor breathing with commodity rfid systems. In Distributed Computing Systems (ICDCS), 2017 IEEE 37th International Conference on, pages 404--413. IEEE, 2017.

[17]

C. Ingraham. Mapping america's most dangerous bridges - the washington post. https://www.washingtonpost.com/news/wonk/wp/2015/02/04/mapping-americas-most-dangerous-bridges/?utm_term=.d231413e97d3, 2015. (Accessed on 04/30/2018).

[18]

R. Insider. Rfid readers for mobile phones from tsl. http://blog.atlasrfidstore.com/rfid-readers-mobile-phones-tsl, 2014.

[19]

S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, et al. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology, pages 559--568. ACM, 2011.

Digital Library

[20]

H. Jin, C. Xu, and K. Lyons. Corona: Positioning adjacent device with asymmetric bluetooth low energy rssi distributions. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, UIST '15, pages 175--179, New York, NY, USA, 2015. ACM.

Digital Library

[21]

H. Jin, Z. Yang, S. Kumar, and J. Hong. Towards wearable everyday body-frame tracking using passive rfids. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017.

Digital Library

[22]

T. Karrer, M. Wittenhagen, L. Lichtschlag, F. Heller, and J. Borchers. Pinstripe: eyes-free continuous input on interactive clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1313--1322. ACM, 2011.

Digital Library

[23]

H. Li, E. Brockmeyer, E. J. Carter, J. Fromm, S. E. Hudson, S. N. Patel, and A. Sample. Paperid: A technique for drawing functional battery-free wireless interfaces on paper. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, pages 5885--5896, New York, NY, USA, 2016. ACM.

Digital Library

[24]

H. Li, C. Ye, and A. P. Sample. Idsense: A human object interaction detection system based on passive uhf rfid. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 2555--2564. ACM, 2015.

Digital Library

[25]

H. Li, P. Zhang, S. Al Moubayed, S. N. Patel, and A. P. Sample. Id-match: A hybrid computer vision and rfid system for recognizing individuals in groups. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, pages 4933--4944, New York, NY, USA, 2016. ACM.

Digital Library

[26]

H. Li, P. Zhang, S. Al Moubayed, S. N. Patel, and A. P. Sample. Id-match: A hybrid computer vision and rfid system for recognizing individuals in groups. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 4933--4944. ACM, 2016.

Digital Library

[27]

Y. Ma, N. Selby, and F. Adib. Minding the billions: Ultra-wideband localization for deployed rfid tags. In ACM MobiCom, 2017.

Digital Library

[28]

P. Millot, L. Castanet, L. Casadebaig, N. Maaref, A. Gaugue, M. MÃl'nard, J. Khamlichi, G. Louis, N. Fortino, J. Y. Dauvignac, G. Clementi, M. Schortgen, L. Quellec, and V. Laroche. An uwb through-the-wall radar with 3d imaging, detection and tracking capabilities. In 2015 European Radar Conference (EuRAD), pages 237--240, Sept 2015.

[29]

T. B. Moeslund and E. Granum. A survey of computer vision-based human motion capture. Computer vision and image understanding, 81(3):231--268, 2001.

Digital Library

[30]

R. Nayak, A. Singh, R. Padhye, and L. Wang. Rfid in textile and clothing manufacturing: technology and challenges. Fashion and Textiles, 2(1):9, Jun 2015.

[31]

G. Neumann, J. Garvin, J. B. Blair, Bufton, Jack, and B. Coyle. Lidar imaging of topography with millimeter ranging precision for proximity science and operations from rovers or spacecraft. 2017.

[32]

H. N. Ng and R. L. Grimsdale. Computer graphics techniques for modeling cloth. IEEE Computer Graphics and Applications, 16(5):28--41, 1996.

Digital Library

[33]

L. M. Ni, Y. Liu, Y. C. Lau, and A. P. Patil. Landmarc: indoor location sensing using active rfid. Wireless networks, 10(6):701--710, 2004.

Digital Library

[34]

NPR. Time to overhaul america's aging bridges? https://www.npr.org/2012/08/31/160391678/time-to-overhaul-americas-aging-bridges, 2017. (Accessed on 04/24/2018).

[35]

C. Occhiuzzi, S. Cippitelli, and G. Marrocco. Modeling, design and experimentation of wearable rfid sensor tag. IEEE Transactions on Antennas and Propagation, 58(8):2490--2498, 2010.

[36]

P. Parzer, A. Sharma, A. Vogl, J. Steimle, A. Olwal, and M. Haller. Smartsleeve: Real-time sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, pages 565--577. ACM, 2017.

Digital Library

[37]

N.Point. Optitrack. Natural Point, Inc.,{Online}. Available: http://www.naturalpoint.com/optitrack/. {Accessed 22 2 2014}, 2011.

[38]

I. Poupyrev, N.-W. Gong, S. Fukuhara, M. E. Karagozler, C. Schwesig, and K. E. Robinson. Project jacquard: interactive digital textiles at scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pages 4216--4227. ACM, 2016.

Digital Library

[39]

S. Pradhan, E. Chai, K. Sundaresan, L. Qiu, M. A. Khojastepour, and S. Rangarajan. Rio: A pervasive rfid-based touch gesture interface. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, MobiCom '17, pages 261--274, New York, NY, USA, 2017. ACM.

Digital Library

[40]

C. Rendl, D. Kim, S. Fanello, P. Parzer, C. Rhemann, J. Taylor, M. Zirkl, G. Scheipl, T. Rothländer, M. Haller, et al. Flexsense: a transparent self-sensing deformable surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pages 129--138. ACM, 2014.

Digital Library

[41]

S. Schneegass and A. Voit. Gesturesleeve: Using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers, pages 108--115. ACM, 2016.

Digital Library

[42]

L. Shangguan, Z. Zhou, and K. Jamieson. Enabling gesture-based interactions with objects. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services, pages 239--251. ACM, 2017.

Digital Library

[43]

M. Sherburn. Geometric and mechanical modelling of textiles. PhD thesis, University of Nottingham, 2007.

[44]

T.-W. Shyr, J.-W. Shie, C.-H. Jiang, and J.-J. Li. A textile-based wearable sensing device designed for monitoring the flexion angle of elbow and knee movements. Sensors, 14(3):4050--4059, 2014.

[45]

F. P. Such, V. Madhavan, E. Conti, J. Lehman, K. O. Stanley, and J. Clune. Deep neuroevolution: Genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning. arXiv preprint arXiv:1712.06567, 2017.

[46]

D. Terzopoulos, J. Platt, A. Barr, and K. Fleischer. Elastically deformable models. In ACM Siggraph Computer Graphics, volume 21, pages 205--214. ACM, 1987.

Digital Library

[47]

TexTrace. The textile rfid solution. http://www.textrace.com/en/index.php, 2017. (Accessed on 04/29/2018).

[48]

M. Walter and A. Fournier. Approximate arc length parameterization. In Proceedings of the 9th Brazilian symposium on computer graphics and image processing, pages 143--150, 1996.

[49]

H. Wang, J. Kearney, and K. Atkinson. Arc-length parameterized spline curves for real-time simulation. In Proc. 5th International Conference on Curves and Surfaces, pages 387--396, 2002.

[50]

J. Wang, D. Vasisht, and D. Katabi. Rf-idraw: virtual touch screen in the air using rf signals. In ACM SIGCOMM Computer Communication Review, volume 44, pages 235--246. ACM, 2014.

Digital Library

[51]

Y. Wang, C. C. Wang, and M. M. Yuen. Fast energy-based surface wrinkle modeling. Computers & Graphics, 30(1):111--125, 2006.

Digital Library

[52]

T. Wei and X. Zhang. Gyro in the air: tracking 3d orientation of batteryless internet-of-things. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pages 55--68. ACM, 2016.

Digital Library

[53]

E.W. Weisstein. Rotation matrix. 2003.

[54]

Wikipedia. Genetic algorithm. https://en.wikipedia.org/wiki/Genetic_algorithm, 2017. (Accessed on 12/07/2017).

[55]

J. Xiong and K. Jamieson. Arraytrack: A fine-grained indoor location system. Usenix, 2013.

Digital Library

[56]

L. Yang, Y. Chen, X.-Y. Li, C. Xiao, M. Li, and Y. Liu. Tagoram: Real-time tracking of mobile rfid tags to high precision using cots devices. In Proceedings of the 20th annual international conference on Mobile computing and networking, pages 237--248. ACM, 2014.

Digital Library

[57]

L. Yao, R. Niiyama, J. Ou, S. Follmer, C. Della Silva, and H. Ishii. Pneui: Pneumatically actuated soft composite materials for shape changing interfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST '13, pages 13--22, New York, NY, USA, 2013. ACM.

Digital Library

[58]

L. Yao, J. Ou, C.-Y. Cheng, H. Steiner, W. Wang, G. Wang, and H. Ishii. Biologic: natto cells as nanoactuators for shape changing interfaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pages 1--10. ACM, 2015.

Digital Library

[59]

W. Zhang, L. M. Sun, and S. W. Sun. Bridge-deflection estimation through inclinometer data considering structural damages. Journal of Bridge Engineering, 22(2):04016117, 2017.

[60]

Y. Zhang, G. Laput, and C. Harrison. Electrick: Low-cost touch sensing using electric field tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI '17, pages 1--14, New York, NY, USA, 2017. ACM.

Digital Library

[61]

Y. Zhu, Y. Yao, B. Y. Zhao, and H. Zheng. Object recognition and navigation using a single networking devic. 2017.

Cited By

Nolan JQian KZhang X(2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631442
Bai YShahid ITakawale HRoy N(2024)ScribeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314117:4(1-31)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631411
Su YZhang TFeng JShi YYang XWu T(2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642356
Show More Cited By

Index Terms

WiSh: Towards a Wireless Shape-aware World using Passive RFIDs
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Towards Wearable Everyday Body-Frame Tracking using Passive RFIDs

We introduce RF-Wear, an accurate and wearable solution to track movements of a user's body using passive RFIDs embedded in their clothing. RF-Wear processes wireless signals reflected off these tags to a compact single-antenna RFID reader in the user's ...
Shape-aware MLS deformation for line handles
SA '15: SIGGRAPH Asia 2015 Technical Briefs

In this work, we propose a shape-aware extension to the Moving Least Squares (MLS) image deformation algorithm proposed by Schaefer et al. The original algorithm is not applicable to concave shapes since the weights are based on the Euclidean distance. ...
RF-Wear: Towards Wearable Everyday Skeleton Tracking Using Passive RFIDs
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers

We introduce RF-Wear1, a low-cost, washable and wearable solution to track movements of a user's body using passive RFIDs embedded in their clothing. RF-Wear processes wireless signals reflected off these tags to a compact single-antenna RFID reader in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobiSys '18: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services

June 2018

560 pages

ISBN:9781450357203

DOI:10.1145/3210240

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MobiSys '18

Sponsor:

SIGMOBILE

MobiSys '18: The 16th Annual International Conference on Mobile Systems, Applications, and Services

June 10 - 15, 2018

Munich, Germany

Acceptance Rates

Overall Acceptance Rate 274 of 1,679 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
650
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)6

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nolan JQian KZhang X(2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631442
Bai YShahid ITakawale HRoy N(2024)ScribeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314117:4(1-31)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631411
Su YZhang TFeng JShi YYang XWu T(2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642356
Jiao WWang JHe YXi XWang FFang DChen X(2024)Eliminating Design Effort: A Reconfigurable Sensing Framework for Chipless, Backscatter TagsIEEE/ACM Transactions on Networking10.1109/TNET.2023.332026332:2(1155-1170)Online publication date: Apr-2024
https://doi.org/10.1109/TNET.2023.3320263
Meegahapola L(2024)Jingxian Wang: “Pushing the Limits of Battery-Free Internet-of-Things”IEEE Pervasive Computing10.1109/MPRV.2024.338395523:1(70-72)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1109/MPRV.2024.3383955
Zhu YZhang Q(2024)LoPrint: Mobile Authentication of RFID-Tagged Items Using COTS Orthogonal AntennasIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621362(1551-1560)Online publication date: 20-May-2024
https://doi.org/10.1109/INFOCOM52122.2024.10621362
Wang SYan YChen YYang PLi X(2023)Spray: A Spectrum-efficient and Agile Concurrent Backscatter SystemACM Transactions on Sensor Networks10.1145/363805120:2(1-21)Online publication date: 25-Dec-2023
https://dl.acm.org/doi/10.1145/3638051
Wang GHan LChang YShi YQian CZhao CDing HXi WZhao CZhao J(2023)Cross-technology Communication between Visible Light and Battery-free RFIDsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108837:3(1-20)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610883
Mamish JGuo ACohen TRichey JZhang YHester J(2023)Interaction HarvestingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108807:3(1-31)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610880
Yang XSayono JZhang Y(2023)CubeSense++: Smart Environment Sensing with Interaction-Powered Corner Reflector MechanismsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606744(1-12)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606744
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents