research-article

SurfaceSight: A New Spin on Touch, User, and Object Sensing for IoT Experiences

Authors:

Chris HarrisonAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 329, Pages 1 - 12

https://doi.org/10.1145/3290605.3300559

Published: 02 May 2019 Publication History

Abstract

IoT appliances are gaining consumer traction, from smart thermostats to smart speakers. These devices generally have limited user interfaces, most often small buttons and touchscreens, or rely on voice control. Further, these devices know little about their surroundings unaware of objects, people and activities happening around them. Consequently, interactions with these "smart" devices can be cumbersome and limited. We describe SurfaceSight, an approach that enriches IoT experiences with rich touch and object sensing, offering a complementary input channel and increased contextual awareness. For sensing, we incorporate LIDAR into the base of IoT devices, providing an expansive, ad hoc plane of sensing just above the surface on which devices rest. We can recognize and track a wide array of objects, including finger input and hand gestures. We can also track people and estimate which way they are facing. We evaluate the accuracy of these new capabilities and illustrate how they can be used to power novel and contextually-aware interactive experiences.

Supplementary Material

MP4 File (paper329.mp4)

Supplemental video

Download
153.46 MB

References

[1]

Gregory D. Abowd, Anind K. Dey, Peter J. Brown, Nigel Davies, Mark Smith, and Pete Steggles. 1999. Towards a Better Understanding of Context and Context-Awareness. In Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing (HUC '99), Hans-Werner Gellersen (Ed.). Springer-Verlag, London, UK, UK, 304--307.

Digital Library

[2]

Fadel Adib, Chen-Yu Hsu, Hongzi Mao, Dina Katabi, and Frédo Durand. 2015. Capturing the human figure through a wall. ACM Trans. Graph. 34, 6, Article 219 (October 2015), 13 pages.

Digital Library

[3]

Michelle Annett, Tovi Grossman, Daniel Wigdor, and George Fitzmaurice. 2011. Medusa: a proximity-aware multi-touch tabletop. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 337346.

Digital Library

[4]

Geovany Araujo Borges and Marie-José Aldon. Line extraction in 2D range images for mobile robotics. Journal of Intelligent & Robotic Systems, 40(3):267-- 297, 2004.

Digital Library

[5]

Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: multi"touch" interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). ACM, New York, NY, USA, 201--204.

Digital Library

[6]

Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. "Realtime multi-person 2d pose estimation us-ing part affinity fields." arXiv preprint arXiv:1611.08050 (2016).

[7]

Álvaro Cassinelli, Stéphane Perrin, and Masatoshi Ishikawa. 2005. Smart laser-scanner for 3D human-machine interface. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1138--1139.

Digital Library

[8]

Ke-Yu Chen, Kent Lyons, Sean White, and Shwetak Patel. 2013. uTrack: 3D input using two magnetic sensors. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). ACM, New York, NY, USA, 237--244.

Digital Library

[9]

Louis Columbus. "2017 Roundup Of Internet Of Things Forecasts". Forbes, Dec 10, 2017.

[10]

Andreas Ess and Konrad Schindler and Bastian Leibe and Luc Van Gool. 2009. Improved Multi-Person Tracking with Active Occlusion Handling. In Proceedings of IEEE ICRA '09.

[11]

Eibe Frank, Mark A. Hall, and Ian H. Witten. 2016. The WEKA Workbench. Online Appendix for "Data Mining: Practical Machine Learning Tools and Techniques", Morgan Kaufmann, Fourth Edition, 2016.

Digital Library

[12]

Dustin Freeman, Hrvoje Benko, Meredith Ringel Morris, and Daniel Wigdor. 2009. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 165--172.

Digital Library

[13]

Mehdi Golestanian and Christian Poellabauer. 2016. Indoor localization using multi-range beaconing: poster. In Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc '16). ACM, New York, NY, USA, 397--398.

Digital Library

[14]

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, nd Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems 27. 2672--2680.

Digital Library

[15]

Dan Gregor, Ondrej Prucha, Jakub Rocek, and Josef Kortan. 2017. Digital playgroundz. In ACM SIGGRAPH 2017 VR Village (SIGGRAPH '17). ACM, New York, NY, USA, Article 4, 2 pages.

Digital Library

[16]

Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian von Wilmsdorff, Reiner Wichert, and Arjan Kuijper. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 231--242.

Digital Library

[17]

Teng Han, Khalad Hasan, Keisuke Nakamura, Randy Gomez, and Pourang Irani. 2017. SoundCraft: Enabling Spatial Interactions on Smartwatches using Hand Generated Acoustics. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 579--591.

Digital Library

[18]

Chris Harrison and Scott E. Hudson. 2009. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 121--124.

Digital Library

[19]

Chris Harrison, Robert Xiao, and Scott Hudson. 2012. Acoustic barcodes: passive, durable and inexpensive notched identification tags. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 563568.

Digital Library

[20]

Chris Harrison. Appropriated Interaction Surfaces. IEEE Computer Magazine, June 2010, 43(6). IEEE, Washington, D.C. 86--89.

Digital Library

[21]

Andy Harter, Andy Hopper, Pete Steggles, Andy Ward, and Paul Webster. 1999. The anatomy of a context-aware application. In Proceedings of the 5th annual ACM/IEEE international conference on Mobile computing and networking (MobiCom '99). ACM, New York, NY, USA, 59--68.

Digital Library

[22]

Hiroshi Ishii, Craig Wisneski, Julian Orbanes, Ben Chun, and Joe Paradiso. 1999. PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. In Proceedings of the SIGCHI confer-ence on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 394--401.

Digital Library

[23]

Hideki Koike, Motoki Kobayashi. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Trans. on Computer-Human Inter., 8(4), 307--322.

Digital Library

[24]

Sven Kratz and Michael Rohs. 2009. HoverFlow: expanding the design space of around-device interaction. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 4, 8 pages.

Digital Library

[25]

Beth M. Lange, Mark A. Jones, and James L. Meyers. 1998. Insight lab: an immersive team environment linking paper, displays, and data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '98), Clare-Marie Karat, Arnold Lund, Joëlle Coutaz, and John Karat (Eds.). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 550--557.

Digital Library

[26]

Gierad Laput, Chouchang Yang, Robert Xiao, Alanson Sample, and Chris Harrison. 2015. EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 157--166.

Digital Library

[27]

Gierad Laput, Karan Ahuja, Mayank Goel, Chris Harrison. Ubicoustics: Plug-and-Play Acoustic Activity Recognition. 2018. In Proceedings of UIST '18.

Digital Library

[28]

Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: HighFidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 321--333.

Digital Library

[29]

Gierad Laput, Robert Xiao, Xiang 'Anthony' Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, New York, NY, USA, 389--394.

Digital Library

[30]

Gierad Laput, Walter S. Lasecki, Jason Wiese, Robert Xiao, Jeffrey P. Bigham, and Chris Harrison. 2015. Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1935--1944.

Digital Library

[31]

Eric Larson, Gabe Cohn, Sidhant Gupta, Xiaofeng Ren, Beverly Harrison, Dieter Fox, and Shwetak Patel. 2011. HeatWave: thermal imaging for surface user interaction. In Proceedings of the SIGCHI Conference on Human Fac-tors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2565--2574.

Digital Library

[32]

Walter S. Lasecki, Young Chol Song, Henry Kautz, and Jeffrey P. Bigham. 2013. Real-time crowd labeling for deployable activity recognition. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13). ACM, New York, NY, USA, 1203--1212.

Digital Library

[33]

Mathieu Le Goc, Stuart Taylor, Shahram Izadi, and Cem Keskin. 2014. A low-cost transparent electric field sensor for 3d interaction on mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3167--3170.

Digital Library

[34]

Eui-Jung Jung, Jae Hon Lee, Byung-Ju Yi, Jooyoung Park, Shin'ichi Yuta and Si-Tae Noh, "Development of a Laser-Range-Finder-Based Human Tracking and Control Algorithm for a Marathoner Service Robot," in IEEE/ASME Transactions on Mechatronics, vol. 19, no. 6, pp. 1963--1976, Dec. 2014.

[35]

Timothy Lee. Why experts believe cheaper, better lidar is right around the corner. Are Technica, January 1, 2018. Retrieved September 12, 2018. https://arstechnica.com/cars/2018/01/driving-aroundwithout-a-driver-lidar-technology-explained/

[36]

Hanchuan Li, Can Ye, and Alanson P. Sample. 2015. IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2555--2564.

Digital Library

[37]

Zhi Liu, Jie Zhang and L. Geng, "An Intelligent Building Occupancy Detection System Based on Sparse Auto-Encoder," 2017 IEEE Winter Applications of Computer Vision Workshops (WACVW), Santa Rosa, CA, 2017, pp. 17--22.

[38]

Takuya Maekawa, Yasue Kishino, Yasushi Sakurai, and Takayuki Suyama. 2013. Activity recognition with hand-worn magnetic sensors. Personal Ubiquitous Comput. 17, 6 (August 2013), 1085--1094.

Digital Library

[39]

Trinh Minh Tri Do, Kyriaki Kalimeri, Bruno Lepri, Fabio Pianesi, and Daniel Gatica-Perez. 2013. Inferring social activities with mobile sensor networks. In Proceedings of the 15th ACM on International conference on multimodal interaction (ICMI '13). ACM, New York, NY, USA, 405--412.

Digital Library

[40]

Jon Moeller and Andruid Kerne. 2012. ZeroTouch: an optical multitouch and free-air interaction architecture. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI '12). ACM, New York, NY, USA, 2165--2174.

Digital Library

[41]

Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. FingerIO: Using Active Sonar for Fine-Grained Finger Tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1515--1525.

Digital Library

[42]

Joseph Paradiso, Che King Leo, Nisha Checka and Kaiyuh Hsiao. Passive acoustic sensing for tracking knocks atop large interactive displays. In Proc. IEEE Sensors '02. 521--527.

[43]

Joseph Paradiso, Kaiyuh Hsiao, Joshua Strickon, Joshua Lifton and A. Adler. Sensor Systems for Interactive Surfaces. IBM Systems Journal, Volume 39, Nos. 3 & 4, October 2000, pp. 892--914.

Digital Library

[44]

Nissanka B. Priyantha, Anit Chakraborty, and Hari Balakrishnan. 2000. The Cricket location-support system. In Proceedings of the 6th annual international conference on Mobile computing and networking (MobiCom '00). ACM, New York, NY, USA, 32--43.

Digital Library

[45]

Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home gesture recognition using wireless signals. In Proceedings of the 19th annu-al international conference on Mobile computing & networking (MobiCom '13). ACM, New York, NY, USA, 27--38.

Digital Library

[46]

Tauhidur Rahman, Alexander T. Adams, Ruth Vinisha Ravichandran, Mi Zhang, Shwetak N. Patel, Julie A. Kientz, and Tanzeem Choudhury. 2015. DoppleSleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 39--50.

Digital Library

[47]

Lenin Ravindranath, Venkata N. Padmanabhan, and Piyush Agrawal. 2008. SixthSense: RFID-based Enterprise Intelligence. In Proceedings of the 6th international conference on Mobile systems, applications, and services (MobiSys '08). ACM, New York, NY, USA, 253--266.

Digital Library

[48]

Jun Rekimoto, and Nobuyuki Matsushita. "Perceptual surfaces: Towards a human and object sensitive interac-tive display." In Workshop on Perceptual User Interfaces (PUI'97), pp. 30--32. 1997.

[49]

Claire Rowland, Elizabeth Goodman, Martin Charlier, Ann Light, and Alfred Lui. 2015. Designing Connected Products: UX for the Consumer Internet of Things. O'Reilly Media, Newton, MA.

Digital Library

[50]

Slamtec RPLIDAR A2. https://www.slamtec.com/en/Lidar/A2Spec Last retrieved September 19, 2018

[51]

Bill Schilit, Norman Adams, and Roy Want. Context-Aware Computing Applications. In Proceedings of the Workshop on Mobile Computing Systems and Applications, Santa Cruz, CA, December 1994. Pages 85--90. IEEE Computer Society.

Digital Library

[52]

Dan Smith, Ling Ma, and Nick Ryan. 2006. Acoustic environment as an indicator of social and physical context. Personal Ubiquitous Comput. 10, 4 (March 2006), 241--254.

Digital Library

[53]

Timothy J. Smith, Stefan Saroiu, and Alec Wolman. 2009. BlueMonarch: a system for evaluating bluetooth applications in the wild. In Proceedings of the 7th international conference on Mobile systems, applications, and services (MobiSys '09). ACM, New York, NY, USA, 41--54.

Digital Library

[54]

T. Steel, D. Kuiper and R. Z. Wenkstern, "Context-Aware Virtual Agents in Open Environments," 2010 Sixth International Conference on Autonomic and Autonomous Systems, Cancun, 2010, pp. 90--96.

Digital Library

[55]

STMicroelectronics. World's Smallest Time-of-Flight (ToF) Sensor. https://www.st.com/en/imaging-and-photonics-solutions/vl53l0x.html. Last retrieved September 19, 2018

[56]

Joshua Strickon and Joseph Paradiso. 1998. Tracking hands above large interactive surfaces with a low-cost scanning laser rangefinder. In CHI 98 Conference Summary on Human Factors in Computing Systems (CHI '98). ACM, New York, NY, USA, 231--232.

Digital Library

[57]

M. Vázquez, A. Steinfeld and S. E. Hudson, "Parallel detection of conversational groups of free-standing people and tracking of their lower-body orientation," 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, 2015, pp. 30103017.

[58]

Edward J. Wang, Tien-Jui Lee, Alex Mariakakis, Mayank Goel, Sidhant Gupta, and Shwetak N. Patel. 2015. MagnifiSense: inferring device interaction using wrist-worn passive magneto-inductive sensors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 15--26.

Digital Library

[59]

Jue Wang, Deepak Vasisht, and Dina Katabi. 2014. RF-IDraw: virtual touch screen in the air using RF signals. SIGCOMM Comput. Commun. Rev. 44, 4 (August 2014), 235--246.

Digital Library

[60]

Roy Want, Andy Hopper, Veronica Falcão, and Jonathan Gibbons. 1992. The active badge location system. ACM Trans. Inf. Syst. 10, 1 (January 1992), 91--102.

Digital Library

[61]

Jamie A. Ward, Paul Lukowicz, Gerhard Troster, and Thad E. Starner. 2006. Activity recognition of assembly tasks using body-worn microphones and accelerometers. In IEEE transactions on pattern analysis and machine intelligence, 28, no. 10: 1553--1567.

Digital Library

[62]

Kathryn Whitenton. "Voice First: The Future of Interaction?" Nielsen Norman Group, November 12, 2017.

[63]

Daniel Wigdor, Hrvoje Benko, John Pella, Jarrod Lombardo, and Sarah Williams. 2011. Rock & rails: extending multi-touch interactions with shape gestures to enable precise spatial manipulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1581--1590.

Digital Library

[64]

Andrew Wilson and Hrvoje Benko. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface soft-ware and technology (UIST '10). ACM, New York, NY, USA, 273--282.

Digital Library

[65]

Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proceedings of the 20th annual ACM symposium on User interface software and technology (UIST '07). ACM, New York, NY, USA, 159--168.

Digital Library

[66]

Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: rapid and easy creation of ad-hoc inter-active applications on everyday surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Com-puting Systems (CHI '13). ACM, New York, NY, USA, 879--888.

Digital Library

[67]

Robert Xiao, Gierad Laput, and Chris Harrison. 2014. Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 193196.

Digital Library

[68]

Robert Xiao, Greg Lew, James Marsanico, Divya Hariharan, Scott E. Hudson and Chris Harrison. Toffee: enabling ad hoc, around-device interaction with acoustic time-of-arrival correlation. In Proc. MobileHCI '14. 67--76.

Digital Library

[69]

Robert Xiao, Scott Hudson, and Chris Harrison. 2016. DIRECT: Making Touch Tracking on Ordinary Surfaces Practical with Hybrid Depth-Infrared Sensing. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS '16). ACM, New York, NY, USA, 85--94.

Digital Library

[70]

Robert Xiao, Teng Cao, Ning Guo, Jun Zhuo, Yang Zhang, and Chris Harrison. 2018. LumiWatch: On-Arm Projected Graphics and Touch Input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 95, 11 pages.

Digital Library

[71]

YDLIDAR X4 360°. https://www.robotshop.com/en/ydlidar-x4--360laser-scanner.html

[72]

Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David HarrisBirtill, and Aaron Quigley. 2016. RadarCat: Radar Categorization for Input & Interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 833--841.

Digital Library

[73]

Xiangyu Yue, Bichen Wu, Sanjit A. Seshia, Kurt Keutzer, and Alberto L. Sangiovanni-Vincentelli. 2018. A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving. In Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval (ICMR '18). ACM, New York, NY, USA, 458--464.

Digital Library

[74]

Zulkarnain Zainudin, Sarath Kodagoda and Gamini Dissanayake. "Torso Detection and Tracking using a 2 D Laser Range Finder." (2010).Proceedings of the 2010 Australasian Conference on Robotics and Automation, ACRA 2010.

[75]

Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: LowCost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1--14.

Digital Library

[76]

Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 273, 15 pages.

Digital Library

[77]

Junhan Zhou, Yang Zhang, Gierad Laput, and Chris Harrison. 2016. AuraSense: Enabling Expressive Around-Smartwatch Interactions with Electric Field Sensing. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 81--86.

Digital Library

Cited By

Wattanaparinton RKitada KTakemura K(2024)RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal ReflectionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676428(1-10)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676428
Su YZhang TFeng JShi YYang XWu T(2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642356
Patidar PGoel MAgarwal Y(2023)VAXProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109077:3(1-24)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610907
Show More Cited By

Index Terms

SurfaceSight: A New Spin on Touch, User, and Object Sensing for IoT Experiences
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Wall++: Room-Scale Interactive and Context-Aware Sensing
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Human environments are typified by walls, homes, offices, schools, museums, hospitals and pretty much every indoor context one can imagine has walls. In many cases, they make up a majority of readily accessible indoor surface area, and yet they are ...
Challenges to ensuring human safety throughout the life-cycle of Smart Environments
SafeThings'17: Proceedings of the 1st ACM Workshop on the Internet of Safe Things

The homes, offices, and vehicles of tomorrow will be embedded with numerous "Smart Things," networked with each other and with the Internet. Many of these Things are embedded in the physical infrastructure, and like the infrastructure they are designed ...
Smart Home Agents and Devices of Today and Tomorrow: Surveying Use and Desires
HAI '21: Proceedings of the 9th International Conference on Human-Agent Interaction

How are people using current smart home technologies, and how do they conceptualize future ones that are more interconnected and more capable than those available today? We deployed an online survey study to 150 participants to investigate use of and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
1,113
Total Downloads

Downloads (Last 12 months)60
Downloads (Last 6 weeks)8

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wattanaparinton RKitada KTakemura K(2024)RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal ReflectionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676428(1-10)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676428
Su YZhang TFeng JShi YYang XWu T(2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642356
Patidar PGoel MAgarwal Y(2023)VAXProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109077:3(1-24)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610907
Chen TLi TYang XZhu K(2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569478
Xu VNakagaki K(2023)Xs: Interactive Scissor Mechanisms as Portable and Customizable Shape-Changing InterfacesProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572737(1-10)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572737
Yeo HWu EKim DLee JKim HOh STakagi LWoo WKoike HQuigley A(2023)OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional CameraProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580747(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580747
He FHu XShi JQian XWang TRamani K(2023)Ubi Edge: Authoring Edge-Based Opportunistic Tangible User Interfaces in Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580704(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580704
Kim MLee DKim H(2023)Surface-Assisted In-Air Gesture Recognition2023 14th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC58733.2023.10392389(666-668)Online publication date: 11-Oct-2023
https://doi.org/10.1109/ICTC58733.2023.10392389
Fan NXiao R(2022)Reducing the Latency of Touch Tracking on Ad-hoc SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35677306:ISS(489-499)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567730
Pei SChari PWang XYang XKadambi AZhang Y(2022)ForceSight: Non-Contact Force Sensing with Laser Speckle ImagingProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545622(1-11)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545622
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents