research-article

AirTouch: 3D-printed Touch-Sensitive Objects Using Pneumatic Sensing

Authors:

Carlos E. Tejada,

Sebastian Boring,

Daniel AshbrookAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 10

https://doi.org/10.1145/3313831.3376136

Published: 23 April 2020 Publication History

Abstract

3D printing technology can be used to rapidly prototype the look and feel of 3D objects. However, the objects produced are passive. There has been increasing interest in making these objects interactive, yet they often require assembling components or complex calibration. In this paper, we contribute AirTouch, a technique that enables designers to fabricate touch-sensitive objects with minimal assembly and calibration using pneumatic sensing. AirTouch-enabled objects are 3D printed as a single structure using a consumer-level 3D printer. AirTouch uses pre-trained machine learning models to identify interactions with fabricated objects, meaning that there is no calibration required once the object has completed printing. We evaluate our technique using fabricated objects with various geometries and touch sensitive locations, obtaining accuracies of at least 90% with 12 interactive locations.

Supplementary Material

MP4 File (paper009vf.mp4)

Supplemental video

Download
68.40 MB

MP4 File (paper009pv.mp4)

Preview video

Download
12.83 MB

References

[1]

Rafael Ballagas, Sarthak Ghosh, and James A Landay. 2018. The Design Space of 3D Printable Interactivity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 61--21.

Digital Library

[2]

Daniel Bernoulli. 1738. Hydrodynamica: sive de viribus et motibus fluidorum commentarii. Johannis Reinholdi Dulseckeri.

[3]

Glenn O Brown. 2002. The History of the Darcy-Weisbach Equation for Pipe Flow Resistance. In Environmental and Water Resources History Sessions at ASCE Civil Engineering Conference and Exposition 2002. American Society of Civil Engineers, Washington, D.C., United States.

[4]

Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1C filter: a simple speed-based low-pass filter for noisy input in interactive systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York, New York, USA, 2527.

Digital Library

[5]

Kristian Gohlke, Eva Hornecker, and Wolfgang Sattler. 2016. Pneumatibles: Exploring Soft Robotic Actuators for the Design of User Interfaces with Pneumotactile Feedback. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, New York, USA, 308--315.

Digital Library

[6]

Timo Götzelmann and Christopher Althaus. 2016. TouchSurfaceModels: Capacitive Sensing Objects through 3D Printers. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, New York, USA, 22--8.

Digital Library

[7]

Chris Harrison and Scott E Hudson. 2009. Providing dynamically changeable physical buttons on a visual display. In Proceedings of the 2009 CHI Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, 299--308.

Digital Library

[8]

Liang He, Gierad Laput, Eric Brockmeyer, and Jon E Froehlich. 2017. SqueezaPulse: Adding Interactive Input to Fabricated Objects Using Corrugated Tubes and Air Pulses. In International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, New York, USA, 341--350.

Digital Library

[9]

Jonathan Hook, Peter Wright, Thomas Nappey, Steve Hodges, and Patrick Olivier. 2014. Making 3D printed objects interactive using wireless accelerometers. In CHI '14 Extended Abstracts on Human Factors in Computing Systems. ACM, 1435--1440.

Digital Library

[10]

Charles Hudin, Sabrina Panëels, and Steven Strachan. 2016. INTACT: Instant Interaction with 3D Printed Objects. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, New York, USA, 2719--2725.

[11]

Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, 3227--3236.

[12]

Shohei Katakura and Keita Watanabe. 2018. ProtoHole: Prototyping Interactive 3D Printed Objects Using Holes and Acoustic Sensing. In CHI '18: Proceedings of the 36th Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, LBW112--6.

Digital Library

[13]

Seoktae Kim, Hyunjung Kim, Boram Lee, Tek-Jin Nam, and Woohun Lee. 2008. Inflatable mouse: volume-adjustable mouse with air-pressure-sensitive input and haptic feedback. In Proceeding of the twenty-sixth annual CHI conference extended abstracts. ACM, New York, New York, USA, 211--224.

[14]

Gierad Laput, Eric Brockmeyer, Scott E Hudson, and Chris Harrison. 2015. Acoustruments: Passive, Acoustically-Driven, Interactive Controls for Handheld Devices. In CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, 2161--2170.

[15]

Dingzeyu Li, David I W Levin, Wojciech Matusik, and Changxi Zheng. 2016. Acoustic voxels: computational optimization of modular acoustic filters. ACM Transactions on Graphics (TOG) 35, 4 (July 2016), 88--12.

Digital Library

[16]

Roderick Murray-Smith, John Williamson, Stephen Hughes, and Torben Quaade. 2008. Stane: synthesized surfaces for tactile input. In CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, New York, USA, 1299.

Digital Library

[17]

Kosuke Nakajima, Yuichi Itoh, Yusuke Hayashi, Kazuaki Ikeda, Kazuyuki Fujita, and Takao Onoye. 2013. Emoballoon. In Advances in Computer Entertainment. Springer, Cham, Cham, 182--197.

[18]

Ryuma Niiyama, Xu Sun, Cynthia Sung, Byoungkwon An, Daniela Rus, and Sangbae Kim. 2015a. Pouch Motors. Soft Robotics 2, 2 (June 2015), 59--70.

[19]

Ryuma Niiyama, Xu Sun, Lining Yao, Hiroshi Ishii, Daniela Rus, and Sangbae Kim. 2015b. Sticky Actuator. In Proceedings of the 8th International Conference on Tangible, Embedded, and Embodied Interaction. ACM Press, New York, New York, USA, 77--84.

[20]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, New York, New York, USA, 31--40.

Digital Library

[21]

Jifei Ou, Mélina Skouras, Nikolaos Vlavianos, Felix Heibeck, Chin-Yi Cheng, Jannik Peters, and Hiroshi Ishii. 2016. aeroMorph - Heat-sealing Inflatable Shape-change Materials for Interaction Design. In UIST '16: Proceedings of the 29th annual ACM symposium on User interface software and technology. ACM, New York, New York, USA, 121--132.

Digital Library

[22]

Raf Ramakers, Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2016. RetroFab: A Design Tool for Retrofitting Physical Interfaces using Actuators, Sensors and 3D Printing. In CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, 409--419.

Digital Library

[23]

Michel Rieutord. 2015. Fluid Dynamics. Springer International Publishing, Cham.

[24]

Jan Rod, David Collins, Daniel Wessolek, Thavishi Ilandara, Ye Ai, Hyowon Lee, and Suranga Nanayakkara. 2017. UTAP - Unique Topographies for Acoustic Propagation: Designing Algorithmic Waveguides for Sensing in Interactive Malleable Interfaces. In International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, New York, USA, 141--152.

[25]

Harpreet Sareen, Udayan Umapathi, Patrick Shin, Yasuaki Kakehi, Jifei Ou, Hiroshi Ishii, and Pattie Maes. 2017. Printflatables: Printing Human-Scale, Functional and Dynamic Inflatable Objects. ACM, New York, New York, USA.

Digital Library

[26]

Valkyrie Savage, Colin Chang, and Björn Hartmann. 2013. Sauron: embedded single-camera sensing of printed physical user interfaces. ACM, New York, New York, USA.

[27]

Valkyrie Savage, Sean Follmer, Jingyi Li, and Björn Hartmann. 2015a. Makers' Marks: Physical Markup for Designing and Fabricating Functional Objects. In UIST '15: Proceedings of the 28th annual ACM symposium on User interface software and technology. ACM Press, New York, New York, USA, 103--108.

Digital Library

[28]

Valkyrie Savage, Andrew Head, Björn Hartmann, Dan B Goldman, Gautham Mysore, and Wilmot Li. 2015b. Lamello: Passive Acoustic Sensing for Tangible Input Components. In CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM Press, New York, New York, USA, 1277--1280.

[29]

Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann. 2014. A series of tubes: adding interactivity to 3D prints using internal pipes. In UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology. New York, New York, USA, 3--12.

Digital Library

[30]

Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In UIST '15: Proceedings of the 28th annual ACM symposium on User interface software and technology. ACM Press, New York, New York, USA, 253--258.

Digital Library

[31]

Martin Schmitz, Martin Stitz, Florian Müller, Markus Funk, and Max Mühlhäuser. 2019. ./trilaterate: A Fabrication Pipeline to Design and 3D Print Hover-, Touch-, and Force-Sensitive Objects. In CHI '19: Proceedings of the 37th Annual SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, 454--13.

Digital Library

[32]

Lei Shi, Ross McLachlan, Yuhang Zhao, and Shiri Azenkot. 2016a. Magic Touch: Interacting with 3D Printed Graphics. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, New York, New York, USA, 329--330.

Digital Library

[33]

Lei Shi, Idan Zelzer, Catherine Feng, and Shiri Azenkot. 2016b. Tickers and Talker: An Accessible Labeling Toolkit for 3D Printed Models. In CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, New York, USA, 4896--4907.

Digital Library

[34]

Ronit Slyper and Jessica Hodgins. 2012. Prototyping robot appearance, movement, and interactions using flexible 3D printing and air pressure sensors. In 2012 RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 6--11.

[35]

Carlos Tejada, Osamu Fujimoto, Zhiyuan Li, and Daniel Ashbrook. 2018. Blowhole: Blowing-Activated Tags for Interactive 3D-Printed Models. In Proceedings of the 44th Graphics Interface Conference GI Proceedings of the nd Graphics Interface Conference. 122--128.

[36]

Marynel Vázquez, Eric Brockmeyer, Ruta Desai, Chris Harrison, and Scott E Hudson. 2015. 3D Printing Pneumatic Device Controls with Variable Activation Force Capabilities. In CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM Press, New York, New York, USA, 1295--1304.

Digital Library

[37]

Karl Willis, Eric Brockmeyer, Scott E Hudson, and Ivan Poupyrev. 2012. Printed Optics: 3D Printing of Embedded Optical Elements for Interactive Devices. In UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM Press, New York, New York, USA, 589--598.

Digital Library

[38]

Junichi Yamaoka, Ryuma Niiyama, and Yasuaki Kakehi. 2017. BlowFab: Rapid Prototyping for Rigid and Reusable Objects using Inflation of Laser-cut Surfaces. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, New York, USA, 461--469.

Digital Library

[39]

Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: pneumatically actuated soft composite materials for shape changing interfaces. In UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, New York, New York, USA, 13--22.

Digital Library

Cited By

Buch NTejada CAshbrook DSavage V(2024)LaCir: A multilayered laser-cuttable material to co-fabricate circuitry and structural components.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642888(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642888
Pardomuan JMiyafuji STakahashi NKoike H(2024)VabricBeads : Variable Stiffness Structured Fabric using Artificial Muscle in Woven BeadsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642401(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642401
Lu QYu TYi SDing YMi HYao L(2023)Sustainflatable: Harvesting, Storing and Utilizing Ambient Energy for Pneumatic Morphing InterfacesProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606721(1-20)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606721
Show More Cited By

Index Terms

AirTouch: 3D-printed Touch-Sensitive Objects Using Pneumatic Sensing
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Tactile and hand-based interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

Exploring 3D Printed Interaction
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

3D printing is widely used to physically prototype the look and feel of 3D objects. However, interaction possibilities of these prototypes are often limited to mechanical parts or post-assembled electronics. Moreover, fabricating interactive 3D printed ...
Fundamental characteristics of printed gelatin utilizing micro 3D printer

Gelatin is useful for biofabrication, because it can be used for cell scaffolds and it has unique properties. Therefore, we attempted to fabricate biodevices of gelatin utilizing micro 3D printer which is able to print with high precision. However, it ...
3D printed PEGDA microstructures for gelatin scaffold integration and neuron differentiation

Three dimensional (3D) printing techniques can be used for scaffold fabrication but the most of them are limited by resolution and material choice. To bypass these limitations, we developed an approach by combining conventional 3D printing and freeze-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
1,893
Total Downloads

Downloads (Last 12 months)127
Downloads (Last 6 weeks)11

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Buch NTejada CAshbrook DSavage V(2024)LaCir: A multilayered laser-cuttable material to co-fabricate circuitry and structural components.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642888(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642888
Pardomuan JMiyafuji STakahashi NKoike H(2024)VabricBeads : Variable Stiffness Structured Fabric using Artificial Muscle in Woven BeadsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642401(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642401
Lu QYu TYi SDing YMi HYao L(2023)Sustainflatable: Harvesting, Storing and Utilizing Ambient Energy for Pneumatic Morphing InterfacesProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606721(1-20)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606721
Lu QYi SYu TDing YMi HYao L(2023)Demonstrating Sustainflatable: Harvesting, Storing and Utilizing Ambient Energy for Pneumatic Morphing InterfacesAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3615765(1-6)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3615765
Shtarbanov ABrocker ACabrera AHu YMüller HMazursky A(2023)Soft Robotics and Programmable Materials for Human-Computer InteractionCompanion Publication of the 2023 ACM Designing Interactive Systems Conference10.1145/3563703.3591460(110-113)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563703.3591460
Lu QXu HGuo YWang JYao L(2023)Fluidic Computation Kit: Towards Electronic-free Shape-changing InterfacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580783(1-21)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580783
Yu TXu WXu HLiu GLiu CWang GMi H(2023)Thermotion: Design and Fabrication of Thermofluidic Composites for Animation Effects on Object SurfacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580743(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580743
Choi HCutkosky MStanley A(2023)Integrated Pneumatic Sensing and Actuation for Soft Haptic DevicesIEEE Robotics and Automation Letters10.1109/LRA.2023.33204948:11(7591-7598)Online publication date: Nov-2023
https://doi.org/10.1109/LRA.2023.3320494
Xue TLu LSharf ATian LLi HSchulz ALipton JPeek N(2022)DancingPottery: Posture-Driven Pottery Generative Design and FabricationProceedings of the 7th Annual ACM Symposium on Computational Fabrication10.1145/3559400.3562002(1-11)Online publication date: 26-Oct-2022
https://dl.acm.org/doi/10.1145/3559400.3562002
Cheng T(2022)Environmental physical intelligence: Seamlessly deploying sensors and actuators to our everyday lifeAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558525(1-5)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558525
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents