survey

Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research

Authors:

Miriam Sturdee,

Jason AlexanderAuthors Info & Claims

ACM Computing Surveys (CSUR), Volume 51, Issue 1

Article No.: 2, Pages 1 - 32

https://doi.org/10.1145/3143559

Published: 04 January 2018 Publication History

Abstract

Shape-changing interfaces are physically tangible, interactive devices, surfaces, or spaces that allow for rich, organic, and novel experiences with computational devices. Over the last 15 years, research has produced functional prototypes over many use applications; reviews have identified themes and possible future directions but have not yet looked at possible design or application-based research. Here, we gather this information together to provide a reference for designers and researchers wishing to build upon existing prototyping work, using synthesis and discussion of existing shape-changing interface reviews and comprehensive analysis and classification of 84 shape-changing interfaces. Eight categories of prototype are identified alongside recommendations for the field.

References

[1]

Teemu T. Ahmaniemi, Johan Kildal, and Merja Haveri. 2014. What is a device bend gesture really good for? In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI’14). ACM, 3503--3512.

Digital Library

[2]

Jason Alexander, Andrés Lucero, and Sriram Subramanian. 2012. Tilt displays: Designing display surfaces with multi-axis tilting and actuation. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MOBILE HCI’12). ACM, 161--170.

Digital Library

[3]

Tobias Alrøe, Jonas Grann, Erik Grönvall, Marianne Graves Petersen, and Jesper L. Rasmussen. 2012. Aerial tunes: Exploring interaction qualities of mid-air displays. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordChi’12). ACM, 514--523.

[4]

Mahoro Anabuki and Hiroshi Ishii. 2007. AR-Jig: A handheld tangible user interface for modification of 3D digital form via 2D physical curve. In 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07). IEEE, 55--66.

Digital Library

[5]

Liam Bannon. 2011. Reimagining HCI: Toward a more human-centered perspective. Interactions 18, 4, 50--57.

Digital Library

[6]

Olivier Bau, Uros Petrevski, and Wendy Mackay. 2009. BubbleWrap: A textile-based electromagnetic haptic display. In CHI’09 Extended Abstracts on Human Factors in Computing Systems. ACM, 3607--3612.

Digital Library

[7]

Tim Campbell, Cesar Torres, and Eric Paulos. 2015. Fl. UIs: Liquid-mediated vision based touch surfaces. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’15). ACM, 85--88.

Digital Library

[8]

Bernard Cheng, Antonio Gomes, Paul Strohmeier, and Roel Vertegaal. 2014. Mood fern: Exploring shape transformations in reactive environments. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (ACE’14). ACM, 60.

Digital Library

[9]

Marcelo Coelho and Pattie Maes. 2008. Sprout I/O: A texturally rich interface. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI’08). ACM, 221--222.

Digital Library

[10]

Marcelo Coelho and Pattie Maes. 2009. Shutters: A permeable surface for environmental control and communication. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI’09). ACM, 13--18.

Digital Library

[11]

Marcelo Coelho and Jamie Zigelbaum. 2011. Shape-changing interfaces. Personal and Ubiquitous Computing 15, 2, 161--173.

Digital Library

[12]

Aubrey Colter, Patlapa Davivongsa, Donald Derek Haddad, Halla Moore, Brian Tice, and Hiroshi Ishii. 2016. SoundFORMS: Manipulating sound through touch. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2425--2430.

Digital Library

[13]

Dhairya Dand and Robert Hemsley. 2013. Obake: Interactions on a 2.5 D elastic display. In Proceedings of the Adjunct Publication of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST’13). ACM, 109--110.

Digital Library

[14]

Aluna Everitt and Jason Alexander. 2017. PolySurface: A design approach for rapid prototyping of shape-changing displays using semi-solid surfaces. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 1283--1294.

Digital Library

[15]

Aluna Everitt, Faisal Taher, and Jason Alexander. 2016. ShapeCanvas: An exploration of shape-changing content generation by members of the public. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2778--2782.

Digital Library

[16]

Paul Fishwick. 2003. Nurturing next-generation computer scientists. Computer 36, 12, 132--134.

Digital Library

[17]

Sean Follmer, Micah Johnson, Edward Adelson, and Hiroshi Ishii. 2011. deForm: An interactive malleable surface for capturing 2.5 D arbitrary objects, tools and touch. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST’11). ACM, 527--536.

Digital Library

[18]

Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming user interfaces: Programmable particle stiffness and sensing for malleable and shape-changing devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST’12). ACM, 519--528.

Digital Library

[19]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: Dynamic physical affordances and constraints through shape and object actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST’13). ACM, 417--426.

Digital Library

[20]

Ingmar S. Franke, Mathias Müller, Thomas Gründer, and Rainer Groh. 2014. FlexiWall: Interaction in-between 2D and 3D interfaces. In HCI International 2014-Posters Extended Abstracts. Springer, 415--420.

[21]

David T. Gallant, Andrew G. Seniuk, and Roel Vertegaal. 2008. Towards more paper-like input: Flexible input devices for foldable interaction styles. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST’08). ACM, 283--286.

Digital Library

[22]

Audrey Girouard, Aneesh Tarun, and Roel Vertegaal. 2012. DisplayStacks: Interaction techniques for stacks of flexible thin-film displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). ACM, 2431--2440.

Digital Library

[23]

Antonio Gomes, Andrea Nesbitt, and Roel Vertegaal. 2013. MorePhone: A study of actuated shape deformations for flexible thin-film smartphone notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, 583--592.

Digital Library

[24]

Antonio Gomes, Lahiru Priyadarshana, Juan Pablo Carrascal, and Roel Vertegaal. 2016. WhammyPhone: Exploring tangible audio manipulation using bend input on a flexible smartphone. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 159--161.

Digital Library

[25]

Antonio Gomes and Roel Vertegaal. 2015. PaperFold: Evaluating shape changes for viewport transformations in foldable thin-film display devices. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’15). ACM, 153--160.

Digital Library

[26]

Mark Goulthorpe, Mark Burry, and Grant Dunlop. 2001. Aegis hyposurface: The bordering of university and practice. In Proceedings of the 21st Association for Computer Aided Design in Architecture (ACADIA’01). 344--349.

[27]

Wenjun Guo, Sang-Ung Yi, Minkyu Choi, Seungha Yoo, and Kyungwon Lee. 2013. Garden agua: Three-dimensional tangible display enabled by arranged water jet. In SIGGRAPH Asia 2013 Emerging Technologies. ACM, 9.

Digital Library

[28]

John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards rapid prototyping with shape-changing displays for designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, 19--28.

Digital Library

[29]

Chris Harrison and Scott E. Hudson. 2009. Providing dynamically changeable physical buttons on a visual display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, 299--308.

Digital Library

[30]

Sunao Hashimoto, Ryohei Suzuki, Youichi Kamiyama, Masahiko Inami, and Takeo Igarashi. 2013. LightCloth: Senseable illuminating optical fiber cloth for creating interactive surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, 603--606.

Digital Library

[31]

Isak Herman, Leonardo Impett, Patrick K. A. Wollner, and Alan F. Blackwell. 2015. Augmenting bioacoustic cognition with tangible user interfaces. In Foundations of Augmented Cognition. Springer, 437--448.

[32]

David Holman, Jesse Burstyn, Ryan Brotman, Audrey Younkin, and Roel Vertegaal. 2013. Flexkit: A rapid prototyping platform for flexible displays. In Proceedings of the Adjunct Publication of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST’13). ACM, 17--18.

Digital Library

[33]

David Holman and Roel Vertegaal. 2008. Organic user interfaces: Designing computers in any way, shape, or form. Communications of the ACM 51, 6, 48--55.

Digital Library

[34]

David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. Paper windows: Interaction techniques for digital paper. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’05). ACM, 591--599.

Digital Library

[35]

Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: Beyond tangible bits, toward transformable materials. Interactions 19, 1, 38--51.

Digital Library

[36]

Hiroshi Ishii, Carlo Ratti, Ben Piper, Yao Wang, Assaf Biderman, and Eran Ben-Joseph. 2004. Bringing clay and sand into digital design continuous tangible user interfaces. BT Technology Journal 22, 4, 287--299.

Digital Library

[37]

Hiroo Iwata, Hiroaki Yano, and Naoto Ono. 2005. Volflex. In SIGGRAPH’05 Emerging Technologies. ACM, 31.

Digital Library

[38]

Yvonne Jansen and Pierre Dragicevic. 2013. An interaction model for visualizations beyond the desktop. IEEE Transactions on Visualization and Computer Graphics 19, 12, 2396--2405.

Digital Library

[39]

Yvonne Jansen, Thorsten Karrer, and Jan Borchers. 2011. MudPad: Tactile feedback for touch surfaces. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. ACM, 323--328.

Digital Library

[40]

Cindy Hsin-Liu Kao, Ermal Dreshaj, Judith Amores, Sang-won Leigh, Xavier Benavides, Pattie Maes, Ken Perlin, and Hiroshi Ishii. 2015. clayodor: Retrieving scents through the manipulation of malleable material. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’15). ACM, 697--702.

[41]

Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. 2012. FoldMe: Interacting with double-sided foldable displays. In Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction (TEI’12). ACM, 33--40.

Digital Library

[42]

Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2011. Xpaaand: Interaction techniques for rollable displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, 2729--2732.

Digital Library

[43]

Asif Khan. 2014. Megafaces. Retrieved December 5, 2017 from http://www.asif-khan.com/project/sochi-winter-olympics-2014/.

[44]

Johan Kildal, Susanna Paasovaara, and Viljakaisa Aaltonen. 2012. Kinetic device: Designing interactions with a deformable mobile interface. In CHI’12 Extended Abstracts on Human Factors in Computing Systems. ACM, 1871--1876.

Digital Library

[45]

Hyunjung Kim and Woohun Lee. 2011. Kinetic tiles. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, 1279--1282.

Digital Library

[46]

Konstantin Klamka and Raimund Dachselt. 2017. IllumiPaper: Illuminated interactive paper. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5605--5618.

Digital Library

[47]

Sachiko Kodama. 2008. Dynamic ferrofluid sculpture: Organic shape-changing art forms. Communications of the ACM 51, 6, 79--81.

Digital Library

[48]

Jeffrey Tzu Kwan Valino Koh, Kasun Karunanayaka, and Ryohei Nakatsu. 2013. Linetic: Technical, usability and aesthetic implications of a ferrofluid-based organic user interface. In Human-Computer Interaction (INTERACT’13). Springer, 180--195.

[49]

Jeffrey Tzu Kwan Valino Koh, Kasun Karunanayaka, Jose Sepulveda, Mili John Tharakan, Manoj Krishnan, and Adrian David Cheok. 2011. Liquid interface: A malleable, transient, direct-touch interface. Computers in Entertainment 9, 2, 7.

[50]

Matthijs Kwak, Kasper Hornbæk, Panos Markopoulos, and Miguel Bruns Alonso. 2014. The design space of shape-changing interfaces: A repertory grid study. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS’14). ACM, 181--190.

Digital Library

[51]

Ki-Uk Kyung, Jeong Mook Lim, Yo-An Lim, Suntak Park, Seung Koo Park, Inwook Hwang, Seungmoon Choi, Jongman Seo, Sang-Youn Kim, Tae-Heon Yang, and others. 2011. TAXEL: Initial progress toward self-morphing visio-haptic interface. In IEEE World Haptics Conference (WHC’11). IEEE, 37--42.

[52]

Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: Understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, 1303--1312.

Digital Library

[53]

Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: Shape capture and display for embodied, computer-mediated remote collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, 461--470.

Digital Library

[54]

Daniel Leithinger, Sean Follmer, Alex Olwal, Samuel Luescher, Akimitsu Hogge, Jinha Lee, and Hiroshi Ishii. 2013. Sublimate: State-changing virtual and physical rendering to augment interaction with shape displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, 1441--1450.

Digital Library

[55]

Daniel Leithinger, David Lakatos, Anthony DeVincenzi, Matthew Blackshaw, and Hiroshi Ishii. 2011. Direct and gestural interaction with relief: A 2.5 D shape display. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST’11). ACM, 541--548.

Digital Library

[56]

Julian Lepinski and Roel Vertegaal. 2011. Cloth displays: Interacting with drapable textile screens. In Proceedings of the 5th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’11). ACM, 285--288.

Digital Library

[57]

David Lindlbauer, Jens Emil Grønbæk, Morten Birk, Kim Halskov, Marc Alexa, and Jörg Müller. 2016. Combining shape-changing interfaces and spatial augmented reality enables extended object appearance. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 791--802.

Digital Library

[58]

Julia Lo and Audrey Girouard. 2014. Fabricating bendy: Design and development of deformable prototypes. IEEE Pervasive Computing 13, 3, 40--46.

[59]

Yukiko Makino and Yasuaki Kakehi. 2011. Metamorphic light: A tabletop tangible interface using deformation of plain paper. In ACM SIGGRAPH 2011 Posters. ACM, 48.

Digital Library

[60]

Viktor Miruchna, Robert Walter, David Lindlbauer, Maren Lehmann, Regine Von Klitzing, and Jörg Müller. 2015. GelTouch: Localized tactile feedback through thin, programmable gel. In Proceedings of the 28th Annual ACM Symposium on User Interface Software 8 Technology. ACM, 3--10.

Digital Library

[61]

Randall Munroe. 2012. XKCD. Retrieved December 5, 2017 from https://xkcd.com/924/.

[62]

Ken Nakagaki, Artem Dementyev, Sean Follmer, Joseph A. Paradiso, and Hiroshi Ishii. 2016. ChainFORM: A linear integrated modular hardware system for shape changing interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 87--96.

Digital Library

[63]

Kosuke Nakajima, Yuichi Itoh, Yusuke Hayashi, Kazuaki Ikeda, Kazuyuki Fujita, and Takao Onoye. 2013. Emoballoon. In Advances in Computer Entertainment (ACE’13). Springer, 182--197.

Digital Library

[64]

Kosuke Nakajima, Yuichi Itoh, Takayuki Tsukitani, Kazuyuki Fujita, Kazuki Takashima, Yoshifumi Kitamura, and Fumio Kishino. 2011. FuSA touch display: A furry and scalable multi-touch display. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS’11). ACM, 35--44.

Digital Library

[65]

Masashi Nakatani, Hiroyuki Kajimoto, Kevin Vlack, Dairoku Sekiguchi, Naoki Kawakami, and Susumu Tachi. 2005. Control method for a 3D form display with coil-type shape memory alloy. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation (ICRA’05). IEEE, 1332--1337.

[66]

Akira Nakayasu. 2016. Luminescent tentacles: A scalable SMA motion display. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 33--34.

Digital Library

[67]

Vinh P. Nguyen, Sang Ho Yoon, Ansh Verma, and Karthik Ramani. 2014. Bendid: Flexible interface for localized deformation recognition. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UBICOMP’14). ACM, 553--557.

Digital Library

[68]

Toshio Nojima, Yoshiharu Ooide, and Hitoshi Kawaguchi. 2013. Hairlytop interface: An interactive surface display comprised of hair-like soft actuators. In World Haptics Conference (WHC’13). IEEE, 431--435.

[69]

Mie Nørgaard, Tim Merritt, Majken Kirkegaard Rasmussen, and Marianne Graves Petersen. 2013. Exploring the design space of shape-changing objects: Imagined physics. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces (DPPI’13). ACM, 251--260.

Digital Library

[70]

Masa Ogata and Masaaki Fukumoto. 2015. FluxPaper: Reinventing paper with dynamic actuation powered by magnetic flux. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, 29--38.

Digital Library

[71]

Simon Olberding, Michael Wessely, and Jürgen Steimle. 2014. Printscreen: Fabricating highly customizable thin-film touch-displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, 281--290.

Digital Library

[72]

Jifei Ou, Lining Yao, Daniel Tauber, Jürgen Steimle, Ryuma Niiyama, and Hiroshi Ishii. 2014. jamSheets: Thin interfaces with tunable stiffness enabled by layer jamming. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI’14). ACM, 65--72.

[73]

Joshua Peschke, Fabian Göbel, Thomas Gründer, Mandy Keck, Dietrich Kammer, and Rainer Groh. 2012. DepthTouch: An elastic surface for tangible computing. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI’12). ACM, 770--771.

Digital Library

[74]

Ben Piper, Carlo Ratti, and Hiroshi Ishii. 2002. Illuminating clay: A 3-D tangible interface for landscape analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). ACM, 355--362.

Digital Library

[75]

Ivan Poupyrev, Tatsushi Nashida, Shigeaki Maruyama, Jun Rekimoto, and Yasufumi Yamaji. 2004. Lumen: Interactive visual and shape display for calm computing. In ACM SIGGRAPH 2004 Emerging Technologies. ACM, 17.

Digital Library

[76]

Ivan Poupyrev, Tatsushi Nashida, and Makoto Okabe. 2007. Actuation and tangible user interfaces: The Vaucanson duck, robots, and shape displays. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI’07). ACM, 205--212.

Digital Library

[77]

Raf Ramakers, Johannes Schöning, and Kris Luyten. 2014. Paddle: Highly deformable mobile devices with physical controls. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI’14). ACM, 2569--2578.

Digital Library

[78]

Majken Kirkegaard Rasmussen, Erik Grönvall, Sofie Kinch, and Marianne Graves Petersen. 2013. It’s alive, it’s magic, it’s in love with you: Opportunities, challenges and open questions for actuated interfaces. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration. ACM, 63--72.

Digital Library

[79]

Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-changing interfaces: A review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). ACM, 735--744.

Digital Library

[80]

Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: Toward high shape resolution in self-actuated flexible mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, 593--602.

Digital Library

[81]

Anne Roudaut, Rebecca Reed, Tianbo Hao, and Sriram Subramanian. 2014. Changibles: Analyzing and designing shape changing constructive assembly. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI’14). ACM, 2593--2596.

Digital Library

[82]

Aimee Rydarowski, Ozge Samanci, and Ali Mazalek. 2008. Murmur: Kinetic relief sculpture, multi-sensory display, listening machine. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI’08). ACM, 231--238.

Digital Library

[83]

Deepak Sahoo, Kasper Hornbæk, and Sriram Subramanian. 2016. TableHop: An actuated fabric display using transparent electrodes. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 3767--3780.

Digital Library

[84]

Takao Sato, Jefferson Pardomuan, Yasushi Matoba, and Hideaki Koike. 2014. ClaytricSurface: An interactive deformable display with dynamic stiffness control. IEEE Computer Graphics and Applications 34, 3, 59--67.

[85]

Magdalena Schmid, Sonja Rümelin, and Hendrik Richter. 2013. Empowering materiality: Inspiring the design of tangible interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI’13). ACM, 91--98.

Digital Library

[86]

Holger Schnädelbach, Kevin Glover, and Ainojie Alexander Irune. 2010. ExoBuilding: Breathing life into architecture. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI’10). ACM, 442--451.

Digital Library

[87]

Sue Ann Seah, Marianna Obrist, Anne Roudaut, and Sriram Subramanian. 2015. Need for touch in human space exploration: Towards the design of a morphing haptic glove--ExoSkin. In Human-Computer Interaction (INTERACT’15). Springer, 18--36.

[88]

Brian K. Smith. 2006. Design and computational flexibility. Digital Creativity 17, 2, 65--72.

[89]

Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: Highly flexible bending interactions for projected handheld displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, 237--246.

Digital Library

[90]

Andrew Stevenson, Christopher Perez, and Roel Vertegaal. 2011. An inflatable hemispherical multi-touch display. In Proceedings of the 5th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’11). ACM, 289--292.

Digital Library

[91]

Paul Strohmeier, Jesse Burstyn, Juan Pablo Carrascal, Vincent Levesque, and Roel Vertegaal. 2016. ReFlex: A flexible smartphone with active haptic feedback for bend input. In Proceedings of the TEI’16: 10th International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 185--192.

Digital Library

[92]

Miriam Sturdee, John Hardy, Nick Dunn, and Jason Alexander. 2015. A public ideation of shape-changing applications. In Proceedings of the 2015 International Conference on Interactive Tabletops 8 Surfaces. ACM, 219--228.

Digital Library

[93]

Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring interactions with physically dynamic bar charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, 3237--3246.

Digital Library

[94]

Faisal Taher, John Vidler, and Jason Alexander. 2016. A characterization of actuation techniques for generating movement in shape-changing interfaces. In International Journal of Human--Computer Interaction 33, 5 (2017), 385--398.

[95]

Kazuki Takashima, Naohiro Aida, Hitomi Yokoyama, and Yoshifumi Kitamura. 2013. TransformTable: A self-actuated shape-changing digital table. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS’13). ACM, 179--188.

Digital Library

[96]

Kazuki Takashima, Takafumi Oyama, Yusuke Asari, Ehud Sharlin, Saul Greenberg, and Yoshifumi Kitamura. 2016. Study and design of a shape-shifting wall display. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 796--806.

Digital Library

[97]

Dominique Tan, Maciej Kumorek, Andres A. Garcia, Adam Mooney, and Derek Bekoe. 2015. Projectagami: A foldable mobile device with shape interactive applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1555--1560.

Digital Library

[98]

Aneesh P. Tarun, Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. Snaplet: Using body shape to inform function in mobile flexible display devices. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. ACM, 329--334.

Digital Library

[99]

Aneesh P. Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. 2013. PaperTab: An electronic paper computer with multiple large flexible electrophoretic displays. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, 3131--3134.

Digital Library

[100]

Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk. 2014. User-defined gestures for elastic, deformable displays. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI’14). ACM, 1--8.

Digital Library

[101]

Jessica Tsimeris, Colin Dedman, Michael Broughton, and Tom Gedeon. 2013. ForceForm: A dynamically deformable interactive surface. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS’13). ACM, 175--178.

Digital Library

[102]

Anna Vallgårda. 2014. Giving form to computational things: Developing a practice of interaction design. Personal and Ubiquitous Computing 18, 3, 577--592.

Digital Library

[103]

Florian Vogt, Timothy Chen, Reynald Hoskinson, and Sidney Fels. 2004. A malleable surface touch interface. In ACM SIGGRAPH 2004 Sketches. ACM, 36.

Digital Library

[104]

Akira Wakita and Akito Nakano. 2012. Blob manipulation. In Proceedings of the 6th International Conference on Tangible, Embedded and Embodied Interaction (TEI’12). ACM, 299--302.

Digital Library

[105]

Jun-ichiro Watanabe, Arito Mochizuki, and Youichi Horry. 2008b. Bookisheet: Bendable device for browsing content using the metaphor of leafing through the pages. In Proceedings of the 10th International Conference on Ubiquitous Computing (Ubicomp’08). ACM, 360--369.

[106]

Yoshihiro Watanabe, Alvaro Cassinelli, Takashi Komuro, and Masatoshi Ishikawa. 2008a. The deformable workspace: A membrane between real and virtual space. In 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems (TABLETOP’08). IEEE, 145--152.

[107]

Christian Weichel, Jason Alexander, and John Hardy. 2015. Shape display shader language (SDSL): A new programming model for shape changing displays. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI’15 EA). ACM, 1121--1126.

Digital Library

[108]

Lining Yao, Jifei Ou, Daniel Tauber, and Hiroshi Ishii. 2014. Integrating optical waveguides for display and sensing on pneumatic soft shape changing interfaces. In Proceedings of the Adjunct Publication of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, 117--118.

Digital Library

[109]

Zi Ye and Hammad Khalid. 2010. Cobra: Flexible displays for mobile gaming scenarios. In CHI’10 Extended Abstracts on Human Factors in Computing Systems. ACM, 4363--4368.

Digital Library

[110]

Tomoyuki Yokota, Peter Zalar, Martin Kaltenbrunner, Hiroaki Jinno, Naoji Matsuhisa, Hiroki Kitanosako, Yutaro Tachibana, Wakako Yukita, Mari Koizumi, and Takao Someya. 2016. Ultraflexible organic photonic skin. Science Advances 2, 4 (2016), e1501856.

[111]

Kyungwon Yun, JunBong Song, Keehong Youn, Sungmin Cho, and Hyunwoo Bang. 2013. ElaScreen: Exploring multi-dimensional data using elastic screen. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, 1311--1316.

Cited By

Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Margariti EVlachokyriakos VDurrant AKirk D(2024)Evaluating ActuAir: Building Occupants' Experiences of a Shape-Changing Air Quality DisplayProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642396(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642396
Steer CSauvé KJain ALawal OProulx MJicol CAlexander J(2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641952
Show More Cited By

Index Terms

Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Grand Challenges in Shape-Changing Interface Research
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Shape-changing interfaces have emerged as a new method for interacting with computers, using dynamic changes in a device's physical shape for input and output. With the advances of research into shape-changing interfaces, we see a need to synthesize the ...
Shape-changing interfaces: a review of the design space and open research questions
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Shape change is increasingly used in physical user interfaces, both as input and output. Yet, the progress made and the key research questions for shape-changing interfaces are rarely analyzed systematically. We review a sample of existing work on shape-...
Sketching Shape-changing Interfaces: Exploring Vocabulary, Metaphors Use, and Affordances
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Shape-changing interfaces allow designers to create user interfaces that physically change shape. However, presently, we lack studies of how such interfaces are designed, as well as what high-level strategies, such as metaphors and affordances, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys

ACM Computing Surveys Volume 51, Issue 1

January 2019

743 pages

ISSN:0360-0300

EISSN:1557-7341

DOI:10.1145/3177787

Editor:
Sartaj Sahni
Department of Computer and Information Science and Engineering / University of Florida / Gainesville, FL

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 January 2018

Accepted: 01 September 2017

Revised: 01 September 2017

Received: 01 October 2016

Published in CSUR Volume 51, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey
Research
Refereed

Funding Sources

Engineering and Physical Sciences Research Council

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
1,659
Total Downloads

Downloads (Last 12 months)201
Downloads (Last 6 weeks)34

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Margariti EVlachokyriakos VDurrant AKirk D(2024)Evaluating ActuAir: Building Occupants' Experiences of a Shape-Changing Air Quality DisplayProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642396(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642396
Steer CSauvé KJain ALawal OProulx MJicol CAlexander J(2024)Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and EmotionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641952(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641952
Li MZhou YZhang LLi TJiang Y(2024)OneTip: A soft tactile interface for 6-D fingertip pose acquisition in human-computer interactionSensors and Actuators A: Physical10.1016/j.sna.2024.115896379(115896)Online publication date: Dec-2024
https://doi.org/10.1016/j.sna.2024.115896
Da Costa VZen ETavares T(2023)The interface is on the table: Systematic Literature Review about interaction design to applications for tangible tabletops.Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638091(1-12)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638091
Gonzalez JPrashant STayal SKedia JIon AHudson S(2023)Constraint-Driven Robotic Surfaces, At Human-ScaleProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606740(1-12)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606740
Cui ZWang SLi JLuo SIon A(2023)MiuraKit: A Modular Hands-On Construction Kit For Pneumatic Shape-Changing And Robotic InterfacesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596108(2066-2078)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596108
Holmquist L(2023)Bits are Cheap, Atoms are Expensive: Critiquing the Turn Towards Tangibility in HCIExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3582744(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3582744
Shultz CHarrison C(2023)Flat Panel Haptics: Embedded Electroosmotic Pumps for Scalable Shape DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581547(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581547
Ramakers RLeen DKim JLuyten KHouben SVeuskens T(2023)Measurement Patterns: User-Oriented Strategies for Dealing with Measurements and Dimensions in Making ProcessesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581157(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581157
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents