Article

Papier-Mache: toolkit support for tangible input

Authors:

Scott R. Klemmer,

James A. LandayAuthors Info & Claims

CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 399 - 406

https://doi.org/10.1145/985692.985743

Published: 25 April 2004 Publication History

Abstract

Tangible user interfaces (TUIs) augment the physical world by integrating digital information with everyday physical objects. Currently, building these UIs requires "getting down and dirty" with input technologies such as computer vision. Consequently, only a small cadre of technology experts can currently build these UIs. Based on a literature review and structured interviews with nine TUI researchers, we created Papier-Mâché, a toolkit for building tangible interfaces using computer vision, electronic tags, and barcodes. Papier-Mache introduces a high-level event model for working with these technologies that facilitates technology portability. For example, an application can be prototyped with computer vision and deployed with RFID. We present an evaluation of our toolkit with six class projects and a user study with seven programmers, finding the input abstractions, technology portability, and monitoring window to be highly effective.

References

[1]

Ballagas, R., M. Ringel, et al., iStuff: a physical user interface toolkit for ubiquitous computing environments. Human Factors in Computing Systems, CHI Letters, 2003. 5(1): pp. 537 -- 44.

Digital Library

[2]

Card, S.K., T.P. Moran, and A. Newell, Chapter 2: The Human Information Processor, in The Psychology of Human-Computer Interaction, Lawrence Erlbaum: Hillsdale. pp. 23 -- 97, 1983.

[3]

Clements, P., R. Kazman, and M. Klein, Evaluating Software Architectures: Methods and Case Studies. Boston: Addison-Wesley. 323 pp, 2002.

Digital Library

[4]

Detienne, F., Software Design - Cognitive Aspects. London: Springer Verlag. 200 pp, 2001.

Digital Library

[5]

Dey, A.K., D. Salber, and G.D. Abowd, A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Human-Computer Interaction, 2001. 16(2-4): pp. 97 -- 166.

Digital Library

[6]

Fails, J.A. and D.R. Olsen, A Design Tool for Camera-based Interaction. Human Factors in Computing Systems, CHI Letters, 2003. 5(1): pp. 449 -- 56.

Digital Library

[7]

Fishkin, K.P., T.P. Moran, and B.L. Harrison. Embodied User Interfaces: Towards Invisible User Interfaces. Proc. Conf. on Engineering for Human-Computer Interaction. pp. 1--18, 1998.

Digital Library

[8]

Forsyth, D.A. and J. Ponce, Computer Vision: A Modern Approach. Upper Saddle River: Prentice Hall. 693 pp, 2003.

Digital Library

[9]

Freeman, W.T., D. Anderson, P. Beardsley, C. Dodge, et al., Computer vision for interactive computer graphics. IEEE Computer Graphics and Applications, 1998. 18(3): pp. 42 -- 53.

Digital Library

[10]

Grady, R.B., Practical Software Metrics for Project Management and Process Improvement, Prentice Hall: Englewood Cliffs, NJ. pp. 17, 1992.

Digital Library

[11]

Greenberg, S. and C. Fitchett, Phidgets: easy development of physical interfaces through physical widgets. User Interface Software & Technology, CHI Letters, 2001. 3(2): pp. 209 -- 18.

Digital Library

[12]

Heiner, J.M., S.E. Hudson, and K. Tanaka, Linking and messaging from real paper in the paper PDA. User Interface Software & Technology, CHI Letters, 1999. 1(1): pp. 179 -- 86.

Digital Library

[13]

Horn, B., Robot vision. Cambridge: MIT Press. 509 pp, 1986.

Digital Library

[14]

Ishii, H. and B. Ullmer. Tangible Bits: Human Factors in Computing Systems. Proc. CHI: Human factors in computing systems. pp. 234 -- 41, 1997.

Digital Library

[15]

Kato, H., M. Billinghurst, and I. Poupyrev. ARToolKit. University of Washington HIT Lab, 2000. http://www.hitl.washington.edu/artoolkit/

[16]

Klemmer, S.R., J. Graham, G.J. Wolff, and J.A. Landay, Books with Voices: Paper Transcripts as a Tangible Interface to Oral Histories. Human Factors in Computing Systems, CHI Letters, 2003. 5(1): pp. 89 -- 96.

Digital Library

[17]

Klemmer, S.R., M.W. Newman, R. Farrell, M. Bilezikjian, and J.A. Landay, The Designers' Outpost: A Tangible Interface for Collaborative Web Site Design. User Interface Software and Technology, CHI Letters, 2001. 3(2): pp. 1 -- 10.

Digital Library

[18]

Mackay, W.E., A.-L. Fayard, L. Frobert, and L. Médini. Reinventing the Familiar: Exploring an Augmented Reality Design Space for Air Traf?c Control. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 558 -- 65, 1998.

Digital Library

[19]

Mankoff, J., S.E. Hudson, and G.D. Abowd, Providing Integrated Toolkit-Level Support for Ambiguity in Recognition-Based Interfaces. Human Factors in Computing Systems, CHI Letters, 2000. 2(1): pp. 368 -- 375.

Digital Library

[20]

McGee, D.R., P.R. Cohen, R.M. Wesson, and S. Horman, Comparing paper and tangible, multimodal tools. Human Factors in Computing Systems, CHI Letters, 2002. 4(1): pp. 407 -- 414.

Digital Library

[21]

Moran, T.P., E. Saund, W. van Melle, A. Gujar, et al., Design and Technology for Collaborage: Collaborative Collages of Information on Physical Walls. UIST: User Interface Software and Technology, CHI Letters, 1999. 1(1): pp. 197 -- 206.

Digital Library

[22]

Myers, B., S.E. Hudson, and R. Pausch, Past, Present, and Future of User Interface Software Tools. ACM Transactions on Computer-Human Interaction, 2000. 7(1): pp. 3 -- 28.

Digital Library

[23]

Myers, B. and M.B. Rosson. Survey on User Interface Programming. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 195 -- 202, 1992.

Digital Library

[24]

Myers, B.A., A new model for handling input. ACM Trans. on Information Systems, 1990. 8(3): pp. 289 -- 320.

Digital Library

[25]

Nelson, L., S. Ichimura, E.R. Pederson, and L. Adams. Palette: a paper interface for giving presentations. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 354 -- 61, 1999.

Digital Library

[26]

Olsen, D.R., Chapter 5: Basic Interaction, in Developing User Interfaces, Morgan Kaufmann. pp. 132 -- 62, 1998.

Digital Library

[27]

Pane, J., A Programming System for Children that is Designed for Usability, Carnegie Mellon University, Pittsburgh, 2002. http://www.cs.cmu.edu/~pane/thesis

Digital Library

[28]

Rekimoto, J. and Y. Ayatsuka. CyberCode: Designing Augmented Reality Environments with Visual Tags. Proc. Designing Augmented Reality Environments (DARE 2000). ACM Press. pp. 1 -- 10, 2000.

Digital Library

[29]

Shneiderman, B. Empirical Studies of Programmers: The Territory, Paths, and Destinations. Proc. First Workshop on Empirical Studies of Programmers. Ablex Pub. pp. 1 -- 12, 1986.

Digital Library

[30]

Ullmer, B. and H. Ishii, Emerging Frameworks for Tangible User Interfaces, in Human-Computer Interaction in the New Millennium, Addison-Wesley. pp. 579 -- 601, 2001.

[31]

Want, R., K.P. Fishkin, A. Gujar, and B.L. Harrison. Bridging Physical and Virtual Worlds With Electronic Tags. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 370 -- 77, 1999.

Digital Library

Cited By

Dominiak JWalczak AStefanidi EAdamkiewicz KGrudzień KNiess JWoźniak P(2024)ProtoBricks: A Research Toolkit for Tangible Prototyping & Data PhysicalizationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661573(476-495)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661573
Campos Zamora DDogan MSiu AKoh EXiao C(2024)MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré EffectProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642734(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642734
Sun YLin L(2024)Designing a Tangible Interactive Learning System for Children’s Art Education: A Multi-Sensory Design ApproachHCI International 2024 Posters10.1007/978-3-031-61953-3_25(225-234)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61953-3_25
Show More Cited By

Index Terms

Recommendations

Decoupled design: building applications on the NetBeans platform
OOPSLA '06: Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications

The NetBeans Platform is the open-source NetBeans Integrated Development Environment (IDE) less those modules that make it a development tool. The platform is a "generic application" - a runtime which can be used to develop applications.One of the key ...
Natural and tangible human-computer interfaces for augmented environments
SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communication

In this talk, the author will introduce Augmented Reality as a new media to improve human-computer communication and industrial processes. The author will make a special emphasis in introducing and demonstrating new human-computer interfaces appropriate ...
Decoupled design: building applications on the NetBeans platform
OOPSLA '06: Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications

The NetBeans Platform is the open-source NetBeans Integrated Development Environment (IDE) less those modules that make it a development tool. The platform is a "generic application" - a runtime which can be used to develop applications.One of the key ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2004

742 pages

ISBN:1581137028

DOI:10.1145/985692

Conference Chairs:
Elizabeth Dykstra-Erickson
Kinoma
,
Manfred Tscheligi
CURE, Austria

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI04

Sponsor:

CHI04: CHI 2004 Conference on Human Factors in Computing Systems

April 24 - 29, 2004

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

115
Total Citations
View Citations
2,745
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)8

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dominiak JWalczak AStefanidi EAdamkiewicz KGrudzień KNiess JWoźniak P(2024)ProtoBricks: A Research Toolkit for Tangible Prototyping & Data PhysicalizationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661573(476-495)Online publication date: 1-Jul-2024
Campos Zamora DDogan MSiu AKoh EXiao C(2024)MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré EffectProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642734(1-10)Online publication date: 11-May-2024
Sun YLin L(2024)Designing a Tangible Interactive Learning System for Children’s Art Education: A Multi-Sensory Design ApproachHCI International 2024 Posters10.1007/978-3-031-61953-3_25(225-234)Online publication date: 1-Jun-2024
Coutaz J(2024)At the Confluence of Software Engineeringand Human-Computer Interaction:A Personal AccountThe French School of Programming10.1007/978-3-031-34518-0_5(89-122)Online publication date: 30-Apr-2024
Williams KHammer JHudson S(2023)The IoT Codex: A Book of Programmable Stickers for Authoring and Composing Embedded Computing Applications2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL-HCC57772.2023.00009(1-11)Online publication date: 3-Oct-2023
Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
Ye HFu H(2022)ProGesAR: Mobile AR Prototyping for Proxemic and Gestural Interactions with Real-world IoT Enhanced SpacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517689(1-14)Online publication date: 29-Apr-2022
Ullmer BShaer OMazalek AHummels C(2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
Han FCheng YStrachan MMa X(2021)Hybrid Paper-Digital Interfaces: A Systematic Literature ReviewProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462059(1087-1100)Online publication date: 28-Jun-2021
Xu XMankoff JDey A(2021)Understanding practices and needs of researchers in human state modeling by passive mobile sensingCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-021-00072-43:4(344-366)Online publication date: 6-Jul-2021
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents