Article

Reflective physical prototyping through integrated design, test, and analysis

Authors:

Björn Hartmann,

Scott R. Klemmer,

Michael Bernstein,

Avi Robinson-Mosher,

Jennifer GeeAuthors Info & Claims

UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

Pages 299 - 308

https://doi.org/10.1145/1166253.1166300

Published: 15 October 2006 Publication History

Abstract

Prototyping is the pivotal activity that structures innovation, collaboration, and creativity in design. Prototypes embody design hypotheses and enable designers to test them. Framin design as a thinking-by-doing activity foregrounds iteration as a central concern. This paper presents d.tools, a toolkit that embodies an iterative-design-centered approach to prototyping information appliances. This work offers contributions in three areas. First, d.tools introduces a statechart-based visual design tool that provides a low threshold for early-stage prototyping, extensible through code for higher-fidelity prototypes. Second, our research introduces three important types of hardware extensibility - at the hardware-to-PC interface, the intra-hardware communication level, and the circuit level. Third, d.tools integrates design, test, and analysis of information appliances. We have evaluated d.tools through three studies: a laboratory study with thirteen participants; rebuilding prototypes of existing and emerging devices; and by observing seven student teams who built prototypes with d.tools.

Supplementary Material

JPG File (1166300.jpg)

Download
14.58 KB

index.html (index.html)

Slides from the presentation

Download
.96 KB

ZIP File (p299-slides.zip)

Supplemental material for Reflective physical prototyping through integrated design, test, and analysis

Download
16.60 MB

Audio only (1166300.mp3)

Download
5.37 MB

Video (1166300.mp4)

Download
128.61 MB

References

[1]

Java 2 Platform SDK: Java. Robot, 2006. Sun Microsystems. http://java.sun.com/j2se/1.5/docs/api/java/awt/Robot.html

[2]

LEGO Mindstorms Robotic Invention System. http://www.mindstorms.lego.com/

[3]

Maestro. Cybelius. http://www.cybelius.com/products

[4]

Max/MSP. Cycling '74. http://cycling74.com/products/maxmsp

[5]

Avrahami, D. and S. E. Hudson, Forming interactivity: a tool for rapid prototyping of physical interactive products, in DIS: ACM Conference on Designing interactive systems. ACM Press. pp. 141--46, 2002.

Digital Library

[6]

Badre, A. N., M. Guzdial, S. E. Hudson, and P. J. Santos. A user interface evaluation environment using synchronized video, visualizations and event trace data. Software Quality Journal 4(2): Springer Netherlands. pp. 101--13, 1995.

[7]

Baldonado, M. Q. W., A. Woodruff, and A. Kuchinsky, Guidelines for using multiple views in information visualization, in Proceedings of the working conference on Advanced visual interfaces. 2000, ACM Press: Palermo, Italy.

Digital Library

[8]

Ballagas, R., M. Ringel, M. Stone, and J. Borchers. iStuff: a physical user interface toolkit for ubiquitous computing environments. In Proceedings of CHI: ACM Conference on Human Factors in Computing Systems. p. 537--44, 2003.

Digital Library

[9]

Ballagas, R., A. Szybalski, and A. Fox. Patch Panel: Enabling Control-Flow Interoperability in Ubicomp Environments. In Proceedings of PerCom 2004 Second IEEE International Conference on Pervasive Computing and Communications: IEEE Press. p. 241--52, 2004.

Digital Library

[10]

Barragan, H., Wiring: Prototyping Physical Interaction Design, Interaction Design Institute, Ivrea, Italy, 2004.

[11]

Buchenau, M. and J. Fulton Suri. Experience prototyping. In Proceedings of DIS: ACM Conference on Designing interactive systems: ACM Press. pp. 424--33, 2000.

Digital Library

[12]

Burr, B., VACA: A Tool for Qualitative Video Analysis, in Extended Abstracts of CHI: ACM Conference on Human Factors in Computing Systems. 2006, ACM Press.

Digital Library

[13]

Fails, J. and D. Olsen. A design tool for camera-based interaction. In Proceedings of CHI: ACM Conference on Human Factors in Computing Systems: ACM Press. pp. 449--56, 2003.

Digital Library

[14]

Greenberg, S. and M. Boyle. Customizable physical interfaces for interacting with conventional applications. In Proceedings of UIST: ACM Symposium on User Interface Software and Technology: ACM Press. p. 31--40, 2002.

Digital Library

[15]

Greenberg, S. and C. Fitchett. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of UIST: ACM Symposium on User Interface Software and Technology. p. 209--18, 2001.

Digital Library

[16]

Hammontree, M. L., J. Hendrickson, J., and B. W. Hensley. Integrated data capture and analysis tools for research and testing on graphical user interfaces. In Proceedings of CHI: ACM Conference on Human Factors in Computing Systems: ACM Press. pp. 431--32, 1992.

Digital Library

[17]

Harel, D. Statecharts: A visual formalism for complex systems. Science of Comp. Programming 8(3). pp. 231--74, 1987.

Digital Library

[18]

Hilbert, D. M. and D. F. Redmiles. Extracting usability information from user interface events. ACM Computing Surveys 32(4). pp. 384--421, 2000.

Digital Library

[19]

Hinckley, K., J. Pierce, M. Sinclair, and E. Horvitz. Sensing techniques for mobile interaction. In Proceedings of UIST: ACM Symposium on User Interface Software and Technology: ACM Press. pp. 91--100, 2000.

Digital Library

[20]

Houde, S. and C. Hill, What do Prototypes Prototype? in Handbook of Human-Computer Interaction, M. Helander, T.Ê. Landauer, and P. Prabhu, Editors. Elsevier Science B. V: Amsterdam, 1997.

[21]

Kelley, J. F. An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Office Information Systems 2(1). pp. 26--41, 1984.

Digital Library

[22]

Kelley, T., The Art of Innovation: Currency. 320 pp. 2001.

[23]

Kirsh, D. and P. Maglio. On distinguishing epistemic from pragmatic action. Cognitive Science 18. pp. 513--49, 1994.

[24]

Klemmer, S. R., B. Hartmann, and L. Takayama. How Bodies Matter: Five Themes for Interaction Design. In Proceedings of Design of Interactive Systems, 2006.

Digital Library

[25]

Klemmer, S. R., A. K. Sinha, J. Chen, et al. SUEDE: A Wizard of Oz Prototyping Tool for Speech User Interfaces. In Proceedings of UIST: ACM Symposium on User Interface Software and Technology. p. 1--10, 2000.

Digital Library

[26]

Klemmer, S. R., B. Verplank, and W. Ju. Teaching Embodied Interaction Design Practice. In Proceedings of DUX: Conference on Designing for User eXperience: AIGA, 2005.

Digital Library

[27]

Lee, J., D. Avrahami, S. Hudson, et al. The Calder Toolkit: Wired and Wireless Components for Rapidly Prototyping Interactive Devices. In Proceedings of DIS: ACM Conference on Designing Interactive Systems: ACM Press. p. 167--75, August, 2004.

Digital Library

[28]

Mackay, W. E. EVA: an experimental video annotator for symbolic analysis of video data. SIGCHI Bulletin 21(2): ACM Press. pp. 68--71, 1989.

Digital Library

[29]

Myers, B., S. E. Hudson, and R. Pausch. Past, Present, and Future of User Interface Software Tools. ACM Transactions on Computer-Human Interaction 7(1). pp. 3--28, 2000.

Digital Library

[30]

Ringel Morris, M., Supporting Effective Interaction with Tabletop Groupware, Unpublished PhD, Stanford University, Computer Science, Stanford, CA, 2006.

Digital Library

[31]

Schön, D. A., The Reflective Practitioner: How Professionals Think in Action. New York: Basic Books. 374 pp. 1983.

[32]

Schön, D. A. and J. Bennett, Reflective Conversation with Materials, in Bringing Design to Software, T. Winograd, Editor. ACM Press: New York. pp. 171--84, 1996.

Digital Library

[33]

Schrage, M., Cultures of Prototyping, in Bringing Design to Software, T. Winograd, Editor. ACM Press: New York. pp. 191--205, 1996.

Digital Library

[34]

Schrage, M., Serious play - How the world's best companies simulate to innovate. Cambridge, MA: Harvard Business School Press. 245 pp. 2000.

[35]

Weiler, P. Software for the usability lab: a sampling of current tools. In Proceedings of CHI: ACM Conference on Human factors in computing systems: ACM Press, 1993.

Digital Library

Cited By

Seo WPark SZhang ZSingh HPasupathy KMahajan P(2024)Identifying Interventions to Improve Diagnostic Safety in Emergency Departments: Protocol for a Participatory Design StudyJMIR Research Protocols10.2196/5535713(e55357)Online publication date: 21-Jun-2024
https://doi.org/10.2196/55357
Raina AMone VGorjian MQuek FSueda SKrishnamurthy V(2024)Blended Physical-Digital Kinesthetic Feedback for Mixed Reality-Based Conceptual Design-In-ContextProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670967(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670967
Petridis STerry MCai C(2024)PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers’ WorkflowsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661613(743-756)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661613
Show More Cited By

Index Terms

Reflective physical prototyping through integrated design, test, and analysis
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
      2. User centered design
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments
      1. Integrated and visual development environments
  2. Software organization and properties
    1. Software system structures
      1. Software system models
        State systems

Recommendations

Prototyping and Prototype use in Participatory Design with older adults: A systematic literature review
PDC '22: Proceedings of the Participatory Design Conference 2022 - Volume 1

This systematic literature review examines the role of prototyping and prototype use in Participatory Design (PD) with older adults. Through text analysis of 68 studies, ten descriptive categories of forms of prototyping and prototype use were ...
SUEDE: iterative, informal prototyping for speech interfaces
CHI EA '01: CHI '01 Extended Abstracts on Human Factors in Computing Systems

SUEDE is a speech interface prototyping tool that enables rapid, iterative creation of prompt-response speech interfaces. It explicitly supports iterative design, allowing a designer to quickly create an interface prototype, conduct user studies, and ...
Increasing interactivity of paper prototyping with smart pen
HCIK '15: Proceedings of HCI Korea

Wireframes have been widely used in the early phase of user interface (UI) design processes. However, because they lack interactivity in usage, it is not possible for users to have a realistic experience. Through our preliminary study, several ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology

October 2006

354 pages

ISBN:1595933131

DOI:10.1145/1166253

General Chair:
Pierre Wellner
IDIAP Research Institute, Switzerland
,
Program Chair:
Ken Hinckley
Microsoft Research, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST06

Sponsor:

UIST06: The 19th Annual ACM Symposium on User Interface Software and Technology

October 15 - 18, 2006

Montreux, Switzerland

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

217
Total Citations
View Citations
4,096
Total Downloads

Downloads (Last 12 months)134
Downloads (Last 6 weeks)22

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Seo WPark SZhang ZSingh HPasupathy KMahajan P(2024)Identifying Interventions to Improve Diagnostic Safety in Emergency Departments: Protocol for a Participatory Design StudyJMIR Research Protocols10.2196/5535713(e55357)Online publication date: 21-Jun-2024
https://doi.org/10.2196/55357
Raina AMone VGorjian MQuek FSueda SKrishnamurthy V(2024)Blended Physical-Digital Kinesthetic Feedback for Mixed Reality-Based Conceptual Design-In-ContextProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670967(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670967
Petridis STerry MCai C(2024)PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers’ WorkflowsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661613(743-756)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661613
Jahanlou AChilana P(2024)How Example-Based Authoring of Motion Graphics Impacts Creative Expression: Differences in Perceptions of Professional and Casual Motion DesignersProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656197(347-357)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656197
Hu JLi JZeng YYang DLiang DMeng HMa X(2024)Designing Scaffolding Strategies for Conversational Agents in Dialog Task of Neurocognitive Disorders ScreeningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642960(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642960
Du HZhu GXing WXie C(2024)What Distinguishes Students’ Engineering Design Performance: Design Behaviors, Design Iterations, and Application of Science ConceptsJournal of Science Education and Technology10.1007/s10956-024-10184-yOnline publication date: 10-Dec-2024
https://doi.org/10.1007/s10956-024-10184-y
Alessandrini A(2023)Strategies, Practices, and Challenges in Interactive Prototypes Construction: a Field Study in a Design CourseProceedings of the European Conference on Cognitive Ergonomics 202310.1145/3605655.3605661(1-4)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3605655.3605661
Turakhia DJiang PMueller S(2023)The Reflective Make-AR In-Action: Using Augmented Reality for Reflection-based Learning of MakerskillsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585850(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585850
Lam MMa ZLi AFreitas IWang DLanday JBernstein M(2023)Model Sketching: Centering Concepts in Early-Stage Machine Learning Model DesignProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581290(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581290
Yu FStolzenberg RBrem A(2023)Assessment of the mono-disciplinary approaches and interdisciplinary approaches in prototyping practiceJournal of Engineering and Technology Management10.1016/j.jengtecman.2022.10172967(101729)Online publication date: Jan-2023
https://doi.org/10.1016/j.jengtecman.2022.101729
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents