research-article

Bonfire: a nomadic system for hybrid laptop-tabletop interaction

Authors:

Daniel Avrahami,

Jacob O. Wobbrock,

Beverly Harrison,

Matthai Philipose,

Anthony LaMarcaAuthors Info & Claims

UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

Pages 129 - 138

https://doi.org/10.1145/1622176.1622202

Published: 04 October 2009 Publication History

Abstract

We present Bonfire, a self-contained mobile computing system that uses two laptop-mounted laser micro-projectors to project an interactive display space to either side of a laptop keyboard. Coupled with each micro-projector is a camera to enable hand gesture tracking, object recognition, and information transfer within the projected space. Thus, Bonfire is neither a pure laptop system nor a pure tabletop system, but an integration of the two into one new nomadic computing platform. This integration (1) enables observing the periphery and responding appropriately, e.g., to the casual placement of objects within its field of view, (2) enables integration between physical and digital objects via computer vision, (3) provides a horizontal surface in tandem with the usual vertical laptop display, allowing direct pointing and gestures, and (4) enlarges the input/output space to enrich existing applications. We describe Bonfire's architecture, and offer scenarios that highlight Bonfire's advantages. We also include lessons learned and insights for further development and use.

Supplementary Material

MOV File (p129-kane.mov)

Download
47.16 MB

References

[1]

Agarawala, A. and Balakrishnan, R. (2006) Keepin' it real: pushing the desktop metaphor with physics, piles and the pen. Proc. CHI '06. New York: ACM Press, 1283--1292.

Digital Library

[2]

Arai, T., Machii, K. and Kuzunuki, S. (1995) Retrieving electronic documents with real-world objects on InteractiveDESK. Proc. UIST '95. New York: ACM Press, 37--38.

Digital Library

[3]

Beardsley, P., Baar, J.V., Raskar, R. and Forlines, C. (2005) Interaction using a handheld projector. IEEE Computer Graphics and Applications, 25 (1), 39--43.

Digital Library

[4]

Berry, L., Bartram, L. and Booth, K.S. (2005) Role-based control of shared application views. Proc. UIST '05. New York: ACM Press, 23--32.

Digital Library

[5]

Blasko, G., Feiner, S. and Coriand, F. (2005) Exploring interaction with a simulated wrist-worn projection display. Proc. ISWC '09. Washington, DC: IEEE Computer Society, 2--9.

Digital Library

[6]

Butler, A., Izadi, S. and Hodges, S. (2008) SideSight: multi-"touch" interaction around small devices. Proc. UIST '08. NewYork: ACM Press, 201--204.

Digital Library

[7]

Cadiz, J.J., Venolia, G., Jancke, G. and Gupta, A. (2002) Designing and deploying an information awareness interface. Proc. CSCW '02. New York: ACM Press, 314--323.

Digital Library

[8]

Cao, X. and Balakrishnan, R. (2006) Interacting with dynamically defined information spaces using a handheld projector and a pen. Proc. UIST '06. New York: ACM Press, 225--234.

Digital Library

[9]

Cao, X., Forlines, C. and Balakrishnan, R. (2007) Multi-user interaction using handheld projectors. Proc. UIST '07. New York: ACM Press, 43--52.

Digital Library

[10]

Cohen, C.J., Beach, G.J. and Foulk, G. (2001) A basic hand gesture control system for PC applications. Proc. AIPR '01. Washington, DC: IEEE Computer Society, 74.

Digital Library

[11]

Dietz, P. and Leigh, D. (2001) DiamondTouch: a multi-user touch technology. Proc. UIST '01. New York: ACM Press, 219--226.

Digital Library

[12]

Greaves, A., Hang, A. and Rukzio, E. (2008) Evaluation of picture browsing using a projector phone. Proc. MobileHCI '08. New York: ACM Press, 527--530.

Digital Library

[13]

Grudin, J. (2001) Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. Proc. CHI '01. New York: ACM Press, 458--465.

Digital Library

[14]

Hang, A., Rukzio, E. and Greaves, A. (2008) Projector phone: a study of using mobile phones with integrated projector for interaction with maps. Proc. MobileHCI '08. New York: ACM Press, 207--216.

Digital Library

[15]

Harrison, C. and Hudson, S.E. (2008) Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. Proc. UIST '08. New York: ACM Press, 205--208.

Digital Library

[16]

Hosoi, K., Dao, V.N., Mori, A. and Sugimoto, M. (2007) CoGAME: manipulation using a handheld projector. Proc. SIGGRAPH '07 Emerging Technologies. New York: ACM Press.

Digital Library

[17]

Koike, H., Sato, Y. and Kobayashi, Y. (2001) Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Transactions on Computer-Human Interaction, 8 (4), 307--322.

Digital Library

[18]

Letessier, J. and Bérard, F. (2004) Visual tracking of bare fingers for interactive surfaces. Proc. UIST '04. New York: ACM Press, 119--122.

Digital Library

[19]

MacIntyre, B., Mynatt, E.D., Voida, S., Hansen, K.M., Tullio, J. and Corso, G.M. (2001) Support for multitasking and background awareness using interactive peripheral displays. Proc. UIST '01. New York: ACM Press, 41--50.

Digital Library

[20]

Manresa, C., Varona, J., Mas, R. and Perales, F. (2005) Hand tracking and gesture recognition for human-computer interaction. Electronic Letters on Computer Vision and Image Analysis, 5 (3), 96--104.

[21]

Mistry, M., P., Maes, P. and Chang, L. (2009) WUW -- Wear Ur World -- a wearable gestural interface. Proc. CHI '09 Extended Abstracts. ACM Press, 4111--4116.

Digital Library

[22]

Olwal, A. and Wilson, A.D. (2008) SurfaceFusion: unobtrusive tracking of everyday objects in tangible user interfaces. Proc. GI '08. Toronto: Canadian Information Processing Society, 235--242.

Digital Library

[23]

Pinhanez, C., Kjeldsen, R., Tang, L., Levas, A., Podlaseck, M., Sukaviriya, N. and Pingali, G. (2003) Creating touch-screens anywhere with interactive projected displays. Proc. MULTIMEDIA '03. New York: ACM Press, 460--461.

Digital Library

[24]

Pinhanez, C.S. (2001) The Everywhere Displays Projector: a device to create ubiquitous graphical interfaces. Proc. UbiComp'01. London: Springer-Verlag, 315--331.

Digital Library

[25]

Raskar, R., Baar, J.v., Beardsley, P., Willwacher, T., Rao, S. and Forlines, C. (2003) iLamps: geometrically aware and self-configuring projectors. Proc. SIGGRAPH '03. New York: ACM Press, 809--818.

Digital Library

[26]

Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D. and Willwacher, T. (2004) RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. Proc. SIGGRAPH '04. New York: ACM Press, 406--415.

Digital Library

[27]

Rekimoto, J. (2002) SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. Proc. CHI '02. New York: ACM Press, 113--120.

Digital Library

[28]

Rekimoto, J. and Saitoh, M. (1999) Augmented surfaces: a spatially continuous work space for hybrid computing environments. Proc. CHI '99. New York: ACM Press, 378--385.

Digital Library

[29]

Shen, C., Everitt, K. and Ryall, K. (2003) UbiTable: impromptu face-to-face collaboration on horizontal interactive surfaces. Proc. UbiComp '03. Heidelberg: Springer Berlin, 281--288.

[30]

Song, H., Grossman, T., Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R. and Kurtenbach, G. (2009) PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. Proc. CHI '09. New York: ACM Press, 143--152.

Digital Library

[31]

Stauffer, C. and Grimson, W.E.L. (1999) Adaptive background mixture models for real-time tracking. Proc. CVPR '99. Washington, DC: IEEE Computer Society, 246--252.

[32]

Sugimoto, M., Miyahara, K., Inoue, H. and Tsunesada, Y. (2005) Hotaru: intuitive manipulation techniques for projected displays of mobile devices. Proc. INTERACT '05. Heidelberg: Springer Berlin, 57--688.

Digital Library

[33]

Sukaviriya, N., Kjeldsen, R., Pinhanez, C., Tang, L., Levas, A., Pingali, G. and Podlaseck, M. (2004) A portable system for anywhere interactions. Proc. CHI '04 Extended Abstracts. ACM Press, 789--790.

Digital Library

[34]

Sukthankar, R., Stockton, R.G. and Mullin, M.D. (2001) Smarter presentations: exploiting homography in camera-projector systems. Proc. ICCV '01. Washington, DC: IEEE Computing Society, 247--253.

[35]

Swain, M.J. and Ballard, D.H. (1991) Color indexing. International Journal of Computer Vision, 7 (1), 11--32.

Digital Library

[36]

Tognazzini, B. (1994) The "Starfire" video prototype project: a case history. Proc. CHI '94. New York: ACM Press, 99--105.

Digital Library

[37]

Ullmer, B. and Ishii, H. (1997) The metaDESK: Models and prototypes for tangible user interfaces. Proc. UIST '97. New York, ACM Press, 223--232.

Digital Library

[38]

Want, R., Fishkin, K., Gujar, A., and Harrison, B. (1999). Bridging Physical and Virtual Worlds with Electronic Tags. (1999). Proc. CHI '99, Pittsburgh, PA. New York: ACM Press, 370--377.

Digital Library

[39]

Weiser, M. (1999) The computer for the 21st century. Scientific American (September 1991), 94--104.

[40]

Wellner, P. (1991) The DigitalDesk calculator: tangible manipulation on a desk top display. Proc. UIST '91. New York: ACM Press, 27--33.

Digital Library

[41]

Wellner, P. (1993) Interacting with paper on the DigitalDesk. Communications of the ACM, 36 (7), 87--96.

Digital Library

[42]

Wigdor, D., Jiang, H., Forlines, C., Borkin, M. and Shen, C. (2009) WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system. Proc. CHI'09. ACM Press, 1237--1246.

Digital Library

[43]

Wilson, A.D. (2005) PlayAnywhere: a compact interactive tabletop projection-vision system. Proc. UIST '05. New York: ACM Press, 83--92.

Digital Library

[44]

Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A. and Kirk, D. (2008) Bringing physics to the surface. Proc. UIST '08. New York: ACM Press, 67--76.

Digital Library

[45]

Wilson, A.D. and Sarin, R. (2007) BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. Proc. GI '07. New York: ACM Press, 119--125.

Digital Library

[46]

Wobbrock, J.O., Morris, M.R. and Wilson, A.D. (2009) User-defined gestures for surface computing. Proc. CHI '09. New York: ACM Press, 1083--1092.

Digital Library

[47]

Wu, M. and Balakrishnan, R. (2003) Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. Proc. UIST '03. New York: ACM Press, 193--202.

Digital Library

[48]

Yang, R. and Welch, G. (2001) Automatic and continuous projector display surface calibration using everyday imagery. Proc. WSCG '01.

[49]

Zhang, Z., Wu, Y., Shan, Y. and Shafer, S. (2001) Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper. Proc. PUI '01. New York: ACM Press, 1--8.

Digital Library

[50]

Zhou, H., Xie, L. and Fang, X. (2007) Visual Mouse: SIFT Detection and PCA Recognition. Proc. CISW '07. Washington, DC: IEEE Computer Society, 263--266.

Digital Library

[51]

Ziola, R., Kellar, M. and Inkpen, K. (2007) DeskJockey: exploiting passive surfaces to display peripheral information. Proc. INTERACT '07. Heidelberg: Springer Berlin, 447--460.

Digital Library

Cited By

Wittig NDrey TWettig TAuda JKoelle MGoedicke DSchneegass S(2024)LeARn at Home: Comparing Augmented Reality and Video Conferencing Remote TutoringProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701577(255-263)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701577
Xue JZhang XLi GXie X(2024)Tangible User Interface Everywhere Based on Imperceptible Structured Light2024 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS58744.2024.10558671(1-5)Online publication date: 19-May-2024
https://doi.org/10.1109/ISCAS58744.2024.10558671
Lee KPark J(2023)Contactless Interface Using Exhaled Breath and Thermal ImagingSensors10.3390/s2307360123:7(3601)Online publication date: 30-Mar-2023
https://doi.org/10.3390/s23073601
Show More Cited By

Index Terms

Bonfire: a nomadic system for hybrid laptop-tabletop interaction
1. Computing methodologies
  1. Machine learning
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Understanding Multi-touch Manipulation for Surface Computing
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Two-handed, multi-touch surface computing provides a scope for interactions that are closer analogues to physical interactions than classical windowed interfaces. The design of natural and intuitive gestures is a difficult problem as we do not know how ...
Eugenie: gestural and tangible interaction with active tokens for bio-design
UIST '14 Adjunct: Adjunct Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

We present a case study of a tangible user interface that implements novel interaction techniques for the construction of complex queries in large data sets. Our interface, Eugenie, utilizes gestural interaction with active physical tokens and a multi-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

October 2009

278 pages

ISBN:9781605587455

DOI:10.1145/1622176

General Chair:
Andrew Wilson
Microsoft Research, USA
,
Program Chair:
François Guimbretière
Cornell University, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '09

Sponsor:

UIST '09: The 22nd Annual ACM Symposium on User Interface Software and Technology

October 4 - 7, 2009

BC, Victoria, Canada

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

100
Total Citations
View Citations
2,264
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)7

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wittig NDrey TWettig TAuda JKoelle MGoedicke DSchneegass S(2024)LeARn at Home: Comparing Augmented Reality and Video Conferencing Remote TutoringProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701577(255-263)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701577
Xue JZhang XLi GXie X(2024)Tangible User Interface Everywhere Based on Imperceptible Structured Light2024 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS58744.2024.10558671(1-5)Online publication date: 19-May-2024
https://doi.org/10.1109/ISCAS58744.2024.10558671
Lee KPark J(2023)Contactless Interface Using Exhaled Breath and Thermal ImagingSensors10.3390/s2307360123:7(3601)Online publication date: 30-Mar-2023
https://doi.org/10.3390/s23073601
Eddy DWhite MBlanchette D(2023)Intelligent Insights for Manufacturing Inspections from Efficient Image RecognitionMachines10.3390/machines1101004511:1(45)Online publication date: 1-Jan-2023
https://doi.org/10.3390/machines11010045
Kim DJoshi NVogel D(2023)Perspective and Geometry Approaches to Mouse Cursor Control in Spatial Augmented RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580849(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580849
Eddy DWhite MBlanchette D(2023)Learned Manufacturing Inspection Inferences from Image Recognition CapabilitiesFlexible Automation and Intelligent Manufacturing: The Human-Data-Technology Nexus10.1007/978-3-031-17629-6_21(193-202)Online publication date: 4-Feb-2023
https://doi.org/10.1007/978-3-031-17629-6_21
Joshi NIrudayaraj AHartmann JVogel D(2022)An Instrumented Office Chair with a Steerable Projector for Personal Spatial Augmented RealityProceedings of the 2022 ACM Symposium on Spatial User Interaction10.1145/3565970.3567705(1-12)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565970.3567705
Drey TJanek JLang JPuschmann DRietzler MRukzio E(2022)SpARklingPaperProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503376:3(1-29)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550337
Zhang JZhou YXi RLi SGuo JHe Y(2022)AmbiEarProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503206:3(1-25)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550320
Yang XSayono JXu JLi JHester JZhang Y(2022)MiniKersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35502876:3(1-22)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550287
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents