research-article

The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies

Authors:

Nicolai Marquardt,

Robert Diaz-Marino,

Sebastian Boring,

Saul GreenbergAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 315 - 326

https://doi.org/10.1145/2047196.2047238

Published: 16 October 2011 Publication History

Abstract

People naturally understand and use proxemic relationships (e.g., their distance and orientation towards others) in everyday situations. However, only few ubiquitous computing (ubicomp) systems interpret such proxemic relationships to mediate interaction (proxemic interaction). A technical problem is that developers find it challenging and tedious to access proxemic information from sensors. Our Proximity Toolkit solves this problem. It simplifies the exploration of interaction techniques by supplying fine-grained proxemic information between people, portable devices, large interactive surfaces, and other non-digital objects in a room-sized environment. The toolkit offers three key features. 1) It facilitates rapid prototyping of proxemic-aware systems by supplying developers with the orientation, distance, motion, identity, and location information between entities. 2) It includes various tools, such as a visual monitoring tool, that allows developers to visually observe, record and explore proxemic relationships in 3D space. (3) Its flexible architecture separates sensing hardware from the proxemic data model derived from these sensors, which means that a variety of sensing technologies can be substituted or combined to derive proxemic information. We illustrate the versatility of the toolkit with proxemic-aware systems built by students.

Supplementary Material

JPG File (fp135.jpg)

Download
8.70 KB

MOV File (fp135.mov)

Download
66.43 MB

References

[1]

Ballagas, R., Ringel, M., Stone, M., and Borchers, J. iStuff: a physical user interface toolkit for ubiquitous computing environments. Proc. of CHI'03, ACM (2003).

Digital Library

[2]

Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. Proc. of ITS'10, ACM (2010).

Digital Library

[3]

Boyle, M. and Greenberg, S. Rapidly prototyping multimedia groupware. Proc. of DMS, Knowl. Sys. Institute, (2005).

[4]

Dey, A.K., et al. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum.-Comp. Int. 16, 2, L. Erlbaum (2001), 97--166.

Digital Library

[5]

Diaz-Marino, R. and Greenberg, S. The proximity toolkit and ViconFace: the video. Ext. Abst. CHI '10, ACM (2010).

Digital Library

[6]

Feiner, S., et al. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies 1, 4 (1997), 208--217.

[7]

Gamma, E., et al. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, 1994.

Digital Library

[8]

Greenberg, S. and Fitchett, C. Phidgets: Easy Development of Physical Interfaces Through Physical Widgets. Proc. of UIST'01, ACM (2001), 209--218.

Digital Library

[9]

Greenberg, S., Marquardt, N., et al. Proxemic interactions: the new ubicomp? interactions 18, ACM (2011), 42--50.

Digital Library

[10]

GroupLab. Proximity Toolkit website, http://grouplab.cpsc.ucalgary.ca/proximitytoolkit, Retrieved July 5, 2011.

[11]

Hall, E.T. The Hidden Dimension. Doubleday, N.Y, 1966.

[12]

Hartmann, B., et al. Reflective physical prototyping through integrated design, test, and analysis. Proc. UIST, ACM (2006).

Digital Library

[13]

Hightower, J., et al. The location stack: A layered model for location in ubiquitous computing. Proc. of WMCSA'02, (2002).

Digital Library

[14]

Ishii, H. and Ullmer, B. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. Proc. of CHI'97, ACM (1997), 234--241.

Digital Library

[15]

Ju, W., et al. Range: exploring implicit interaction through electronic whiteboard design. Proc. of CSCW'08, ACM (2008).

Digital Library

[16]

Klemmer, S.R., et al. Papier-Mache: Toolkit Support for Tangible Input. Proc. of CHI'04, ACM (2004), 399--406.

Digital Library

[17]

Kortuem, G., et al. Sensing and visualizing spatial relations of mobile devices. Proc. of UIST'05, ACM (2005), 93--102.

Digital Library

[18]

Krumm, J. and Hinckley, K. The NearMe wireless proximity server. Lecture notes in computer science, (2004), 283--300.

[19]

Li, Y., et al. Topiary: a tool for prototyping location-enhanced applications. Proc. of UIST '04, ACM (2004).

Digital Library

[20]

MacIntyre, B., et al. DART: a toolkit for rapid design exploration of augmented reality experiences. Proc. of UIST'04, ACM (2004).

Digital Library

[21]

Marquardt, N. and Greenberg, S. Distributed Physical Interfaces with Shared Phidgets. Proc. of TEI'07, ACM (2007).

Digital Library

[22]

Matthews, T., et al. A toolkit for managing user attention in peripheral displays. Proc. of UIST '04, ACM (2004).

Digital Library

[23]

Myers, B.A., et al. Past, Present, and Future of User Interface Software Tools. TOCHI 7, 1, ACM (2000), 3--28.

Digital Library

[24]

PrimeSense. OpenNI SDK, http://www.openni.org, Accessed July 5, 2011.

[25]

Reitmayr, G. et al. OpenTracker: A flexible software design for three-dimensional interaction. Virt. Reality 9, (2005).

Digital Library

[26]

Sandor, C. and Klinker, G. A rapid prototyping software infrastructure for user interfaces in ubiquitous augmented reality. Pers. and Ubiq. Comp. 9, (2005).

Digital Library

[27]

Schwarz, J., et al. A framework for robust and flexible handling of inputs with uncertainty. Proc of UIST, ACM (2010).

Digital Library

[28]

Snibbe, S.S. et al. Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits. Proc. of CHI '09, ACM (2009), 1447--1456.

Digital Library

[29]

Streitz, N., et al. Ambient displays and mobile devices for the creation of social architectural spaces. In Public and Situated Displays. Kluwer, 2003, 387--410.

[30]

Vicon Motion Systems. Nexus software, http://www.vicon.com/products/nexus.html, Retrieved July 5, 2011.

[31]

Vogel, D. et al. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. Proc. of UIST'04, ACM (2004).

Digital Library

[32]

Weiser, M. The Computer for the 21st Century. Scientific American 265, (1991), 94.

Digital Library

[33]

Zhao, T., Aggarwal, M., Kumar, R., and Sawhney, H. Real-Time Wide Area Multi-Camera Stereo Tracking. Proc. of CVPR'05, IEEE (2005), 976--983.

Digital Library

Cited By

Aghel Manesh SZhang TOnishi YHara KBateman SLi JTang A(2024)How People Prompt Generative AI to Create Interactive VR ScenesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661547(2319-2340)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661547
Lunding MGrønbæk JGrymer NWells THouben SPetersen M(2023)Reality and Beyond: Proxemics as a Lens for Designing Handheld Collaborative Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36264637:ISS(21-40)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626463
Bateman SGutwin CMansoor HNacenta Mvan der Kamp MBaliesnyi MGagnon KRollheiser J(2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593236
Show More Cited By

Index Terms

The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Proxemic interaction: designing for a proximity and orientation-aware environment
ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

In the everyday world, much of what we do is dictated by how we interpret spatial relationships, or proxemics. What is surprising is how little proxemics are used to mediate people's interactions with surrounding digital devices. We imagine proxemic ...
Proxemic interactions in ubiquitous computing ecologies
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

An important challenge in ubiquitous computing (ubicomp) is to create techniques that allow people to seamlessly and naturally connect to and interact with the increasing number of digital devices. I propose to leverage the knowledge of people's and ...
Proxemic interactions with and around digital surfaces
ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

This tutorial introduces strategies how the knowledge of people's and devices' proxemic relationships can be applied to interaction design. The goal is to inform the design of future proxemic-aware devices that -- similar to people's natural ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

189
Total Citations
View Citations
2,460
Total Downloads

Downloads (Last 12 months)110
Downloads (Last 6 weeks)22

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Aghel Manesh SZhang TOnishi YHara KBateman SLi JTang A(2024)How People Prompt Generative AI to Create Interactive VR ScenesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661547(2319-2340)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661547
Lunding MGrønbæk JGrymer NWells THouben SPetersen M(2023)Reality and Beyond: Proxemics as a Lens for Designing Handheld Collaborative Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36264637:ISS(21-40)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626463
Bateman SGutwin CMansoor HNacenta Mvan der Kamp MBaliesnyi MGagnon KRollheiser J(2023)WAMS: A Flexible API for Visual Workspaces Across Multiple SurfacesProceedings of the ACM on Human-Computer Interaction10.1145/35932367:EICS(1-40)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593236
Li RSeyed TMarquardt NOfek EHodges SSinclair MRomat HPahud MSharma JBuxton WHinckley KRiche N(2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581300
Irlitti ALatifoglu MZhou QReinoso MHoang TVelloso EVetere F(2023)Volumetric Mixed Reality Telepresence for Real-time Cross Modality CollaborationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581277(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581277
Hu EGrønbæk JHouck AHeo S(2023)OpenMic: Utilizing Proxemic Metaphors for Conversational Floor Transitions in Multiparty Video MeetingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581013(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581013
Ye HLeng JXiao CWang LFu H(2023)ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580750(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580750
Hubenschmid SFink DZagermann JWieland JReiterer HFeuchtner T(2023)Colibri: A Toolkit for Rapid Prototyping of Networking Across Realities2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00010(9-13)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00010
Pamparău CSchipor ODancu AVatavu R(2023)SAPIENS in XR: operationalizing interaction-attention in extended realityVirtual Reality10.1007/s10055-023-00776-127:3(1765-1781)Online publication date: 22-Feb-2023
https://doi.org/10.1007/s10055-023-00776-1
Vatavu R(2023)Gesture-Based InteractionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_20-1(1-47)Online publication date: 9-Feb-2023
https://doi.org/10.1007/978-3-319-27648-9_20-1
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents