skip to main content
10.1145/3313831.3376379acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Proxemics Beyond Proximity: Designing for Flexible Social Interaction Through Cross-Device Interaction

Published: 23 April 2020 Publication History

Abstract

Cross-device interactions enable ad hoc sharing of content and control in co-located collaboration. Cross-device research often draws from proxemics theory for designing interactions based on detection of spatial relations such as distance and orientation between people and devices. However, detection of human-human or human-device proximity also constrains flexibility in co-located social interaction. We suggest a proxemics-based approach to designing flexible cross-device interactions. From observations in a field study, we articulate how co-located sharing practices are shaped by the interplay between everyday mobile devices and the physical environment. Based on these insights, we present three cross-device prototypes as proofs-of-concept, demonstrating three design sensitivities for considering proxemics beyond proximity; incorporating features in the environment, enabling flexibility in interpersonal distance and orientation, and providing multiple alternative action possibilities. Drawing from characteristics of our prototypes, we discuss concrete proposals for designing cross-device interactions to enable flexible social interaction.

Supplementary Material

MP4 File (paper252pv.mp4)
Preview video
MP4 File (pn4056vf.mp4)
Supplemental video
MP4 File (a252-gronbaek-presentation.mp4)

References

[1]
2016. AirDrop. (24 9 2016). Retrieved from https://support.apple.com/en-us/HT203106.
[2]
2016. Android Beam. (24 9 2016). Retrieved from https://developer.android.com/training/beam-files/index.html.
[3]
2017. Chirp.io -- Send data with sound. (1 9 2017). Retrieved from http://chirp.io/.
[4]
2018. Vuforia Developer Portal. (16 8 2018). Retrieved from https://developer.vuforia.com/.
[5]
Rafael Ballagas, Michael Rohs, Jennifer G Sheridan, and Jan Borchers. 2004. Byod: Bring your own device. In Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, Vol. 2004.
[6]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). Association for Computing Machinery, New York, NY, USA, 121--130.
[7]
Anne Louise Bang and Mette Agger Eriksen. 2014. Experiments all the way in programmatic design research. Artifact: Journal of Design Practice 3, 2 (2014), 4--1.
[8]
Jakob Bardram, Jonathan Bunde-Pedersen, Afsaneh Doryab, and Steffen Sørensen. 2009. CLINICAL SURFACES - Activity-Based Computing for Distributed Multi-Display Environments in Hospitals, Vol. 5727. 704--717.
[9]
Jacob Biehl, William Baker, Brian P. Bailey, Desney S. Tan, Kori M. Inkpen, and Mary Czerwinski. 2008. IMPROMPTU: A new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. Conference on Human Factors in Computing Systems - Proceedings (01 2008), 939--948.
[10]
Thomas Binder and Johan Redström. 2006. Exemplary design research. (2006).
[11]
Sebastian Boring, Manuela Altendorfer, Gregor Broll, Otmar Hilliges, and Andreas Butz. 2007. Shoot & Copy: Phonecam-based Information Transfer from Public Displays Onto Mobile Phones. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems and the 1st International Symposium on Computer Human Interaction in Mobile Technology (Mobility '07). ACM, NY, NY, USA, 24--31.
[12]
Sebastian Boring, Dominikus Baur, Andreas Butz, Sean Gustafson, and Patrick Baudisch. 2010. Touch Projector: Mobile Interaction through Video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10). Association for Computing Machinery, New York, NY, USA, 2287--2296.
[13]
Andrew Bragdon, Rob DeLine, Ken Hinckley, and Meredith Ringel Morris. 2011. Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). Association for Computing Machinery, New York, NY, USA, 212--221.
[14]
Eva Brandt and Thomas Binder. 2007. Experimental design research: genealogy, intervention, argument. International Association of Societies of Design Research, Hong Kong (2007).
[15]
Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 562, 28 pages.
[16]
W. Buxton. 2006. Space-function integration and ubiquitous media. Towards and Interactive and Integrative Design Process. Linz, Austria: DOM Publications (2006), 248--271.
[17]
Debaleena Chattopadhyay, Kenton O'Hara, Sean Rintel, and Roman Rädle. 2016. Office Social: Presentation Interactivity for Nearby Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16). Association for Computing Machinery, New York, NY, USA, 2487--2491.
[18]
Debaleena Chattopadhyay, Francesca Salvadori, Kenton O'Hara, and Sean Rintel. 2017. Beyond Presentation: Shared Slideware Control as a Resource for Collocated Collaboration. Human--Computer Interaction (2017), 1--44.
[19]
Giuseppe Desolda, Carmelo Ardito, Hans-Christian Jetter, and Rosa Lanzilotti. 2019. Exploring spatially-aware cross-device interaction techniques for mobile collaborative sensemaking. International Journal of Human-Computer Studies 122 (2019), 1--20.
[20]
Paul Dourish. 2004. Where the action is: the foundations of embodied interaction. MIT press.
[21]
Maiken Hillerup Fogtmann, Peter Gall Krogh, and Thomas Markussen. 2011. Spatial sharing: Designing computational artifacts as architecture. In Proceedings of the International Conference on Designing Pleasurable Products and Interfaces. 1--9.
[22]
Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, and Bo Begole. 2014. SurfaceLink: Using Inertial and Acoustic Sensing to Enable Multi-Device Interaction on a Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). Association for Computing Machinery, New York, NY, USA, 1387--1396.
[23]
Saul Greenberg. 2001. Context as a Dynamic Construct. Hum.-Comput. Interact. 16, 2 (Dec. 2001), 257--268.
[24]
Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? Interactions 18, 1 (Jan. 2011), 42--50.
[25]
Jens Emil Grønbæk, Henrik Korsgaard, Marianne Graves Petersen, Morten Henriksen Birk, and Peter Gall Krogh. 2017. Proxemic Transitions: Designing Shape-Changing Furniture for Informal Meetings. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 7029--7041.
[26]
Jens Emil Grønbæk, Christine Linding, Anders Kromann, Thomas Fly Hylddal Jensen, and Marianne Graves Petersen. 2019. Proxemics Play: Exploring the Interplay between Mobile Devices and Interiors. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion (DIS '19 Companion). Association for Computing Machinery, New York, NY, USA, 177--181.
[27]
Jens Emil Grønbæk and Kenton O'Hara. 2016. Built-In Device Orientation Sensors for Ad-Hoc Pairing and Spatial Awareness. In Cross-Surface'16 workshop.
[28]
Edward T. Hall. 1966. The Hidden Dimension.
[29]
Eva Hornecker. 2005. A design theme for tangible interaction: embodied facilitation. In ECSCW 2005.
[30]
Steven Houben, Nicolai Marquardt, Jo Vermeulen, Clemens Klokmose, Johannes Schöning, Harald Reiterer, and Christian Holz. 2017. Opportunities and Challenges for Cross-Device Interactions in the Wild. Interactions 24, 5 (Aug. 2017), 58--63.
[31]
Hans-Christian Jetter, Harald Reiterer, and Florian Geyer. 2014. Blended Interaction: Understanding Natural Human-Computer Interaction in Post-WIMP Interactive Spaces. Personal Ubiquitous Comput. 18, 5 (June 2014), 1139--1158.
[32]
Haojian Jin, Christian Holz, and Kasper Hornbundefinedk. 2015. Tracko: Ad-Hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). Association for Computing Machinery, New York, NY, USA, 147--156.
[33]
Tero Jokela, Ming Ki Chong, Andrés Lucero, and Hans Gellersen. 2015. Connecting Devices for Collaborative Interactions. Interactions 22, 4 (June 2015), 39--43.
[34]
Mandy Korzetz, Romina Kühn, Peter Heisig, and Thomas Schlegel. 2016. Natural Collocated Interactions for Merging Results with Mobile Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, NY, NY, USA, 746--752.
[35]
Peter Gall Krogh, Marianne Graves Petersen, Kenton O'Hara, and Jens Emil Grønbæk. 2017. Sensitizing Concepts for Socio-Spatial Literacy in HCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 6449--6460.
[36]
Bryan Lawson. 2007. Language of space. Routledge.
[37]
Paul Luff and Christian Heath. 1998. Mobility in Collaboration. In Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (CSCW '98). Association for Computing Machinery, New York, NY, USA, 305--314.
[38]
Kent Lyons, Trevor Pering, Barbara Rosario, Shivani Sud, and Roy Want. 2009. Multi-display composition: Supporting display sharing for collocated mobile devices. In IFIP Conference on Human-Computer Interaction. Springer, 758--771.
[39]
Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). Association for Computing Machinery, New York, NY, USA, 315--326.
[40]
Nicolai Marquardt and Saul Greenberg. 2015. Proxemic interactions: From theory to practice. Synthesis Lectures on Human-Centered Informatics 8, 1 (2015), 1--199.
[41]
Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-Mobility and f-Formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). Association for Computing Machinery, New York, NY, USA, 13--22.
[42]
Rene Mayrhofer and Hans Gellersen. 2007. Shake well before use: Authentication based on accelerometer data. In International Conference on Pervasive Computing. Springer, 144--161.
[43]
Helena M. Mentis, Kenton O'Hara, Abigail Sellen, and Rikin Trivedi. 2012. Interaction Proxemics and Image Use in Neurosurgery. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Association for Computing Machinery, New York, NY, USA, 927--936.
[44]
Kenton O'Hara, Richard Harper, Helena Mentis, Abigail Sellen, and Alex Taylor. 2013. On the Naturalness of Touchless: Putting the "Interaction" Back into NUI. ACM Trans. Comput.-Hum. Interact. 20, 1, Article Article 5 (April 2013), 25 pages.
[45]
Kenton O'Hara and Tim Kindberg. 2007. Understanding user engagement with barcoded signs in the 'Coast' location-based experience. Journal of location based services 1, 4 (2007), 256--273.
[46]
Kenton O'Hara, Jesper Kjeldskov, and Jeni Paay. 2011. Blended Interaction Spaces for Distributed Team Collaboration. ACM Trans. Comput.-Hum. Interact. 18, 1, Article Article 3 (May 2011), 28 pages.
[47]
Antti Oulasvirta and Kasper Hornbæk. 2016. HCI Research As Problem-Solving. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 4956--4967.
[48]
Trevor Pering, Kent Lyons, Roy Want, Mary Murphy-Hoye, Mark Baloga, Paul Noll, Joe Branc, and Nicolas De Benoist. 2010. What do you bring to the table?: investigations of a collaborative workspace. 183--192.
[49]
Mark J Perry and Kenton O'Hara. 2003. Display-Based Activity in the Workplace. In INTERACT.
[50]
Salil Pradhan. 2000. Semantic Location. Personal Ubiquitous Comput. 4, 4 (Jan. 2000), 213--216.
[51]
Roman Rädle, Hans-Christian Jetter, Jonathan Fischer, Inti Gabriel, Clemens N. Klokmose, Harald Reiterer, and Christian Holz. 2018. PolarTrack: Optical Outside-In Device Tracking That Exploits Display Polarization. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 497, 9 pages.
[52]
Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-Hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). Association for Computing Machinery, New York, NY, USA, 45--54.
[53]
Stuart Reeves, Steve Benford, Claire O'Malley, and Mike Fraser. 2005. Designing the Spectator Experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). Association for Computing Machinery, New York, NY, USA, 741--750.
[54]
Yvonne Rogers. 2006. Moving on from Weiser's vision of calm computing: Engaging ubicomp experiences. In International conference on Ubiquitous computing. Springer, 404--421.
[55]
Maurício Sousa, Daniel Mendes, Rafael Kuffner Dos Anjos, Daniel Medeiros, Alfredo Ferreira, Alberto Raposo, João Madeiras Pereira, and Joaquim Jorge. 2017. Creepy Tracker Toolkit for Context-Aware Interfaces. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). Association for Computing Machinery, New York, NY, USA, 191--200.
[56]
Alexandros Stylianidis, Jo Vermeulen, Steven Houben, Lindsay MacDonald, and Russell Beale. 2017. SenseBelt: A Belt-Worn Sensor to Support Cross-Device Interaction. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 2123--2131.
[57]
Josephine Raun Thomsen, Peter Gall Krogh, Jacob Albundefinedk Schnedler, and Hanne Linnet. 2018. Interactive Interior and Proxemics Thresholds: Empowering Participants in Sensitive Conversations. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 68, 12 pages.
[58]
Roy Want. 2004. Enabling ubiquitous sensing with RFID. Computer 37, 4 (2004), 84--86.
[59]
Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, above and between Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). Association for Computing Machinery, New York, NY, USA, 273--282.
[60]
Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 3929--3942.
[61]
John Zimmerman, Erik Stolterman, and Jodi Forlizzi. 2010. An Analysis and Critique of Research Through Design: Towards a Formalization of a Research Approach. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10). ACM, NY, NY, USA, 310--319.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
10688 pages
ISBN:9781450367080
DOI:10.1145/3313831
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. ad hoc collaboration
  2. cross-device interaction
  3. interaction proxemics
  4. proximity sensing
  5. sensing systems

Qualifiers

  • Research-article

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)204
  • Downloads (Last 6 weeks)16
Reflects downloads up to 15 Sep 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media