research-article

Extending a mobile device's interaction space through body-centric interaction

Authors:

Xiang 'Anthony' Chen,

Nicolai Marquardt,

Sebastian Boring,

Saul GreenbergAuthors Info & Claims

MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

Pages 151 - 160

https://doi.org/10.1145/2371574.2371599

Published: 21 September 2012 Publication History

Abstract

Modern mobile devices rely on the screen as a primary input modality. Yet the small screen real-estate limits interaction possibilities, motivating researchers to explore alternate input techniques. Within this arena, our goal is to develop Body-Centric Interaction with Mobile Devices: a class of input techniques that allow a person to position and orient her mobile device to navigate and manipulate digital content anchored in the space on and around the body. To achieve this goal, we explore such interaction in a bottom-up path of prototypes and implementations. From our experiences, as well as by examining related work, we discuss and present three recurring themes that characterize how these interactions can be realized. We illustrate how these themes can inform the design of Body-Centric Interactions by applying them to the design of a novel mobile browser application. Overall, we contribute a class of mobile input techniques where interactions are extended beyond the small screen, and are instead driven by a person's movement of the device on and around the body.

Supplementary Material

MP4 File (fp0137-file3.mp4)

Download
46.84 MB

References

[1]

Ängeslevä, J., Oakley, I., Hughes, S., and O'Modhrain, S. Body Mnemonics. Mobile HCI Conference, ACM (2003), 15--22.

[2]

Baddeley, A. D. and Hitch, G. J. Developments in the concept of working memory. Neuropsychology 8, 4 (1994), 485--493.

[3]

Benford, S. and Fahlén, L. A spatial model of interaction in large virtual environments. Kluwer Academic, Dordrecht, 199

[4]

Cohn, G., Morris, D., Patel, S. N., and Tan, D. S. Your noise is my command. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, (2011), 791.

Digital Library

[5]

Elias, L. J. and Saucier, D. M. Neuropsychology: clinical and experimental foundations. Pearson/Allyn & Bacon, Boston, 2006.

[6]

Fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computers. Communications of the ACM 36, 7 (1993), 39--49.

Digital Library

[7]

Guerreiro, T., Gamboa, R., and Jorge, J. Mnemonical Body Shortcuts for Interacting with Mobile Devices. In M. Sales Dias, S. Gibet, M. M. Wanderley and R. Bastos, eds., Gesture-Based Human-Computer Interaction and Simulation. Springer Berlin Heidelberg, Berlin, Heidelberg, 2009, 261--271.

Digital Library

[8]

Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary interfaces. Proceedings of the 23nd annual ACM symposium on User interface software and technology - UIST '10, (2010), 3--12.

Digital Library

[9]

Gustafson, S., Holz, C., and Baudisch, P. Imaginary Phone. Symposium on User Interface Software and Technology, (2011), 10--19.

[10]

Hall, E. T. Proxemics. Current Anthropology 9, 2/3, (1968), 83--108.

[11]

Harrison, C., Tan, D., and Morris, D. Skinput. Proceedings of the 28th international conference on Human factors in computing systems - CHI '10, (2010), 453--462.

Digital Library

[12]

Holmes, N. P. and Spence, C. The body schema and multisensory representation(s) of peripersonal space. Cognitive Processing 5, 2 (2004), 94--105.

[13]

Ishii, H. and Ullmer, B. Tangible bits. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '97, (1997), 234--241.

Digital Library

[14]

Li, F. C. Y., Dearman, D., and Truong, K. N. Virtual shelves. Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09, (2009), 125.

Digital Library

[15]

Marquardt, N., Diaz-Marino, R., Boring, S., and Greenberg, S. The proximity toolkit. Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11, ACM Press (2011), 315.

Digital Library

[16]

Mistry, P. and Maes, P. SixthSense. ACM SIGGRAPH ASIA 2009 Sketches on - SIGGRAPH ASIA '09, (2009), 1.

Digital Library

[17]

Norman, D. A. Affordance, conventions, and design. interactions 6, 3 (1999), 38--43.

Digital Library

[18]

Post, E. R. and Orth, M. Smart fabric, or "wearable clothing." Digest of Papers. First International Symposium on Wearable Computers, (1997), 167--168.

Digital Library

[19]

Proske, U. and Gandevia, S. C. The kinaesthetic senses. The Journal of Physiology 587, 17 (2009), 4139--4146.

[20]

Rico, J. and Brewster, S. Usable gestures for mobile interfaces. ACM Press (2010), 887.

[21]

Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. Enabling always-available input with muscle-computer interfaces. ACM Press (2009), 167.

[22]

Shoemaker, G., Tang, A., and Booth, K. S. Shadow reaching. Proceedings of the 20th annual ACM symposium on User interface software and technology - UIST '07, (2007), 53.

Digital Library

[23]

Shoemaker, G., Tsukitani, T., Kitamura, Y., and Booth, K. S. Body-centric interaction techniques for very large wall displays. Proceedings of the 6th Nordic Conference on Human-Computer Interaction Extending Boundaries - NordiCHI '10, (2010), 463.

Digital Library

[24]

Strachan, S., Murray-Smith, R., and O'Modhrain, S. BodySpace. CHI '07 extended abstracts on Human factors in computing systems - CHI '07, (2007), 2001.

[25]

Tan, D. S., Pausch, R., Stefanucci, J. K., and Proffitt, D. R. Kinesthetic cues aid spatial memory. CHI '02 extended abstracts on Human factors in computing systems - CHI '02, (2002), 806.

Digital Library

[26]

Tan, D. S., Stefanucci, J. K., Proffitt, D. R., and Pausch, R. The Infocockpit. Proceedings of the 2001 workshop on Percetive user interfaces - PUI '01, (2001), 1.

[27]

Tarun, A. P., Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. Snaplet. Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems - CHI EA '11, (2011), 329.

[28]

Yee, K.-P. Peephole displays. Proceedings of the conference on Human factors in computing systems - CHI '03, (2003), 1.

Digital Library

Cited By

Zhou QSyiem BLi BGoncalves JVelloso E(2024)Reflected RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314317:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631431
Mi TWang JChan L(2023)LapTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108787:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610878
Müller FSchmitt DMatviienko ASchön DGünther SKosch TSchmitz M(2023)TicTacToes: Assessing Toe Movements as an Input ModalityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580954(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580954
Show More Cited By

Index Terms

Extending a mobile device's interaction space through body-centric interaction
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Body-centric interaction with mobile devices
TEI '12: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction

Most current mobile technologies require on-screen operations for interacting with devices' visual contents. However, as a trade-off for mobility, screens usually provide limited space for interactions. To address this problem, I explore Body-Centric ...
Mobile-based tangible interaction techniques for shared displays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

This tutorial explores the possibility of using touchscreen-based mobile devices as active tangibles on an interactive tabletop surface. The tutorial starts with an open discussion about various aspects of tangible interaction, including an overview of ...
Mobile interaction with the real world
MobileHCI '06: Proceedings of the 8th conference on Human-computer interaction with mobile devices and services

The main goal of the workshop is to discuss approaches that use a mobile device (e.g. mobile phone, smartphone, PDA) for interactions with objects in the real world. Relevant topics include (but are not limited to) mobile interaction with the real world;...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

September 2012

468 pages

ISBN:9781450311052

DOI:10.1145/2371574

General Chairs:
Elizabeth Churchill
Designing Associates, USA
,
Sriram Subramanian
University of Bristol, UK
,
Program Chairs:
Patrick Baudisch
Hasso Plattner Institute, Germany
,
Kenton O'Hara
Microsoft Research, Cambridge, UK

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '12

Sponsor:

SIGCHI

MobileHCI '12: 14th International Conference on Human Computer Interaction with Mobile Devices and Services

September 21 - 24, 2012

California, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
1,227
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhou QSyiem BLi BGoncalves JVelloso E(2024)Reflected RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314317:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631431
Mi TWang JChan L(2023)LapTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108787:3(1-23)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610878
Müller FSchmitt DMatviienko ASchön DGünther SKosch TSchmitz M(2023)TicTacToes: Assessing Toe Movements as an Input ModalityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580954(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580954
Yeo HWu EKim DLee JKim HOh STakagi LWoo WKoike HQuigley A(2023)OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional CameraProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580747(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580747
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Sathya ALi JRahman TGao GPeng H(2022)CalicoProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503236:3(1-32)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550323
Ye HLee CWu TYang XChen BLiang R(2022)Body-Centric NFC: Body-Centric Interaction with NFC Devices Through Near-Field Enabled ClothingProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3534569(1626-1639)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3534569
Brasier EPietriga EAppert C(2021)AR-enhanced Widgets for Smartphone-centric InteractionProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472019(1-12)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472019
Danyluk KEns BJenny BWillett WKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)A Design Space Exploration of Worlds in MiniatureProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445098(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445098
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents