research-article

Mobile pointing task in the physical world: balancing focus and performance while disambiguating

Authors:

William Delamare,

Céline Coutrix,

Laurence NigayAuthors Info & Claims

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

Pages 89 - 98

https://doi.org/10.1145/2493190.2493232

Published: 27 August 2013 Publication History

Abstract

We address the problem of mobile distal selection of physical objects when pointing at them in augmented environments. We focus on the disambiguation step needed when several objects are selected with a rough pointing gesture. A usual disambiguation technique forces the users to switch their focus from the physical world to a list displayed on a handheld device's screen. In this paper, we explore the balance between change of users' focus and performance. We present two novel interaction techniques allowing the users to maintain their focus in the physical world. Both use a cycling mechanism, respectively performed with a wrist rolling gesture for P2Roll or with a finger sliding gesture for P2Slide. A user experiment showed that keeping users' focus in the physical world outperforms techniques that require the users to switch their focus to a digital representation distant from the physical objects, when disambiguating up to 8 objects.

Supplementary Material

JPG File (fp0300-file3.jpg)

Download
8.79 KB

suppl.mov (fp0300-file3.m4v)

Supplemental video

Download
15.20 MB

References

[1]

Ailisto, H., Pohjanheimo, L., Välkkynen, P., Strömmer, E., Tuomisto, T., and Korhonen, I. Bridging the physical and virtual worlds by local connectivity-based physical selection. Personal and Ubiquitous Computing 10, 6 (2006), 333--344.

Digital Library

[2]

Balakrishnan, R. and MacKenzie, I. S. Performance differences in the fingers, wrist, and forearm in computer input control. Proc. CHI '97, ACM (1997), 303--310.

Digital Library

[3]

Balakrishnan, R. "Beating" Fitts' law: virtual enhancements for pointing facilitation. International Journal of Human-Computer Studies 61, 6 (2004), 857--874.

Digital Library

[4]

Bérard, F. and Rochet-Capellan, A. Measuring the linear and rotational user precision in touch pointing. Proc. ITS '12, ACM (2012), 183--192.

Digital Library

[5]

Blanch, R. and Ortega, M. Rake Cursor: Improving Pointing Performance with Concurrent Input Channels. Proc. CHI '09, ACM (2009), 1415--1418.

Digital Library

[6]

Card, S. K., Mackinlay, J. D., and Robertson, G. G. A morphological analysis of the design space of input devices. ACM TOIS 9, 2 (1991), 99--122.

Digital Library

[7]

Davis, B. J. and O'Connell, J. Shoulder, Elbow and Wrist Components of Physiologic Tremor Amplitudeas Measured Using a Laser Penlight. European Neurology 43, 3 (2000), 152--154.

[8]

Delamare, W., Coutrix, C., and Nigay, L. Designing Disambiguation Techniques for Pointing in the Physical World. Proc. EICS '13, (2013). To appear.

Digital Library

[9]

Feiner, A. The flexible pointer: An interaction technique for selection in augmented and virtual reality. Proc. UIST '03, ACM (2003), 81--82.

[10]

Forsberg, A., Herndon, K., and Zeleznik, R. Aperture based selection for immersive virtual environments. Proc. UIST '96, ACM (1996), 95--96.

Digital Library

[11]

Grossman, T. and Balakrishnan, R. The design and evaluation of selection techniques for 3D volumetric displays. Proc. UIST '06, ACM (2006), 3--12.

Digital Library

[12]

König, W., Gerken, J., Dierdorf, S., et al. Adaptive Pointing - Design and Evaluation of a Precision Enhancing Technique for Absolute Pointing Devices. Proc. INTERACT '09, Springer (2009), 658--671.

Digital Library

[13]

Kopper, R., Bowman, D. a., Silva, M. G., et al. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies 68, 10 (2010), 603--615.

Digital Library

[14]

De la O Chávez, F., Fernández de Vega, F., Olague, G., et al. An independent and non-intrusive laser pointer environment control device system. Proc. ICPS '08, ACM (2008), 37--46.

Digital Library

[15]

Myers, B. A., Bhatnagar, R., Nichols, J., et al. Interacting at a distance: measuring the performance of laser pointers and other devices. Proc. CHI '02, ACM (2002), 33--40.

Digital Library

[16]

Patel, S. and Abowd, G. A 2-way laser-assisted selection scheme for handhelds in a physical environment. Proc. UbiComp '03, Springer (2003), 200--207.

[17]

Pook, S., Lecolinet, E., Vaysseix, G., and Barillot, E. Control menus: excecution and control in a single interactor. Extended Abstracts CHI '00, ACM (2000), 263--264.

Digital Library

[18]

Qin, Y., Shi, Y., Jiang, H., et al. Structured laser pointer: enabling wrist-rolling movements as a new interactive dimension. Proc. AVI '10, ACM (2010), 163--166.

Digital Library

[19]

Rahman, A. S. M. M., Hossain, M. A., and Saddik, A. El. Spatial-geometric approach to physical mobile interaction based on accelerometer and IR sensory data fusion. ACM TOMCCAP 6, 4 (2010), 1--23.

Digital Library

[20]

Rahman, M., Gustafson, S., Irani, P., et al. Tilt techniques: Investigating the Dexterity of Wrist-based Input. Proc. CHI '09, ACM (2009), 1943--1952.

Digital Library

[21]

Raskar, R., Beardsley, P., Van Baar, J., et al. RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors. ACM TOG 23, 3 (2004), 406--415.

Digital Library

[22]

Rohs, M., Oulasvirta, A., and Suomalainen, T. Interaction with magic lenses: real-world validation of a fitts' law model. Proc. CHI '11, ACM (2011), 2725--2728.

Digital Library

[23]

Rohs, M. and Oulasvirta, A. Target acquisition with camera phones when used as magic lenses. Proc. CHI '08, ACM (2008), 1409--1418.

Digital Library

[24]

Rohs, M., Schleicher, R., Schöning, J., et al. Impact of item density on the utility of visual context in magic lens interactions. Personal and Ubiquitous Computing 13, 8 (2009), 633--646.

Digital Library

[25]

Rukzio, E., Broll, G., Leichtenstern, K., et al. Mobile interaction with the real world: An evaluation and comparison of physical mobile interaction techniques. Proc. AmI '07, Springer (2007), 1--18.

Digital Library

[26]

Ryan, T. N., McMahan, P., and Bowman, D. A. Tech-note: rapMenu: Remote Menu Selection Using Freehand Gestural Input. Proc. 3DUI '08, IEEE (2008), 55--58.

Digital Library

[27]

Schmidt, D., Molyneaux, D., and Cao, X. PICOntrol: using a handheld projector for direct control of physical devices through visible light. Proc. UIST '12 2, ACM (2012), 379--388.

Digital Library

[28]

Scoditti, A., Vincent, T., Coutaz, J., et al. TouchOver: decoupling positioning from selection on touch-based handheld devices. Proc. IHM '11, ACM (2011), 1--4.

Digital Library

[29]

Swindells, C., Inkpen, K. M., Dill, J. C., et al. That one there! Pointing to establish device identity. Proc. UIST '02, ACM (2002), 151--160.

Digital Library

[30]

Talsma, D., Senkowski, D., Soto-Faraco, S., et al. The multifaceted interplay between attention and multisensory integration. Trends in cognitive sciences 14, 9 (2010), 400--410.

[31]

Välkkynen, P., Niemelä, M., and Tuomisto, T. Evaluating touching and pointing with a mobile terminal for physical browsing. Proc. NordiCHI '06, ACM (2006), 28--37.

Digital Library

[32]

Vernier, F. and Nigay, L. A framework for the combination and characterization of output modalities. Proc. of DSV-IS '00, Springer (2000), 32--48.

Digital Library

[33]

Vincent, T., Nigay, L., and Kurata, T. Precise pointing techniques for handheld Augmented Reality. Proc. INTERACT'13, (2013). To appear.

[34]

Wilson, A. and Pham, H. Pointing in intelligent environments with the worldcursor. Proc. INTERACT '03, Springer (2003), 495--502.

[35]

Wobbrock, J. O., Myers, B. a., and Aung, H. H. The performance of hand postures in front- and back-of-device interaction for mobile computing. International Journal of Human-Computer Studies 66, 12 (2008), 857--875.

Digital Library

[36]

Zhai, S., Milgram, P., and Buxton, W. The influence of muscle groups on performance of multiple degree-of-freedom input. Proc. CHI '96, ACM Press (1996), 308--315.

Digital Library

Cited By

Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Ma JQian JZhou THuang J(2023)FocalPointProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808567:1(1-26)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580856
Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Show More Cited By

Index Terms

Mobile pointing task in the physical world: balancing focus and performance while disambiguating
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Impact of mobile tangible slider design and its reachability on pointing performance
IHM '16: Actes de la 28ième conference francophone sur l'Interaction Homme-Machine

Touch interaction is almost omnipresent on mobile devices and technological advances have made screens bigger. The users can then interact with more content displayed on screen but it is more difficult for the users to reach all the parts of the screen ...
Mobile interaction with the real world
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services

The Mobile HCI community is moving beyond the interaction between a single user and her mobile device taking the users environment into account. Mobile interaction with the real world concentrates on using mobile devices as tools to interact with real ...
Designing disambiguation techniques for pointing in the physical world
EICS '13: Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems

Several ways for selecting physical objects exist, including touching and pointing at them. Allowing the user to interact at a distance by pointing at physical objects can be challenging when the environment contains a large number of interactive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

August 2013

662 pages

ISBN:9781450322737

DOI:10.1145/2493190

General Chairs:
Michael Rohs
University of Hannover, Germany
,
Albrecht Schmidt
University of Stuttgart, Germany
,
Program Chairs:
Daniel Ashbrook
Samsung, USA
,
Enrico Rukzio
University of Ulm, Germany and Lancaster University, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 August 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '13

Sponsor:

SIGCHI

MobileHCI '13: 15th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 27 - 30, 2013

Munich, Germany

Acceptance Rates

MobileHCI '13 Paper Acceptance Rate 53 of 238 submissions, 22%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
309
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Alghofaili RSendhilnathan NZhang TGrossman TGlueck MJonker TLafreniere B(2024)Interactive Mediation Techniques for Error-Aware Gesture Input SystemsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670964(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670964
Ma JQian JZhou THuang J(2023)FocalPointProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808567:1(1-26)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580856
Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Sun MCao MWang LQian Q(2020)PhoneCursor: Improving 3D Selection Performance With Mobile Device in ARIEEE Access10.1109/ACCESS.2020.29860378(70616-70626)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2986037
Baloup MPietrzak TCasiez GBrewster SFitzpatrick GCox AKostakos V(2019)RayCursorProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300331(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300331
Baloup MOudjail VPietrzak TCasiez GKubicki SGirard PCalvary GLavoué E(2018)Pointing techniques for distant targets in virtual realityProceedings of the 30th Conference on l'Interaction Homme-Machine10.1145/3286689.3286696(100-107)Online publication date: 23-Oct-2018
https://dl.acm.org/doi/10.1145/3286689.3286696
Freeman EBrewster SLantz VKaye JDruin ALampe CMorris DHourcade J(2016)Do That, ThereProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858308(2319-2331)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858308
Delamare WCoutrix CNigay LZiegler JNebeling MNigay L(2015)Designing guiding systems for gesture-based interactionProceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/2774225.2774847(44-53)Online publication date: 23-Jun-2015
https://dl.acm.org/doi/10.1145/2774225.2774847
Magnusson CRassmus-Gröhn KSzymczak DRoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)Exploring historyProceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2639245(69-78)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2639245

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents