article

Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback

Authors:

J. LooserAuthors Info & Claims

International Journal of Human-Computer Studies, Volume 69, Issue 6

Pages 401 - 414

https://doi.org/10.1016/j.ijhcs.2011.02.005

Published: 01 June 2011 Publication History

Abstract

Sensing technologies such as inertia tracking and computer vision enable spatial interactions where users make selections by 'air pointing': moving a limb, finger, or device to a specific spatial region. In addition of expanding the vocabulary of possible interactions available, air pointing brings the potential benefit of enabling 'eyes-free' interactions, where users rely on proprioception and kinaesthesia rather than vision. This paper explores the design space for air pointing interactions, and presents tangible results in the form of a framework that helps designers understand input dimensions and resulting interaction qualities. The framework provides a set of fundamental concepts that aid in thinking about the air pointing domain, in characterizing and comparing existing solutions, and in evaluating novel techniques. We carry out an initial investigation to demonstrate the concepts of the framework by designing and comparing three air pointing techniques: one based on small angular 'raycasting' movements, one on large movements across a 2D plane, and one on movements in a 3D volume. Results show that large movements on the 2D plane are both rapid (selection times under 1s) and accurate, even without visual feedback. Raycasting is rapid but inaccurate, and the 3D volume is expressive but slow, inaccurate, and effortful. Many other findings emerge, such as selection point 'drift' in the absence of feedback. These results and the organising framework provide a foundation for innovation and understanding of air pointing interaction.

References

[1]

Short report: is spatial information encoded automatically?. Quarterly Journal of Experimental Psychology. v46A. 365-375.

[2]

&#237;***ngeslev&#228;, J., Oakley, I., Hughes, S., O'Modhrain, S., 2003. Body mnemonics: portable device interaction design concept. In: Adjunct Proceedings of the UIST 2003: ACM Symposium on User Interface Software and Technology, Vancouver, CanadaACM Press.

[3]

Charade: remote control of objects using free-hand gestures. Communications of the ACM. v36 i7. 28-35.

Digital Library

[4]

Bolt, R.A., 1980. Put-that-there: voice and gesture at the graphics interface. In: Proceedings of the Seventh Annual Conference on Computer Graphics and Interactive Techniques, Seattle, Washington, United States, pp. 262-270.

Digital Library

[5]

Bowman, D.A., Johnson, D.B., Hodges, L.F., 1999. Testbed evaluation of virtual environment interaction techniques. In: Virtual Reality Software and Technology, ACM Press, London, pp. 26-33.

Digital Library

[6]

3D User Interfaces: Theory and Practice. Addison-Wesley, Boston, MA.

Digital Library

[7]

Brewster, S., Brown, L.M., Tactons: structured tactile messages for non-visual information display. In: Proceedings of the Fifth Conference on Australasian user Interface, vol. 28, Dunedin, New Zealand, 2004. Australian Computer Society, Inc., Conference Paper, 976313. pp. 15-23.

Digital Library

[8]

Brewster, S., Lumsden, J., Bell, M., Hall, M., Tasker, S., 2003. Multimodal 'eyes-free' interaction techniques for wearable devices. In: Proceedings of the CHI'03: Conference on Human Factors in Computing Systems, Ft. Lauderdale, Florida, ACM, pp. 473-480.

Digital Library

[9]

Brewster, S., Wright, P., Edwards, A., 1993. An evaluation of earcons for use in auditory human-computer interfaces. In: Proceedings of the INTERCHI'93 Conference on Human Factors in Computing Systems, Amsterdam, pp. 222-227.

Digital Library

[10]

Cao, X., Li, J., Balakrishnan, R., 2008. Peephole pointing: modeling acquisition of dynamically revealed targets. In: Proceedings of the CHI'08: ACM Conference on Human Factors in Computing Systems, Florence, Italy, ACM Press, pp. 1699-1708.

Digital Library

[11]

Cockburn, A., Gutwin, C., Alexander, J., 2006. Faster document navigation with space-filling thumbnails. In: Proceedings of the CHI'06 ACM Conference on Human Factors in Computing Systems, Montreal, Canada, ACM Press, pp. 1-10.

Digital Library

[12]

Cockburn, A., Gutwin, C., Greenberg, S., 2007. A predictive model of menu performance. In: Proceedings of the CHI'07: ACM Conference on Human Factors in Computing Systems, San Jose, CA, ACM Press, pp. 627-636.

Digital Library

[13]

Crossman, E., Goodeve, P., 1963/1983. Feedback control of hand-movement and Fitts' Law. Paper presented at the meeting of the Experimental Psychological Society, Oxford, July, 1963. Reprinted in Quarterly Journal of Experimental Psychology 35A, 251-278.

[14]

Czerwinski, M., van Dantzich, M., Robertson, G., Hoffman, H., 1999. The contribution of thumbnail image, mouse-over text and spatial location memory to web page retrieval in 3D. In: Proceedings of the Interact '99, Edinburgh, Scotland, IOS press, pp. 163-170.

[15]

Object-array structure, frames of reference, and retrieval of spatial knowledge. Journal of Experimental Psychology: Learning, Memory, and Cognition. v21 i2. 483-500.

[16]

Assaying, isolating, and accommodating individual differences in learning a complex skill. In: Dillon, R. (Ed.), Individual Differences in Cognition, pp. 173-217.

[17]

The role of target information on manual-aiming bias. Psychological Research. v58 i1. 2-9.

[18]

The influence of premovement visual information on manual aiming. Quarterly Journal of Experimental Psychology. v39A i3. 541-559.

[19]

Videogames and spatial skills: an exploratory study. Educational Communication and Technology. v33 i4. 263-275.

[20]

Grossman, T., Balakrishnan, R., 2004. Pointing at trivariate targets in 3D environments. In: Proceedings of the CHI'04: ACM Conference on Human Factors in Computing Systems, pp. 447-454.

Digital Library

[21]

Grossman, T., Balakrishnan, R., 2006. The design and evaluation of selection techniques for 3D volumetric displays. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, Montreux, Switzerland, ACM Press, pp. 3-12.

Digital Library

[22]

Harbluk, J., Noy, Y., 2002. The Impact of Cognitive Distraction on Driver Visual Behaviour and Vehicle Control. Transport Canada. Ergonomics Division of the Road Safety Directorate and Motor Vehicle Regulation Directorate.

[23]

Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P., Meshkati, N. (Eds.), Human Mental Workload, pp. 139-183.

[24]

Hinckley, K., Pausch, R., Goble, J., Kassell, N., 1994. A survey of design issues in spatial input. In: Proceedings of the UIST'94 Symposium on User Interface Software and Technology, California, pp. 213-222.

Digital Library

[25]

Proprioceptive guidance and motor planning of reaching movements to unseen targets. Experimental Brain Research. v95. 349-358.

[26]

VideoPlace and the interface of the future. In: B., Laurel (Ed.), The Art of Human Computer Interface, Addison Wesley. pp. 417-422.

[27]

Kurtenbach, G., Buxton, W., 1994. User learning and performance with marking menus. In: Proceedings of the CHI'94 Conference on Human Factors in Computing Systems, Boston, April 24-28, pp. 258-264.

Digital Library

[28]

An empirical evaluation of some articulatory and cognitive aspects of marking menus. Human-Computer Interaction. v8 i1. 1-23.

Digital Library

[29]

Preface to the special section on driver distraction. Human Factors. v46 i4. 583-586.

[30]

Li, F., Dearman, D., Troung, K., 2009. Virtual shelves: interactions with orientation aware devices. In: Proceedings of the UIST 2009: The 22nd Annual ACM Symposium on User Interface Software and Technology, Victoria, Canada, ACM Press.

Digital Library

[31]

Li, K., Baudisch, P., Hinckley, K., 2008. BlindSight: eyes-free access to mobile phones. In: Proceedings of the CHI'08: ACM Conference on Human Factors in Computing Systems, Florence, Italy, ACM Press, pp.1389-1398.

Digital Library

[32]

Pointing to remembered visual targets after active one-step self-displacements within reaching space. Experimental Brain Research. v125. 50-61.

[33]

Mine, M.R., Brooks Jr., F.P., Sequin, C.H., 1997. Moving objects in space: exploiting proprioception in virtual-environment interaction. In: Proceedings of the International Conference on Computer Graphics and Interactive Techniques, pp. 19-26.

Digital Library

[34]

Myers, B., Bhatnagar, R., Nichols, J., Peck, C., Kong, D., Miller, R., Long, C., 2002. Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings of the CHI'02: ACM Conference on Human Factors in Computing Systems, Minneapolis, Minnesota, ACM Press, pp. 33-40.

Digital Library

[35]

NASA, 1995. Man-Systems Integration Standards. Revision B. NASA.

[36]

Coding of spatial location information: an automatic process?. Journal of Experimental Psychology: Learning, Memory, and Cognition. v13 i4. 595-605.

[37]

Mechanisms of skill acquisition and the law of practice. In: Anderson, J. (Ed.), Cognitive Skills and their Acquisition, Erlbaum, Hillsdale, NJ. pp. 1-55.

[38]

Oakley, I., Park, J., 2007. Designing eyes-free interaction. In: Proceedings of the Second International Workshop on Haptics and Audio Interaction Design, HAID 2007, Seoul, South Korea, Springer Berlin, Lecture Notes in Computer Science, pp. 121-132.

Digital Library

[39]

Pierce, J.S., Forsberg, A.S., Conway, M.J., Hong, S., Zeleznik, R.C., Mine, M.R., 1997. Image plane interaction techniques in 3D immersive environments. In: Proceedings of the 1997 Symposium on Interactive 3D graphics, Providence, Rhode Island, United States, ACM, pp. 39-43.

Digital Library

[40]

What was where? Memory for object locations. Quarterly Journal of Experimental Psychology. v49A i1. 178-199.

[41]

A framework and testbed for studying manipulation techniques for immersive VR. Virtual Reality Software and Technology. 21-28.

Digital Library

[42]

Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques. Computer Graphics Forum. v17 i3. 41-52.

[43]

Optimal response of eye and hand motor systems in pointing at a visual target. Biological Cybernetics. v35. 113-124.

[44]

Maximum reach envelope for the seated and standing male and female for industrial workstation design. Ergonomics. v43 i9. 1390-1404.

[45]

On the proprio-ceptive system, especially in its reflex aspect. Brain. v29 i4. 483-486.

[46]

Sensorimotor representations for pointing to targets in three-dimensional space. Journal of Neurophysiology. v52. 582-594.

[47]

Steed, A., 2006. Towards a general model for selection in virtual environments. In: Proceedings of the IEEE Symposium on 3D User Interfaces, Alexandria, Virginia, USA, pp. 103-110.

Digital Library

[48]

Is continuous visual monitoring necessary in visually guided locomotion?. Journal of Experimental Psychology: Human Perception and Performance. v9. 427-443.

[49]

Assaying and isolating individual differences in searching a hierarchical file system. Human Factors. v29 i3. 349-359.

Digital Library

[50]

Vogel, D., Balakrishnan, R., 2005. Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the UIST'05: ACM Symposium on User Interface Software and Technology, Seattle, WA, ACM Press, pp. 33-42.

Digital Library

[51]

Wilson, A., Shafer, S., 2003. XWand: UI for intelligent spaces. In: Proceedings of the CHI'2003 Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida, pp. 545-552.

Digital Library

[52]

Exploring Individual Differences in Raybased Selection: Strategies and Traits. IEEE Virtual Reality, Bonn, Germany.

Digital Library

[53]

The wiimote and beyond: spatially convenient devices for 3D user interfaces. IEEE Computer Graphics and Applications. v30 i2. 71-85.

Digital Library

[54]

Wobbrock, J., Cutrell, E., Harada, S., MacKenzie, I., 2008. An error model for pointing based on Fitts' law. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, ACM, pp.1613-1622.

Digital Library

[55]

Wobbrock, J., Myers, B., Kembel, J., 2003. EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion. In: Proceedings of the 16th Annual ACM symposium on User Interface Software and Technology, Vancouver, Canada, ACM Press, pp. 61-70.

Digital Library

[56]

The accuracy of voluntary movement. Psychological Review (Monograph Supplement). v3. 1-119.

[57]

Yee, K., 2003. Peephole displays: pen interaction on spatially aware handheld computers. In: Proceedings of the CHI'03: ACM Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida, ACM Press, pp. 1-8.

Digital Library

[58]

User performance in relation to 3D input device design. Computer Graphics. v32 i4. 50-54.

Digital Library

[59]

Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., Baudisch, P., 2007. earPod: eyes-free menu selection using touch input and reactive audio feedback. In: Proceedings of the CHI 07: ACM Conference on Human Factors in Computing Systems, San Jose, California, USA, ACM, pp. 1395-1404.

Digital Library

Cited By

Faleel SSodhi RIrani P(2024)Comparison of Unencumbered Interaction Technique for Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981468:ISS(500-516)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698146
Chidambaram SWilliams ABai MVirk SHaffner PLease MLi E(2024)Annorama: Enabling Immersive At-Desk Annotation Experiences in Virtual Reality with 3D Point Cloud DioramasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682081(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682081
Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Show More Cited By

Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback
1. Human-centered computing

Recommendations

MagicPAPER: Tabletop Interactive Projection Device Based on Kraft Paper
ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

As the most common writing material in our daily life, paper is an important carrier of traditional painting, and it also has a more comfortable physical touch than electronic screens. In this study, we designed a shadow-art device for human-computer ...
MagicPAPER: An Integrated Shadow-Art Hardware Device Enabling Touch Interaction on Paper
DIS '18 Companion: Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems

Touch interaction is usually implemented on a computer screen or a projected surface. However, tactile quality of paper is attractive and intuitive for people to manipulate in traditional paintings and storytelling. In order to enable touch interaction ...
Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Eyes-free target acquisition is a basic and important human ability to interact with the surrounding physical world, relying on the sense of space and proprioception. In this research, we leverage this ability to improve interaction in virtual reality (...

Comments

Information & Contributors

Information

Published In

cover image International Journal of Human-Computer Studies

International Journal of Human-Computer Studies Volume 69, Issue 6

June, 2011

106 pages

ISSN:1071-5819

Issue’s Table of Contents

Copyright © Elsevier Ltd © 2011.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 June 2011

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

52
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Faleel SSodhi RIrani P(2024)Comparison of Unencumbered Interaction Technique for Head-Mounted DisplaysProceedings of the ACM on Human-Computer Interaction10.1145/36981468:ISS(500-516)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698146
Chidambaram SWilliams ABai MVirk SHaffner PLease MLi E(2024)Annorama: Enabling Immersive At-Desk Annotation Experiences in Virtual Reality with 3D Point Cloud DioramasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682081(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682081
Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Pei SKim DOlwal AZhang YDu R(2024)UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self EntitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642220(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642220
Nath PDelamare WHasan K(2024)PalmSpaceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103219184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103219
Palmeira ECampos AMoraes Íde Siqueira AFerreira M(2023)Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject StudyProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625046(274-278)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625046
Henderson JNeshati AMizobuchi SZhou WVogel DLank E(2023)Interaction Region Characteristics for Midair Barehand Targeting on a TelevisionExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585877(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585877
Streli PArmani RCheng YHolz C(2023)HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction using Inertial SensingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581468(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581468
Reynaert VRekik YBerthaut FGrisoni L(2023)The effect of hands synchronicity on users perceived arms Fatigue in Virtual reality environmentInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103092178:COnline publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103092
Adhanom IMacNeilage PFolmer E(2023)Eye Tracking in Virtual Reality: a Broad Review of Applications and ChallengesVirtual Reality10.1007/s10055-022-00738-z27:2(1481-1505)Online publication date: 18-Jan-2023
https://dl.acm.org/doi/10.1007/s10055-022-00738-z
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents