research-article

Understanding shortcut gestures on mobile touch devices

Authors:

Benjamin Poppinga,

Alireza Sahami Shirazi,

Susanne BollAuthors Info & Claims

MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

Pages 173 - 182

https://doi.org/10.1145/2628363.2628378

Published: 23 September 2014 Publication History

Abstract

Touch gestures become steadily more important with the ongoing success of touch screen devices. Compared to traditional user interfaces, gestures have the potential to lower cognitive load and the need for visual attention. However, nowadays gestures are defined by designers and developers and it is questionable if these meet all user requirements. In this paper, we present two exploratory studies that investigate how users would use unistroke touch gestures for shortcut access to a mobile phone's key functionalities. We study the functions that users want to access, the preferred activators for gesture execution, and the shapes of the user-invented gestures. We found that most gestures trigger applications, letter-shaped gestures are preferred, and the gestures should be accessible from the lock screen, the wallpaper, and the notification bar. We conclude with a coherent, unambiguous set of gestures for the 20 most frequently accessed functions, which can inform the design of future gesture-controlled applications.

References

[1]

Anthony, L., Brown, Q., Nias, J., and Tate, B. Examining the need for visual feedback during gesture interaction on mobile touchscreen devices for kids. In Proceedings of the 12th International Conference on Interaction Design and Children, IDC '13, ACM (2013), 157--164.

Digital Library

[2]

Anthony, L., and Wobbrock, J. O. $n-protractor: A fast and accurate multistroke recognizer. In Proceedings of Graphics Interface (2012), 117--120.

Digital Library

[3]

Appert, C., and Zhai, S. Using strokes as command shortcuts: Cognitive benefits and toolkit support. In Proceedings of CHI, ACM (2009), 2289--2298.

Digital Library

[4]

Billinghurst, M. Gesture based interaction. In Haptic input, B. Buxton, Ed. Cambridge University Press, 2009.

[5]

Bolt, R. A. "put-that-there": Voice and gesture at the graphics interface. In Proceedings of SIGGRAPH, ACM (1980), 262--270.

Digital Library

[6]

Döring, T., Kern, D., Marshall, P., Pfeiffer, M., Schöning, J., Gruhn, V., and Schmidt, A. Gestural interaction on the steering wheel: Reducing the visual demand. In Proceedings of CHI, ACM (2011), 483--492.

Digital Library

[7]

Henze, N., Pielot, M., Poppinga, B., Schinke, T., and Boll, S. My app is an experiment: Experience from user studies in mobile app stores. Int. J. Mob. Hum. Comput. Interact. 3, 4 (Oct. 2011), 71--91.

Digital Library

[8]

Hinrichs, U., and Carpendale, S. Gestures in the wild: Studying multi-touch gesture sequences on interactive tabletop exhibits. In Proceedings of CHI, ACM (2011), 3023--3032.

Digital Library

[9]

Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. Paperphone: Understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proceedings of CHI, ACM (2011), 1303--1312.

Digital Library

[10]

Lee, J. C., Hudson, S. E., and Tse, E. Foldable interactive displays. In Proceedings of UIST, ACM (2008), 287--290.

Digital Library

[11]

Li, Y. Gesture search: A tool for fast mobile data access. In Proceedings of UIST, ACM (2010), 87--96.

Digital Library

[12]

Lü, H., and Li, Y. Gesture avatar: A technique for operating mobile user interfaces using gestures. In Proceedings of CHI, ACM (2011), 207--216.

Digital Library

[13]

Lü, H., and Li, Y. Gesture coder: A tool for programming multi-touch gestures by demonstration. In Proceedings of CHI, ACM (2012), 2875--2884.

Digital Library

[14]

Moyle, M., and Cockburn, A. Analysing mouse and pen flick gestures. In Proceedings of the SIGCHI-NZ Symposium On Computer-Human Interaction, ACM (2002), 19--24.

Digital Library

[15]

Nacenta, M. A., Kamber, Y., Qiang, Y., and Kristensson, P. O. Memorability of pre-designed and user-defined gesture sets. In Proceedings of CHI, ACM (2013), 1099--1108.

Digital Library

[16]

Ouyang, T., and Li, Y. Bootstrapping personal gesture shortcuts with the wisdom of the crowd and handwriting recognition. In Proceedings of CHI, ACM (2012), 2895--2904.

Digital Library

[17]

Roudaut, A., Bailly, G., Lecolinet, E., and Nigay, L. Leaf menus: Linear menus with stroke shortcuts for small handheld devices. In Human-Computer Interaction - INTERACT 2009, vol. 5726 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2009, 616--619.

Digital Library

[18]

Sahami Shirazi, A., Henze, N., Dingler, T., Pielot, M., Weber, D., and Schmidt, A. Large-scale assessment of mobile notifications. In Proceedings of CHI, ACM (2014), 3055--3064.

Digital Library

[19]

Schlömer, T., Poppinga, B., Henze, N., and Boll, S. Gesture recognition with a wii controller. In Proceedings of TEI, ACM (2008), 11--14.

Digital Library

[20]

Seyed, T., Burns, C., Costa Sousa, M., Maurer, F., and Tang, A. Eliciting usable gestures for multi-display environments. In Proceedings of ITS, ACM (2012), 41--50.

Digital Library

[21]

Tran, J. J., Trewin, S., Swart, C., John, B. E., and Thomas, J. C. Exploring pinch and spread gestures on mobile devices. In Proceedings of MobileHCI, ACM (2013), 151--160.

Digital Library

[22]

Wigdor, D., and Wixon, D. Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier, 2011.

Digital Library

[23]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proceedings of CHI, ACM (2009), 1083--1092.

Digital Library

[24]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. In Proceedings of UIST, ACM (2007), 159--168.

Digital Library

[25]

Wolf, K., McGee-Lennon, M., and Brewster, S. A study of on-device gestures. In Proceedings of MobileHCI, ACM (2012), 11--16.

Digital Library

[26]

Zhai, S., Kristensson, P. O., and Appert, C. Foundational Issues in Touch-Surface Stroke Gesture Design. Now Publishers Inc., Hanover, MA, USA, 2012.

Digital Library

Cited By

Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Lu TZheng HZhang TXu XGuo A(2024)InteractOut: Leveraging Interaction Proxies as Input Manipulation Strategies for Reducing Smartphone OveruseProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642317(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642317
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Show More Cited By

Index Terms

Understanding shortcut gestures on mobile touch devices
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones

While advances in mobile text entry enable smartphone users to type almost as fast as on hardware keyboards, text-heavy activities are still not widely adopted. One reason is the lack of shortcut mechanisms. In this article, we determine shortcuts for ...
Evaluating the placement of arm-worn devices for recognizing variations of dynamic hand gestures

Dynamic hand gestures have become increasingly popular as touch-free input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in their ...
Comparing the Placement of Two Arm-Worn Devices for Recognizing Dynamic Hand Gestures
MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

Dynamic hand gestures have become increasingly popular as an input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in the arm ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

September 2014

664 pages

ISBN:9781450330046

DOI:10.1145/2628363

Conference Chairs:
Aaron Quigley
University of St. Andrews, UK
,
Sara Diamond
OCAD University, Canada
,
Program Chairs:
Pourang Irani
University of Manitoba, Canada
,
Sriram Subramanian
University of Bristol, UK

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 September 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

MobileHCI '14

Sponsor:

SIGCHI

MobileHCI '14: 16th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 23 - 26, 2014

ON, Toronto, Canada

Acceptance Rates

MobileHCI '14 Paper Acceptance Rate 35 of 124 submissions, 28%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
682
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)2

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Lu TZheng HZhang TXu XGuo A(2024)InteractOut: Leveraging Interaction Proxies as Input Manipulation Strategies for Reducing Smartphone OveruseProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642317(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642317
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Pooripanyakun MWodehouse AMehnen J(2023)The role of interface configuration on performance accuracy in eyes-free touchscreen interactionUniversal Access in the Information Society10.1007/s10209-023-01057-zOnline publication date: 31-Oct-2023
https://doi.org/10.1007/s10209-023-01057-z
Costagliola GDe Rosa MFuccella V(2023)Gesture‐Based ComputingHandbook of Human‐Machine Systems10.1002/9781119863663.ch32(397-408)Online publication date: 7-Jul-2023
https://doi.org/10.1002/9781119863663.ch32
Aktar FMaurer F(2022)Elicitation of Interaction Techniques with 3D Data Visualizations in Immersive Environment using HMDs2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00053(238-243)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00053
Schipor OVatavu R(2022)GearWheels: A Software Tool to Support User Experiments on Gesture Input with Wearable DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.209890739:18(3527-3545)Online publication date: 22-Jul-2022
https://doi.org/10.1080/10447318.2022.2098907
Ren YArif A(2021)Stepper, Swipe, Tilt, ForceProceedings of the ACM on Human-Computer Interaction10.1145/34885455:ISS(1-21)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488545
Cui WZhu SLi ZXu ZYang XRamakrishnan IBi XKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)BackSwipe: Back-of-device Word-Gesture Interaction on SmartphonesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445081(1-12)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445081
T. LLeiva L(2021)Attentive Sequence-to-Sequence Modeling of Stroke Gestures Articulation PerformanceIEEE Transactions on Human-Machine Systems10.1109/THMS.2021.311296151:6(663-672)Online publication date: Dec-2021
https://doi.org/10.1109/THMS.2021.3112961
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents