research-article

Finding the Sweet Spot: Analyzing Unrestricted Touchscreen Interaction In-the-Wild

Authors:

Niels HenzeAuthors Info & Claims

ISS '19: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces

Pages 171 - 179

https://doi.org/10.1145/3343055.3359705

Published: 10 November 2019 Publication History

Abstract

With smartphones being a prime example, touchscreens became one of the most widely used interface to interact with computing systems. Compared to other touchscreen devices, smartphones pose additional challenges as the hand that interacts with the device is commonly used to also hold the device. Consequently, determining how fingers of the hand holding the device can interact with the screen is a non-trivial challenge. A body of recent work investigated the comfortable area in controlled lab studies. This poses limitations as it is based on the assumption that the grips used in the studies are representative for normal smartphone use. In this paper, we extend previous work by providing insights from in-the-wild studies using two different apps that were deployed in the Android App Store. Comparing our results with previous work we confirm that our data fits previously proposed models. Further analyzing the data, we highlight the sweet spot, the position that is touched if the input can be performed on the whole screen.

Supplementary Material

MP4 File (p171-mayer.mp4)

Download
262.99 MB

References

[1]

Florian Alt, Stefan Schneegass, Alireza Sahami Shirazi, Mariam Hassib, and Andreas Bulling. 2015. Graphical Passwords in the Wild: Understanding How Users Choose Pictures and Passwords in Image-based Authentication Schemes. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 316--322. http://dx.doi.org/10.1145/2785830.2785882

Digital Library

[2]

Alvina Anjum and Muhammad U. Ilyas. 2013. Activity recognition using smartphone sensors. In IEEE 10th Consumer Communications and Networking Conference (CCNC '13). 914--919. http://dx.doi.org/10.1109/CCNC.2013.6488584

[3]

Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1991--2000. http://dx.doi.org/10.1145/2556288.2557354

Digital Library

[4]

Sebastian Boring, David Ledo, Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 39--48. http://dx.doi.org/10.1145/2371574.2371582

Digital Library

[5]

Christian Corsten, Marcel Lahaye, Jan Borchers, and Simon Voelker. 2019. ForceRay: Extending Thumb Reach via Force Input Stabilizes Device Grip for Mobile Touch Input. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 212, 12 pages. http://dx.doi.org/10.1145/3290605.3300442

Digital Library

[6]

Rachel Eardley, Steve Gill, Anne Roudaut, Stephen Thompson, and Joanna Hare. 2016. Investigating How the Hand Interacts with Different Mobile Phones. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 698--705. http://dx.doi.org/10.1145/2957265.2961840

Digital Library

[7]

Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4680--4691. http://dx.doi.org/10.1145/3025453.3025835

Digital Library

[8]

Umar Farooq and Zhijia Zhao. 2018. RuntimeDroid: Restarting-Free Runtime Change Handling for Android Apps. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '18). ACM, New York, NY, USA, 110--122. http://dx.doi.org/10.1145/3210240.3210327

Digital Library

[9]

Mayank Goel, Jacob Wobbrock, and Shwetak Patel. 2012. GripSense: Using Built-in Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 545--554. http://dx.doi.org/10.1145/2380116.2380184

Digital Library

[10]

Alix Goguey, Géry Casiez, Andy Cockburn, and Carl Gutwin. 2018. Storyboard-Based Empirical Modeling of Touch Interface Performance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 445, 12 pages. http://dx.doi.org/10.1145/3173574.3174019

Digital Library

[11]

Niels Henze. 2012. Hit It!: An Apparatus for Upscaling Mobile HCI Studies. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1333--1338. http://dx.doi.org/10.1145/2212776.2212450

Digital Library

[12]

Niels Henze, Markus Funk, and Alireza Sahami Shirazi. 2016. Software-reduced Touchscreen Latency. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 434--441. http://dx.doi.org/10.1145/2935334.2935381

Digital Library

[13]

Niels Henze, Sven Mayer, Huy Viet Le, and Valentin Schwind. 2017. Improving Software-reduced Touchscreen Latency. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 107, 8 pages. http://dx.doi.org/10.1145/3098279.3122150

Digital Library

[14]

Niels Henze and Martin Pielot. 2013. App Stores: External Validity for Mobile HCI. interactions 20, 2 (March 2013), 33--38. http://dx.doi.org/10.1145/2427076.2427084

Digital Library

[15]

Niels Henze, Enrico Rukzio, and Susanne Boll. 2011. 100,000,000 Taps: Analysis and Improvement of Touch Performance in the Large. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 133--142. http://dx.doi.org/10.1145/2037373.2037395

Digital Library

[16]

Niels Henze, Enrico Rukzio, and Susanne Boll. 2012. Observational and Experimental Investigation of Typing Behaviour Using Virtual Keyboards for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2659--2668. http://dx.doi.org/10.1145/2207676.2208658

Digital Library

[17]

Niels Henze, Alireza Sahami Shrazi, Albrecht Schmidt, Martin Pielot, and Florian Michahelles. 2013. Empirical Research through Ubiquitous Data Collection. Computer 46 (06 2013), 74--76. http://dx.doi.org/10.1109/MC.2013.202

Digital Library

[18]

Christian Holz and Patrick Baudisch. 2011. Understanding Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2501--2510. http://dx.doi.org/10.1145/1978942.1979308

Digital Library

[19]

Amy K. Karlson and Benjamin B. Bederson. 2007. ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices. In Human-Computer Interaction -- INTERACT 2007. Springer Berlin Heidelberg, Berlin, Heidelberg, 324--338.

[20]

Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2018. Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 31, 12 pages. http://dx.doi.org/10.1145/3173574.3173605

Digital Library

[21]

Huy Viet Le, Sven Mayer, Benedict Steuerlein, and Niels Henze. 2019. Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the Touchscreen. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19). ACM, New York, NY, USA, 14. http://dx.doi.org/10.1145/3338286.3340145

Digital Library

[22]

Huy Viet Le, Sven Mayer, Katrin Wolf, and Niels Henze. 2016. Finger Placement and Hand Grasp During Smartphone Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2576--2584. http://dx.doi.org/10.1145/2851581.2892462

Digital Library

[23]

Songil Lee, Gyouhyung Kyung, Jungyong Lee, Seung Ki Moon, and Kyoung Jong Park. 2016. Grasp and index finger reach zone during one-handed smartphone rear interaction: effects of task type, phone width and hand length. Ergonomics 59, 11 (2016), 1462--1472. http://dx.doi.org/10.1080/00140139.2016.1146346

[24]

Florian Lehmann and Michael Kipp. 2018. How to Hold Your Phone When Tapping: A Comparative Study of Performance, Precision, and Errors. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). ACM, New York, NY, USA, 115--127. http://dx.doi.org/10.1145/3279778.3279791

Digital Library

[25]

William E. Lorensen and Harvey E. Cline. 1987. Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '87). ACM, New York, NY, USA, 163--169. http://dx.doi.org/10.1145/37401.37422

Digital Library

[26]

Sven Mayer, Lars Lischke, Jens Emil Grønbæk, Zhanna Sarsenbayeva, Jonas Vogelsang, Paweł W. Wo'zniak, Niels Henze, and Giulio Jacucci. 2018. Pac-Many: Movement Behavior when Playing Collaborative and Competitive Games on Large Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 539, 10 pages. http://dx.doi.org/10.1145/3173574.3174113

Digital Library

[27]

Emiliano Miluzzo, Alexander Varshavsky, Suhrid Balakrishnan, and Romit Roy Choudhury. 2012. Tapprints: Your Finger Taps Have Fingerprints. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys '12). ACM, New York, NY, USA, 323--336. http://dx.doi.org/10.1145/2307636.2307666

Digital Library

[28]

R.C. Oldfield. 1971. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9, 1 (1971), 97 -- 113. http://dx.doi.org/https://doi.org/10.1016/0028--3932(71)90067--4

[29]

Yong S. Park and Sung H. Han. 2010. One-handed thumb interaction of mobile devices from the input accuracy perspective. International Journal of Industrial Ergonomics 40, 6 (2010), 746 -- 756. http://dx.doi.org/10.1016/j.ergon.2010.08.001

[30]

Ira B. Perelle and Lee Ehrman. 1994. An international study of human handedness: The data. Behavior Genetics 24, 3 (01 May 1994), 217--227. http://dx.doi.org/10.1007/BF01067189

[31]

Benjamin Poppinga, Alireza Sahami Shirazi, Niels Henze, Wilko Heuten, and Susanne Boll. 2014. Understanding Shortcut Gestures on Mobile Touch Devices. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 173--182. http://dx.doi.org/10.1145/2628363.2628378

Digital Library

[32]

Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Kai Kunze, and Albrecht Schmidt. 2013. Upright or Sideways?: Analysis of Smartphone Postures in the Wild. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 362--371. http://dx.doi.org/10.1145/2493190.2493230

Digital Library

[33]

Stefan Schneegass, Frank Steimle, Andreas Bulling, Florian Alt, and Albrecht Schmidt. 2014. SmudgeSafe: Geometric Image Transformations for Smudge-resistant User Authentication. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 775--786. http://dx.doi.org/10.1145/2632048.2636090

Digital Library

[34]

Katie A Siek, Yvonne Rogers, and Kay H Connelly. 2005. Fat finger worries: how older and younger users physically interact with PDAs. In Human-Computer Interaction-INTERACT 2005. Lecture Notes in Computer Science, Vol. 3585. Springer Berlin Heidelberg, Berlin, Heidelberg, 267--280. http://dx.doi.org/10.1007/11555261_24

Digital Library

[35]

Matthieu B. Trudeau, Justin G. Young, Devin L. Jindrich, and Jack T. Dennerlein. 2012. Thumb motor performance varies with thumb and wrist posture during single-handed mobile phone use. Journal of Biomechanics 45, 14 (2012), 2349 -- 2354. http://dx.doi.org/10.1016/j.jbiomech.2012.07.012

[36]

Dominik Weber, Alexandra Voit, Jonas Auda, Stefan Schneegass, and Niels Henze. 2018. Snooze!: Investigating the User-defined Deferral of Mobile Notifications. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, New York, NY, USA, Article 2, 13 pages. http://dx.doi.org/10.1145/3229434.3229436

Digital Library

[37]

Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell, and Chia Shen. 2007. Lucid Touch: A See-through Mobile Device. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 269--278. http://dx.doi.org/10.1145/1294211.1294259

Digital Library

[38]

Jinghong Xiong and Satoshi Muraki. 2014. An ergonomics study of thumb movements on smartphone touch screen. Ergonomics 57, 6 (2014), 943--955. http://dx.doi.org/10.1080/00140139.2014.904007

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Mandi SGhosh SDe PMitra BHong JBures MPark JCerny T(2022)Emotion detection from smartphone keyboard interactionsProceedings of the 37th ACM/SIGAPP Symposium on Applied Computing10.1145/3477314.3507159(677-680)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3477314.3507159
Show More Cited By

Index Terms

Finding the Sweet Spot: Analyzing Unrestricted Touchscreen Interaction In-the-Wild
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Tactile and hand-based interfaces
      1. Touch screens
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...
Evaluating reading and analysis tasks on mobile devices: a case study of tilt and flick scrolling
OZCHI '09: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7

Flick scrolling is a natural scrolling method for mobile touch devices such as the iPhone™. It is useful not only for its performance but perhaps even more so for its ease of use and user experience. Tilt scrolling instead uses the device's tilt to ...
Mobile-based tangible interaction techniques for shared displays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

This tutorial explores the possibility of using touchscreen-based mobile devices as active tangibles on an interactive tabletop surface. The tutorial starts with an open discussion about various aspects of tangible interaction, including an overview of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '19: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces

November 2019

450 pages

ISBN:9781450368919

DOI:10.1145/3343055

General Chairs:
Bongshin Lee
Microsoft Research, USA
,
Geehyuk Lee
KAIST, South Korea
,
Program Chairs:
Stacey Scott
University of Guelph, Canada
,
Melanie Tory
Tableau Software, USA
,
Jeonghyun Kim
Korea University, South Korea

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

ISS '19

Sponsor:

SIGCHI

ISS '19: Interactive Surfaces and Spaces

November 10 - 13, 2019

Daejeon, Republic of Korea

Acceptance Rates

ISS '19 Paper Acceptance Rate 26 of 85 submissions, 31%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
271
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Yeh YIrudayaraj AVogel D(2024)Single-handed Folding Interactions with a Modified Clamshell Flip PhoneProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642554(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642554
Mandi SGhosh SDe PMitra BHong JBures MPark JCerny T(2022)Emotion detection from smartphone keyboard interactionsProceedings of the 37th ACM/SIGAPP Symposium on Applied Computing10.1145/3477314.3507159(677-680)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3477314.3507159
Yeh YRoy QIrudayaraj AVogel D(2020)Expanding Side Touch Input on Mobile PhonesProceedings of the ACM on Human-Computer Interaction10.1145/34273344:ISS(1-20)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3427334
Le HMayer SWeiß MVogelsang JWeingärtner HHenze N(2020)Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive SmartphonesACM Transactions on Computer-Human Interaction10.1145/339623327:5(1-38)Online publication date: 17-Aug-2020
https://dl.acm.org/doi/10.1145/3396233

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten