research-article

Typing on Split Keyboards with Peripheral Vision

Authors:

Yuanchun ShiAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 200, Pages 1 - 12

https://doi.org/10.1145/3290605.3300430

Published: 02 May 2019 Publication History

Abstract

Split keyboards are widely used on hand-held touchscreen devices (e.g., tablets). However, typing on a split keyboard often requires eye movement and attention switching between two halves of the keyboard, which slows users down and increases fatigue. We explore peripheral typing, a superior typing mode in which a user focuses her visual attention on the output text and keeps the split keyboard in peripheral vision. Our investigation showed that peripheral typing reduced attention switching, enhanced user experience and increased overall performance (27 WPM, 28% faster) over the typical eyes-on typing mode. This typing mode can be well supported by accounting the typing behavior in statistical decoding. Based on our study results, we have designed GlanceType, a text entry system that supported both peripheral and eyes-on typing modes for real typing scenario. Our evaluation showed that peripheral typing not only well co-existed with the existing eyes-on typing, but also substantially improved the text entry performance. Overall, peripheral typing is a promising typing mode and supporting it would significantly improve the text entry performance on a split keyboard.

Supplementary Material

ZIP File (paper200pvc.zip)

Preview video captions

Download
1.04 KB

MP4 File (paper200p.mp4)

Preview video

Download
2.18 MB

MP4 File (paper200.mp4)

Download
269.34 MB

References

[1]

2011. The Open American National Corpus (OANC). Website. http: //www.anc.org/

[2]

Layla El Asri, Hannes Schulz, Shikhar Sharma, Jeremie Zumer, Justin Harris, Emery Fine, Rahul Mehrotra, and Kaheer Suleman. 2017. Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems. CoRR abs/1704.00057 (2017). http://arxiv.org/abs/1704.00057 Typing on Split Keyboards with Peripheral Vision CHI 2019, May 4--9, 2019, Glasgow, Scotland Uk

[3]

Shiri Azenkot and Shumin Zhai. 2012. Touch Behavior with Diferent Postures on Soft Smartphone Keyboards. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 251-- 260.

Digital Library

[4]

Joseph Besharse and Dean Bok. 2011. The Retina and its Disorders. Academic Press,.

[5]

Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, and Shumin Zhai. 2012. Bimanual Gesture Keyboard. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 137--146.

Digital Library

[6]

J. Clawson, K. Lyons, T. Starner, and E. Clarkson. 2005. The impacts of limited visual feedback on mobile text entry for the Twiddler and mini-QWERTY keyboards. In Ninth IEEE International Symposium on Wearable Computers (ISWC'05). 170--177.

Digital Library

[7]

Gislin Dagnelie. 2011. Visual prosthetics: Physiology, bioengineering, rehabilitation. Springer (2011). https://link.springer.com/book/10. 1007/978--1--4419-0754--7

[8]

Anna Maria Feit, Daryl Weir, and Antti Oulasvirta. 2016. How We Type: Movement Strategies and Performance in Everyday Typing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4262--4273.

Digital Library

[9]

Leah Findlater, Jacob O. Wobbrock, and Daniel Wigdor. 2011. Typing on Flat Glass: Examining Ten-fnger Expert Typing Patterns on Touch Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2453--2462.

Digital Library

[10]

Jérémie Gilliot, Géry Casiez, and Nicolas Roussel. 2014. Impact of Form Factors and Input Conditions on Absolute Indirect-touch Pointing Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 723--732.

Digital Library

[11]

Mayank Goel, Leah Findlater, and Jacob Wobbrock. 2012. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text Entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2687--2696.

Digital Library

[12]

Mayank Goel, Alex Jansen, Travis Mandel, Shwetak N. Patel, and Jacob O. Wobbrock. 2013. ContextType: Using Hand Posture Information to Improve Mobile Touch Screen Text Entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2795--2798.

Digital Library

[13]

Joshua Goodman, Gina Venolia, Keith Steury, and Chauncey Parker. 2002. Language Modeling for Soft Keyboards. In Proceedings of the 7th International Conference on Intelligent User Interfaces (IUI '02). ACM, New York, NY, USA, 194--195.

Digital Library

[14]

Carl Gutwin, Andy Cockburn, and Ashley Coveney. 2017. Peripheral Popout: The Infuence of Visual Angle and Stimulus Intensity on Popout Efects. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 208--219.

Digital Library

[15]

Amy K. Karlson and Benjamin B. Bederson. 2007. ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices. Springer Berlin Heidelberg, Berlin, Heidelberg, 324--338.

[16]

Kenrick Kin, Björn Hartmann, and Maneesh Agrawala. 2011. Twohanded Marking Menus for Multitouch Devices. ACM Trans. Comput.Hum. Interact. 18, 3, Article 16 (Aug. 2011), 23 pages.

Digital Library

[17]

Frank Chun Yat Li, Richard T. Guy, Koji Yatani, and Khai N. Truong. 2011. The 1Line Keyboard: A QWERTY Layout in a Single Line. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 461--470.

Digital Library

[18]

Yiqin Lu, Chun Yu, Xin Yi, Yuanchun Shi, and Shengdong Zhao. 2017. BlindType: Eyes-Free Text Entry on Handheld Touchpad by Leveraging Thumb's Muscle Memory. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 18 (June 2017), 24 pages.

Digital Library

[19]

Kris Luyten, Donald Degraen, Gustavo Rovelo Ruiz, Sven Coppers, and Davy Vanacken. 2016. Hidden in Plain Sight: An Exploration of a Visual Language for Near-Eye Out-of-Focus Displays in the Peripheral View. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 487--497.

Digital Library

[20]

I. Scott MacKenzie and R. William Soukoref. 2003. Phrase Sets for Evaluating Text Entry Techniques. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 754--755.

Digital Library

[21]

Hugo Nicolau and Joaquim Jorge. 2012. Touch Typing Using Thumbs: Understanding the Efect of Mobility and Hand Posture. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2683--2686.

Digital Library

[22]

Hugo Nicolau, Kyle Montague, Tiago Guerreiro, André Rodrigues, and Vicki L. Hanson. 2015. Typing Performance of Blind Users: An Analysis of Touch Behaviors, Learning Efect, and In-Situ Usage. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15). ACM, New York, NY, USA, 273--280.

Digital Library

[23]

Antti Oulasvirta, Anna Reichel, Wenbin Li, Yan Zhang, Myroslav Bachynskyi, Keith Vertanen, and Per Ola Kristensson. 2013. Improving Two-thumb Text Entry on Touchscreen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2765--2774.

Digital Library

[24]

Shyam Reyal, Shumin Zhai, and Per Ola Kristensson. 2015. Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 679--688.

Digital Library

[25]

Oliver Schoenleben and Antti Oulasvirta. 2013. Sandwich Keyboard: Fast Ten-fnger Typing on a Mobile Device with Adaptive Touch Sensing on the Back Side. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 175--178.

Digital Library

[26]

James Scott, Shahram Izadi, Leila Sadat Rezai, Dominika Ruszkowski, Xiaojun Bi, and Ravin Balakrishnan. 2010. RearType: Text Entry Using Keys on the Back of a Device. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 171--180.

Digital Library

[27]

Miika Silfverberg. 2003. Using Mobile Keypads with Limited Visual Feedback: Implications to Handheld and Wearable Devices. Springer Berlin Heidelberg, Berlin, Heidelberg, 76--90.

[28]

Hans Strasburger, Ingo Rentschler, and Martin Jüttner. 2011. Peripheral vision and pattern recognition: a review. J Vis. 11, 5 (2011), 13. CHI 2019, May 4--9, 2019, Glasgow, Scotland Uk Lu et al.

[29]

William H. Swanson and Gary E. Fish. 1995. Color matches in diseased eyes with good acuity: detection of defcits in cone optical density and in chromatic discrimination. J. Opt. Soc. Am. A 12, 10 (Oct 1995), 2230--2236.

[30]

Twitter. 2016. 200,000 USA geolocated tweets. Website. http://followthehashtag.com/datasets/ free-twitter-dataset-usa-200000-free-usa-tweets/

[31]

Paul D. Tynan and Robert Sekuler. 1982. Motion processing in peripheral vision: Reaction time and perceived velocity. Vision Research 22, 1 (1982), 61 -- 68.

[32]

Keith Vertanen and Per Ola Kristensson. 2011. A Versatile Dataset for Text Entry Evaluations Based on Genuine Mobile Emails. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 295--298.

Digital Library

[33]

Keith Vertanen, Haythem Memmi, and Per Ola Kristensson. 2013. The Feasibility of Eyes-free Touchscreen Keyboard Typing. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 69, 2 pages.

Digital Library

[34]

Simon Voelker, Kjell Ivar Øvergård, Chat Wacharamanotham, and Jan Borchers. 2015. Knobology Revisited: A Comparison of User Performance Between Tangible and Virtual Rotary Knobs. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 35--38.

Digital Library

[35]

James Walker, Bochao Li, Keith Vertanen, and Scott Kuhl. 2017. Effcient Typing on a Visually Occluded Physical Keyboard. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5457--5461.

Digital Library

[36]

Wikipedia. 2017. Peripheral vision - Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/wiki/Peripheral_vision

[37]

Jacob O. Wobbrock and Brad A. Myers. 2006. Analyzing the Input Stream for Character- Level Errors in Unconstrained Text Entry Evaluations. ACM Trans. Comput.-Hum. Interact. 13, 4 (Dec. 2006), 458--489.

Digital Library

[38]

Xin Yi, Chun Yu, Weinan Shi, and Yuanchun Shi. 2017. Is it too small?: Investigating the performances and preferences of users when typing on tiny QWERTY keyboards. International Journal of Human-Computer Studies 106 (2017), 44--62.

[39]

Suwen Zhu, Tianyao Luo, Xiaojun Bi, and Shumin Zhai. 2018. Typing on an Invisible Keyboard. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 439, 13 pages.

Digital Library

Cited By

Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Wu JWang ZWang LDuan YLi J(2024)FanPad: A Fan Layout Touchpad Keyboard for Text Entry in VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00045(222-232)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00045
Sun AWang LLeng JKei Im S(2023)Light-Occlusion Text Entry in Mixed RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2285646(1-16)Online publication date: 28-Nov-2023
https://doi.org/10.1080/10447318.2023.2285646
Show More Cited By

Index Terms

Typing on Split Keyboards with Peripheral Vision
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Are Split Tablet Keyboards Better? A Study of Soft Keyboard Layout and Hand Posture
Human-Computer Interaction – INTERACT 2019
Abstract
Soft Qwerty keyboards are widely used on mobile devices such as tablets and smartphones. Research into physical keyboards have found split keyboards to be ergonomically better than ordinary physical keyboards. Consequently, the idea of split ...
Optimizing Touchscreen Keyboards for Gesture Typing
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Despite its growing popularity, gesture typing suffers from a major problem not present in touch typing: gesture ambiguity on the Qwerty keyboard. By applying rigorous mathematical optimization methods, this paper systematically investigates the ...
Typing on Midair Virtual Keyboards: Exploring Visual Designs and Interaction Styles
Human-Computer Interaction – INTERACT 2021
Abstract
We investigate typing on a QWERTY keyboard rendered in virtual reality. Our system tracks users’ hands in the virtual environment via a Leap Motion mounted on the front of a head mounted display. This allows typing on an auto-correcting midair ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Beijing Key Lab of Networked Multimedia
Natural Science Foundation of China
Tsinghua University Research Funding

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
645
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Wu JWang ZWang LDuan YLi J(2024)FanPad: A Fan Layout Touchpad Keyboard for Text Entry in VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00045(222-232)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00045
Sun AWang LLeng JKei Im S(2023)Light-Occlusion Text Entry in Mixed RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2285646(1-16)Online publication date: 28-Nov-2023
https://doi.org/10.1080/10447318.2023.2285646
Gunawardena NGinige JJavadi B(2022)Eye-tracking Technologies in Mobile Devices Using Edge Computing: A Systematic ReviewACM Computing Surveys10.1145/354693855:8(1-33)Online publication date: 23-Dec-2022
https://dl.acm.org/doi/10.1145/3546938
Kar PMishra KGhosh SChakraborty SChattopadhyay S(2021)Nosype: A Novel Nose-tip Tracking-based Text Entry System for Smartphone Users with Clinical Disabilities for Touch-based TypingProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472054(1-16)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472054
Jiang XLi YJokinen JHirvola VOulasvirta ARen XBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)How We Type: Eye and Finger Movement Strategies in Mobile TypingProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376711(1-14)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376711
Yi XWang CBi XShi YBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)PalmBoard: Leveraging Implicit Touch Pressure in Statistical Decoding for Indirect Text EntryProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376441(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376441

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents