research-article

A versatile dataset for text entry evaluations based on genuine mobile emails

Authors:

Per Ola KristenssonAuthors Info & Claims

MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services

Pages 295 - 298

https://doi.org/10.1145/2037373.2037418

Published: 30 August 2011 Publication History

Get Access

Abstract

Mobile text entry methods are typically evaluated by having study participants copy phrases. However, currently there is no available phrase set that has been composed by mobile users. Instead researchers have resorted to using invented phrases that probably suffer from low external validity. Further, there is no available phrase set whose phrases have been verified to be memorable. In this paper we present a collection of mobile email sentences written by actual users on actual mobile devices. We obtained our sentences from emails written by Enron employees on their BlackBerry mobile devices. We provide empirical data on how easy the sentences were to remember and how quickly and accurately users could type these sentences on a full-sized keyboard. Using this empirical data, we construct a series of phrase sets we suggest for use in text entry evaluations.

References

[1]

http://www.keithv.com/software/enronmobile/

Google Scholar

[2]

Faulkner, X. and Culwin, F. When fingers do the talking: a study of text messaging. Interacting with Computers 17, 2 (2005), 167--185.

Digital Library

Google Scholar

[3]

Klimt, B. and Yang, Y. Introducing the Enron Corpus. Proc. Email and Anti-Spam (2004).

Google Scholar

[4]

MacKenzie, I. S. and Soukoreff, R. W. Phrase sets for evaluating text entry techniques. Ext. Abstracts CHI 2003, ACM Press (2003), 754--755.

Digital Library

Google Scholar

[5]

Paek, T. and Hsu, B. Sampling representative phrase sets for text entry experiments: a procedure and public resource. Proc. CHI 2011, ACM Press (2011), 2477--2480.

Digital Library

Google Scholar

Cited By

View all

Komninos ASimou IFotopoulos AMichanetzi EXenos M(2024)Towards LLM-Generated Affective Phrase Sets for Text Entry EvaluationProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3703384(457-460)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3703384
Komninos AFeit ALeiva LLehmann FSimou IMinas DFotopoulos AXenos M(2024)An LLM-driven Transcription Task for Mobile Text Entry StudiesProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701586(264-279)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701586
Akhoroz MYildirim C(2024)Poke Typing: Effects of Hand-Tracking Input and Key Representation on Mid-Air Text Entry Performance in Virtual RealityProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685734(293-301)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685734
Show More Cited By

Index Terms

A versatile dataset for text entry evaluations based on genuine mobile emails
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

A Phrase Set for Bengali Text Entry Evaluations Based on Actual Text Messages
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

User studies evaluating text entry techniques usually require participants to transcribe phrases. Yet at present, there is no dataset available for Bengali text entry research that includes phrases entered on mobile devices. This forces researchers to ...
Children's phrase set for text input method evaluations
NordiCHI '06: Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles

This paper investigates the suitability of current phrase sets available in HCI for use with children in text entry experiments. It first examines the use of phrase sets within text input method evaluation, and suggests several reasons why the currently ...
Word Clarity as a Metric in Sampling Keyboard Test Sets
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Test sets play an essential role in evaluating text entry techniques. In this paper, we argue that in addition to the widely adopted metric of bigram representativeness and memorability, word clarity should also be considered as a metric when creating ...

Comments

Information & Contributors

Information

Published In

MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services

August 2011

781 pages

ISBN:9781450305419

DOI:10.1145/2037373

General Chair:
Markus Bylund
Swedish INstitute of Computer Science (SICS)
,
Program Chairs:
Oskar Juhlin
Mobile Life Centre, Stockholm University
,
Ylva Fernaeus
Mobile Life Centre, SICS

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 August 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Engineering and Physical Sciences Research Council

Conference

MobileHCI '11

Sponsor:

Swedish Institute of Computer Science

MobileHCI '11: 13th International Conference on Human Computer Interaction with Mobile Devices and Services

August 30 - September 2, 2011

Stockholm, Sweden

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

123
Total Citations
View Citations
659
Total Downloads

Downloads (Last 12 months)90
Downloads (Last 6 weeks)25

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Komninos ASimou IFotopoulos AMichanetzi EXenos M(2024)Towards LLM-Generated Affective Phrase Sets for Text Entry EvaluationProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3703384(457-460)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3703384
Komninos AFeit ALeiva LLehmann FSimou IMinas DFotopoulos AXenos M(2024)An LLM-driven Transcription Task for Mobile Text Entry StudiesProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701586(264-279)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701586
Akhoroz MYildirim C(2024)Poke Typing: Effects of Hand-Tracking Input and Key Representation on Mid-Air Text Entry Performance in Virtual RealityProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685734(293-301)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685734
Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Gaines DVertanen K(2024)Improving FlexType: Ambiguous Text Input for Users with Visual ImpairmentsProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652059(130-139)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3652059
Shi DZhu YJokinen JAcharya APutkonen AZhai SOulasvirta A(2024)CRTypist: Simulating Touchscreen Typing Behavior via Computational RationalityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642918(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642918
Pandey LArif A(2024)MELDER: The Design and Evaluation of a Real-time Silent Speech Recognizer for Mobile DevicesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642348(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642348
Hu JDudley JKristensson P(2024)SkiMR: Dwell-free Eye Typing in Mixed Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00065(439-449)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00065
Kern FTschanter JLatoschik M(2024)Handwriting for Text Input and the Impact of XR Displays, Surface Alignments, and Sentence ComplexitiesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337212430:5(2357-2367)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372124
Wan TWei YShi RShen JKristensson PAtkinson KLiang H(2024)Design and Evaluation of Controller-Based Raycasting Methods for Efficient Alphanumeric and Special Character Entry in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.334942830:9(6493-6506)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2024.3349428
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A Phrase Set for Bengali Text Entry Evaluations Based on Actual Text Messages

Children's phrase set for text input method evaluations

Word Clarity as a Metric in Sampling Keyboard Test Sets