Reflections on ESM in the Wild: the Case of a Mobile Head-Gesture Game
Article No.: 3, Pages 1 - 4
Abstract
The conduction of HCI studies in the wild brings new challenges to face, like the collection of qualitative data. In particular, one of the biggest concerns about the qualitative data is the external validity of the results obtained. We conducted an ESM based experiment to study the context of use of a mobile head-gesture game in natural settings. The obtained low rate of responses motivated us to think over the external validity of our results. To explain this behaviour, we also analysed the data collected from a technology usage study of the same head-gesture game published in a public app store. The strong correlation found between the obtained data from these two different studies encourages us to believe that the low rate of responses obtained is a consequence of the nature of our particular research question instead of a threat to the external validity of our results.
References
[1]
H. Brandstätter. 1983. Emotional responses to other persons in everyday life situations. Journal of Personality and Social Psychology 45, 4 (1983), 871.
[2]
L. A. Clark and D. Watson. 1988. Mood and the mundane: relations between daily life events and self-reported mood. Journal of personality and social psychology 54, 2 (1988), 296.
[3]
S. Consolvo and M. Walker. 2003. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2 (2003), 24--31.
[4]
H. Cramer, M. Rost, N. Belloni, F. Bentley, and D. Chincholle. 2010. Research in the large. using app stores, markets, and other wide distribution channels in Ubicomp research. In Proc. UbiComp. ACM, 511--514.
[5]
M. Csikszentmihalyi, R. Larson, and S. Prescott. 1977. The ecology of adolescent activity and experience. Journal of youth and adolescence 6, 3 (1977), 281--294.
[6]
J. Froehlich, M. Y. Chen, I. E. Smith, and F. Potter. 2006. Voting with your feet: An investigative study of the relationship between place visit behavior and preference. In UbiComp 2006: Ubiquitous Computing. Springer, 333--350.
[7]
N. Henze and M. Pielot. 2013. App stores: external validity for mobile HCI. interactions 20, 2 (2013), 33--38.
[8]
N. Henze, M. Pielot, B. Poppinga, T. Schinke, and S. Boll. 2011. My app is an experiment: Experience from user studies in mobile app stores. International Journal of Mobile Human Computer Interaction (IJMHCI) 3, 4 (2011), 71--91.
[9]
N. Henze, E. Rukzio, and S. Boll. 2011. 100,000,000 taps: analysis and improvement of touch performance in the large. In Proc. MobileHCI. ACM, 133--142.
[10]
Apple Inc. 2016. TestFlight Beta Testing. (2016). Retrieved Januari 12, 2016 from https://developer.apple.com/testflight/.
[11]
R. Larson. 1989. Beeping children and adolescents: A method for studying time use and daily experience. Journal of Youth and Adolescence 18, 6 (1989), 511--530.
[12]
I. S. MacKenzie. 2012. Human-computer interaction: An empirical research perspective. Newnes.
[13]
D. McMillan, A. Morrison, O. Brown, M. Hall, and M. Chalmers. 2010. Further into the wild: Running worldwide trials of mobile systems. In Pervasive Computing. Springer, 210--227.
[14]
A. Mehrotra, J. Vermeulen, V. Pejovic, and M. Musolesi. 2015. Ask, but don't interrupt: the case for interruptibility-aware mobile experience sampling. In Proc. UbiComp. ACM, 723--732.
[15]
M. F. Roig-Maimó, C. Manresa-Yee, and J. Varona. 2016. A Robust Camera-Based Interface for Mobile Entertainment. Sensors 16, 2 (2016), 254.
[16]
M. F. Roig-Maimó, J. Varona, and C. Manresa-Yee. 2015. Face Me! Head-tracker interface evaluation on mobile devices. In Proc. Ext. Abstracts CHI. ACM Press, New York, New York, USA, 1573--1578.
[17]
J. D. Runyan, T. A. Steenbergh, C. Bainbridge, D. A. Daugherty, L. Oke, and B. N. Fry. 2013. A smartphone ecological momentary assessment/intervention "app" for collecting real-time data and promoting self-awareness. (2013).
[18]
C. N. Scollon, C. Prieto, and E. Diener. 2009. Experience sampling: promises and pitfalls, strength and weaknesses. In Assessing wellbeing. Springer, 157--180.
[19]
J. R. Williamson, S. Brewster, and R. Vennelakanti. 2013. Mo! Games: evaluating mobile gestures in the wild. In Proc. ICMI. ACM, 173--180.
Index Terms
- Reflections on ESM in the Wild: the Case of a Mobile Head-Gesture Game
Recommendations
Release your app on Sunday eve: finding the best time to deploy apps
MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and ServicesMobile application stores such as Apple's App Store and Google's Android Market enable researchers to use App Stores as a platform for user studies. Because successful studies can require a large number of users researchers might need to attract a large ...
My App is an Experiment: Experience from User Studies in Mobile App Stores
Experiments are a cornerstone of HCI research. Mobile distribution channels such as Apple's App Store and Google's Android Market have created the opportunity to bring experiments to the end user. Hardly any experience exists on how to conduct such ...
Large-scale assessment of mobile notifications
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsNotifications are a core feature of mobile phones. They inform users about a variety of events. Users may take immediate action or ignore them depending on the importance of a notification as well as their current context. The nature of notifications is ...
Comments
Information & Contributors
Information
Published In
September 2018
232 pages
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 September 2018
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
Conference
Interacción 2018
Interacción 2018: XIX International Conference on Human Computer Interaction
September 12 - 14, 2018
Palma, Spain
Acceptance Rates
Interacción '18 Paper Acceptance Rate 47 of 73 submissions, 64%;
Overall Acceptance Rate 109 of 163 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 74Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in