note

Manipulating Leaderboards to Induce Player Experience

Authors:

Jason T. Bowey,

Regan L. MandrykAuthors Info & Claims

CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play

Pages 115 - 120

https://doi.org/10.1145/2793107.2793138

Published: 05 October 2015 Publication History

Abstract

Assessing and inducing player experience (pX) in games user research (GUR) is complicated because of the tradeoff between maintaining rigour through experimental control and having participants feel like they are engaged in play. To establish and evaluate an embedded method for inducing a sense of success or failure in participants during gameplay (e.g., to study how different players exhibit resilience to in-game failure), we manipulated leaderboard position in an experiment in which 155 participants played a Bejeweled clone. We show that manipulating success perception through leaderboards increases the player's perception of competence, autonomy, presence, enjoyment, and positive affect over manipulated failure. In addition, displaying the score enhances the effect on positive affect, autonomy and enjoyment, while not increasing detectability.

Supplementary Material

suppl.mov (chip0126-file3.mp4)

Supplemental video

Download
15.50 MB

References

[1]

Abuhamdeh, S., Csikszentmihalyi, M., & Jalal, B. (2015). Enjoying the possibility of defeat: Outcome uncertainty, suspense, and intrinsic motivation. Motivation and Emotion, 39(1), 1--10.

[2]

Birk, M., & Mandryk, R. L. (2013). Control your game-self: effects of controller type on enjoyment, motivation, and personality in game. In Proc. of CHI'13, 685--694.

Digital Library

[3]

Bessière, K., Seay, A. F., & Kiesler, S. (2007). The ideal elf: Identity exploration in World of Warcraft. CyberPsychology & Behavior, 10, 4, 530--535.

[4]

Costa, J. P., Wehbe, R. R., Robb, J., & Nacke, L. E. (2013). Time's up: studying leaderboards for engaging punctual behaviour. In Proc. of Gamification'13, 2633.

Digital Library

[5]

Davison, G. C., Vogel, R. S., & Coffman, S. G. (1997). Think-aloud approaches to cognitive assessment and the articulated thoughts in simulated situations paradigm. Journal of Consulting and Clinical Psychology, 65(6), 950.

[6]

Desurvire, H., Caplan, M., & Toth, J. A. (2004). Using heuristics to evaluate the playability of games. In Proc. of CHI EA'04, 1509--1512.

Digital Library

[7]

De Grove, F., Cauberghe, V., & Van Looy, J. (2014). Development and validation of an instrument for measuring individual motives for playing digital games. Media Psychology, 1--25.

[8]

Epstude, K., & Mussweiler, T. (2009). What you feel is how you compare: how comparisons influence the social induction of affect. Emotion, 9(1), 1.

[9]

Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7(2), 117--140.

[10]

Forgas, J. P., & East, R. (2008). On being happy and gullible: Mood effects on skepticism and the detection of deception. Journal of Experimental Social Psychology, 44(5), 1362--1367.

[11]

Gerling, K.M., Miller, M., Mandryk, R.L., Birk, M., and Smeddinck, J. (2014) Effects of Balancing for Physical Abilities on Player Performance, Experience and Self-Esteem in Exergames. In Proc. of CHI 2014, 2201--2210.

Digital Library

[12]

Hamari, J., Koivisto, J., Sarsa, H. (2014). Does gamification work?--a literature review of empirical studies on gamification. In Proc. of HICSS'14, 30253034.

Digital Library

[13]

Jagacinski, C. M., & Nicholls, J. G. (1987). Competence and affect in task involvement and ego involvement: The impact of social comparison information. Journal of Educational psychology, 79(2), 107.

[14]

John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. Handbook of personality: Theory and research, 2, 102--138.

[15]

Johnson, D., & Gardner, J. (2010). Personality, Motivation and Video Games. In Proc. of OZCHI'10, 276--279.

Digital Library

[16]

Kittur, A., Chi, E. H., & Suh, B. (2008) Crowdsourcing user studies with Mechanical Turk. In Proc. of CHI'08, 453--456.

Digital Library

[17]

Klimmt, C., Blake, C., Hefner, D., Vorderer, P., and Roth, C. (2009) Player Performance, Satisfaction, and Video Game Enjoyment. In Proc. of ICEC'09, 1--12.

Digital Library

[18]

Kirschbaum, C., Pirke, K. M., & Hellhammer, D. H. (1993). The 'Trier Social Stress Test'-a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology, 28(1--2), 7681.

[19]

Lazzaro, N. (2004). Why we play games: Four keys to more emotion without story.

[20]

Mandryk, R.L., Atkins, M., Inkpen, K. (2006). A Continuous and Objective Evaluation of Emotional Experience with Interactive Play Environments. In Proc. of CHI'06, 1027--1036.

Digital Library

[21]

Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods, 44(1), 1--23.

[22]

McAuley, E., Duncan, T., & Tammen, V. V. (1989). Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: A confirmatory factor analysis. Research Quarterly for Exercise and Sport, 60, 48--58.

[23]

Nacke, L. E., Bateman, C., & Mandryk, R. L. (2011). BrainHex: preliminary results from a neurobiological gamer typology survey. In Proc. of ICEC'11, 288--293.

Digital Library

[24]

Nielsen, J. (1994). Heuristic evaluation. Usability Inspection Methods, 17(1), 25--62.

Digital Library

[25]

Nicholls, J. G. (1984). Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. Psychological review, 91(3), 328.

[26]

Ryan, R.M., Rigby, C.S., & Przybylski, A. (2006). The motivational pull of video games: A self-determination theory approach. Motivation and Emotion, 30(4), 344360.

[27]

Sweetser, P., and Wyeth, P. (2005). GameFlow: A Model for Evaluating Player Enjoyment in Games. Computers in Entertainment, 3, 3.

Digital Library

[28]

Trepte, S., and Reinecke, L. (2011). The Pleasures of Success: Game-Related Efficacy Experiences as a Mediator Between Player Performance and Game Enjoyment. Cyberpsychology, Behavior, and Social Networking, 14, 9, 555--557.

[29]

Taylor, S. P. (1967). Aggressive behavior and physiological arousal as a function of provocation and the tendency to inhibit aggression. Journal of Personality, 35(2), 297--310.

[30]

Van Someren, M. W., Barnard, Y. F., & Sandberg, J. A. (1994). The think aloud method: A practical guide to modelling cognitive processes (Vol. 2). London: Academic Press.

[31]

Watson, D., & Clark, L. A. (1999). The PANAS-X: Manual for the positive and negative affect scheduleexpanded form.

[32]

Ware, C. (2012). Information visualization: perception for design. Elsevier.

Digital Library

[33]

Westermann, R., Spies, K., Stahl, GK, & Hesse, FW (1996). Relative effectiveness and validity of mood induction procedures: A meta-analysis. European Journal of Social Psychology, (26), 557--580.

[34]

Williams, K. D., & Jarvis, B. (2006). Cyberball: A program for use in research on interpersonal ostracism and acceptance. Behavior Research Methods, 38(1), 174--180.

Cited By

Fung MJackson C(2024)When feeling positive is being “in the zone”: How challenge optimality causes changes in positive affect and flowCyberpsychology: Journal of Psychosocial Research on Cyberspace10.5817/CP2024-4-718:4Online publication date: 18-Sep-2024
https://doi.org/10.5817/CP2024-4-7
Karhulahti V(2024)Vitality structures in ‘addictive’ game designOpen Research Europe10.12688/openreseurope.17177.24(47)Online publication date: 14-Oct-2024
https://doi.org/10.12688/openreseurope.17177.2
Tyack AMekler E(2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3673230
Show More Cited By

Index Terms

Manipulating Leaderboards to Induce Player Experience
1. Human-centered computing

Recommendations

Towards Democratisation of Games User Research: Exploring Playtesting Challenges of Indie Video Game Developers
CHI PLAY

Playtesting is a games user research (GUR) method used to evaluate design decisions based on feedback gathered from players with the goal to improve player experience. HCI games research has been actively working on and promoting best practices in GUR. ...
Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences
Highlights
- Scale to measure player experience at functional and psychosocial level concurrently.
Abstract
Games User Research (GUR) focuses on measuring, analysing and understanding player experiences to optimise game designs. Hence, GUR experts aim to understand how specific game design choices are experienced by players, and how these ...
The Player Experience Inventory Bench: Providing Games User Researchers Actionable Insight into Player Experiences
CHI PLAY '20: Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play

In this paper, we present PXI Bench, an online tool to provide actionable insight into the player experience, designed by and for games user researchers. Based on the Player Experience Inventory (PXI), it provides detailed information about the baseline ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play

October 2015

852 pages

ISBN:9781450334662

DOI:10.1145/2793107

General Chairs:
Anna L. Cox
University College London, UK
,
Paul Cairns
University of York, UK
,
Program Chairs:
Regina Bernhaupt
IRIT, France
,
Lennart Nacke
University of Waterloo, Canada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Note

Conference

CHI PLAY '15

Sponsor:

SIGCHI

CHI PLAY '15: The annual symposium on Computer-Human Interaction in Play

October 5 - 7, 2015

London, United Kingdom

Acceptance Rates

CHI PLAY '15 Paper Acceptance Rate 40 of 144 submissions, 28%;

Overall Acceptance Rate 421 of 1,386 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
747
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)4

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fung MJackson C(2024)When feeling positive is being “in the zone”: How challenge optimality causes changes in positive affect and flowCyberpsychology: Journal of Psychosocial Research on Cyberspace10.5817/CP2024-4-718:4Online publication date: 18-Sep-2024
https://doi.org/10.5817/CP2024-4-7
Karhulahti V(2024)Vitality structures in ‘addictive’ game designOpen Research Europe10.12688/openreseurope.17177.24(47)Online publication date: 14-Oct-2024
https://doi.org/10.12688/openreseurope.17177.2
Tyack AMekler E(2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
https://dl.acm.org/doi/10.1145/3673230
Opp MGerling KAlsheail MAlexandrovsky DWolf M(2024)Snarky's Adventure: A Research Tool to Explore How Children Understand Playtime and Experience Closure When Disengaging From GamesCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678834(312-317)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678834
Samadi MPhillips CKlarkowski M(2024)Space Oddity: A Demonstration of the Self-Efficacy Game Elements FrameworkCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678793(249-255)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678793
Pesantez JVizanko BBerglund E(2024)Modeling a game to shift peak water demands: WaterTime leaderboardJournal of Cleaner Production10.1016/j.jclepro.2024.143241(143241)Online publication date: Jul-2024
https://doi.org/10.1016/j.jclepro.2024.143241
Na KHan K(2023)How leaderboard positions shape our motivation: the impact of competence satisfaction and competence frustration on motivation in a gamified crowdsourcing taskInternet Research10.1108/INTR-12-2021-089733:7(1-18)Online publication date: 8-Feb-2023
https://doi.org/10.1108/INTR-12-2021-0897
Pirrone Dvan den Eijnden RPeeters M(2023)Why We Can’t Stop: The Impact of Rewarding Elements in Videogames on Adolescents’ Problematic Gaming BehaviorMedia Psychology10.1080/15213269.2023.2242260(1-22)Online publication date: 3-Aug-2023
https://doi.org/10.1080/15213269.2023.2242260
Caroux LPujol M(2023)Player Enjoyment in Video Games: A Systematic Review and Meta-analysis of the Effects of Game Design ChoicesInternational Journal of Human–Computer Interaction10.1080/10447318.2023.221088040:16(4227-4238)Online publication date: 28-May-2023
https://doi.org/10.1080/10447318.2023.2210880
Albert IBurkard NQueck DHerrlich M(2022)The Effect of Auditory-Motor Synchronization in Exergames on the Example of the VR Rhythm Game BeatSaberProceedings of the ACM on Human-Computer Interaction10.1145/35495166:CHI PLAY(1-26)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549516
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents