article

More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game

Authors:

Lennart E. Nacke,

Mark N. Grimshaw,

Craig A. LindleyAuthors Info & Claims

Interacting with Computers, Volume 22, Issue 5

Pages 336 - 343

https://doi.org/10.1016/j.intcom.2010.04.005

Published: 01 September 2010 Publication History

Abstract

The combination of psychophysiological and psychometric methods provides reliable measurements of affective user experience (UX). Understanding the nature of affective UX in interactive entertainment, especially with a focus on sonic stimuli, is an ongoing research challenge. In the empirical study reported here, participants played a fast-paced, immersive first-person shooter (FPS) game modification, in which sound (on/off) and music (on/off) were manipulated, while psychophysiological recordings of electrodermal activity (EDA) and facial muscle activity (EMG) were recorded in addition to a Game Experience Questionnaire (GEQ). Results indicate no main or interaction effects of sound or music on EMG and EDA. However, a significant main effect of sound on all GEQ dimensions (immersion, tension, competence, flow, negative affect, positive affect, and challenge) was found. In addition, an interaction effect of sound and music on GEQ dimension tension and flow indicates an important relationship of sound and music for gameplay experience. Additionally, we report the results of a correlation between GEQ dimensions and EMG/EDA activity. We conclude subjective measures could advance our understanding of sonic UX in digital games, while affective tonic (i.e., long-term psychophysiological) measures of sonic UX in digital games did not yield statistically significant results. One approach for future affective psychophysiological measures of sonic UX could be experiments investigating phasic (i.e., event-related) psychophysiological measures of sonic gameplay elements in digital games. This could improve our general understanding of sonic UX beyond affective gaming evaluation.

References

[1]

Bernhaupt, R., IJsselsteijn, W., Mueller, F.F., Tscheligi, M., Wixon, D., 2008. Evaluating user experiences in games. In: CHI '08 Extended Abstracts on Human Factors in Computing Systems, Florence, Italy.

Digital Library

[2]

Electrodermal Activity. Plenum Press, New York, NY.

[3]

Emotion and Motivation. In: Cacioppo, J.T., Tassinary, L.G., Berntson, G.G. (Eds.), Handbook of Psychphysiology, Cambridge University Press, New York, NY, USA. pp. 581-607.

[4]

Correcting menu usability problems with sound. Behaviour & Information Technology. v18 i3. 165-177.

[5]

Handbook of Psychophysiology. third ed. Cambridge University Press, Cambridge, UK.

[6]

Cleophas, E., Bijsterveld, K. (in press). Selling Sound: Designing, and Marketing Sound in the European Car Industry. The Oxford Handbook of Sound Studies. Oxford University Press, New York.

[7]

Flow: The Psychology of Optimal Experience. HarperPerennial, New York.

[8]

Does sound help us to work better with machines? A commentary on Rauterberg's paper 'About the importance of auditory alarms during the operation of a plant simulator'. Interacting with Computers. v10 i4. 401-409.

[9]

Electronic Arts 2008. Dead Space. (Digital Game).

[10]

Ermi, L., Mäyrä, F., 2005. Fundamental components of the gameplay experience: analysing immersion. In: DiGRA Conference Changing Views: Worlds in Play, Vancouver, Canada.

[11]

Fundamentals of Physiological Computing. Interacting with Computers. v21 i1-2. 133-145.

Digital Library

[12]

Guidelines for human electromyographic research. Psychophysiology. v23 i5. 567-589.

[13]

Urban Stress: Experiments on Noise and Social Stressors. Elsevier Science & Technology, Burlington, MA, USA.

[14]

Grimshaw, M., Lindley, C.A., Nacke, L., 2008. Sound and immersion in the first-person shooter: mixed measurement of the player's sonic experience. In: Paper Presented at the Audio Mostly 2008 - A Conference on Interaction with Sound.

[15]

A conceptual framework for the analysis of first-person shooter audio and its potential use for game engines. International Journal of Computer Games Technology. 7

Digital Library

[16]

The Game Experience Questionnaire: Development of A Self-report Measure to Assess Player Experiences of Digital Games. TU Eindhoven, Eindhoven.

[17]

Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies. v66. 641-661.

Digital Library

[18]

Konami 2001. Silent Hill 2 (PlayStation 2). (Digital Game).

[19]

The emotion probe. Studies of motivation and attention. American Psychologist. v50. 372-385.

[20]

Law, E., Roto, V., Vermeeren, A.P.O.S., Kort, J., Hassenzahl, M., 2008. Towards a shared definition of user experience. In: CHI '08 Extended Abstracts on Human Factors in Computing Systems, Florence, Italy.

Digital Library

[21]

At the heart of it all: The concept of presence. Journal of computer-mediated communication. v3 i2. 20

[22]

Lord, M., 2004. Why Is That Thing Beeping? A Sound Design Primer. Boxes and Arrows: The design behind the design. <http://www.boxesandarrows.com/view/why_is_that_thing_beeping_a_sound_design_primer> (retrieved 11.07.09).

[23]

Direct measurement of skin conductance: a proposal for standardization. Psychophysiology. v8 i5. 656-672.

[24]

Mandryk, R.L., Inkpen, K.M., 2004. Physiological indicators for the evaluation of co-located collaborative play. In: Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW 2004), Chicago, USA.

Digital Library

[25]

Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & Information Technology. v25 i2. 141-158.

[26]

Nacke, L.E., 2009a. Affective Ludology: Scientific Measurement of User Experience in Interactive Entertainment. Unpublished Ph.D. Thesis, Blekinge Institute of Technology, Karlskrona.

[27]

Nacke, L., 2009b. From playability to a hierarchical game usability model. In: Proceedings of the Conference on Future Play @ GDC Canada, Vancouver, BC, Canada.

Digital Library

[28]

Nacke, L., Lindley, C., 2009. Affective ludology, flow and immersion in a first-person shooter: measurement of player experience. Loading¿ 3(5). <http://journals.sfu.ca/loading/index.php/loading/article/view/72>.

[29]

Nacke, L., Lindley, C., Stellmach, S., 2008. Log who's playing: psychophysiological game analysis made easy through event logging. In: Proceedings of Fun and Games, Second International Conference, Eindhoven, The Netherlands.

Digital Library

[30]

Nacke, L., Lindley, C.A., 2008. Flow and immersion in first-person shooters: measuring the player's gameplay experience. In: Proceedings of the 2008 Conference on Future Play: Research, Play, Share, Toronto, Canada.

Digital Library

[31]

Poels, K., de Kort, Y., IJsselsteijn, W., 2007. "It is always a lot of fun!": exploring dimensions of digital game experience using focus group methodology. In: Proceedings of the 2007 Conference on Future Play, Toronto, Canada.

Digital Library

[32]

The neurophysiological bases of emotion: an fMRI study of the affective circumplex using emotion-denoting words. Human Brain Mapping. v30 i3. 883-895.

[33]

The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and Psychopathology. v17. 715-734.

[34]

Contributions of psychophysiology to media research: review and recommendations. Media Psychology. v6 i2. 193-235.

[35]

Phasic emotional reactions to video game events: a psychophysiological investigation. Media Psychology. v8 i4. 343-367.

[36]

The psychophysiology of James Bond: phasic emotional responses to violent video game events. Emotion. v8 i1. 114-120.

[37]

RedOctane 2005. Guitar Hero (PlayStation 2). (Digital Game).

[38]

A circumplex model of affect. Journal of Personality and Social Psychology. v39 i6. 1161-1178.

[39]

Core affect and the psychological construction of emotion. Psychological Review. v110 i1. 145-172.

[40]

Salminen, M., Kivikangas, J.M., Ravaja, N., Kallinen, K., 2009. Frontal EEG asymmetry in the study of player experiences during competitive and cooperative play. In: Proceedings of IADIS International Conference Game and Entertainment Technologies, Algarve, Portugal.

[41]

The experience of presence: factor analytic insights. Presence: Teleoperators and Virtual Environments. v10 i3. 266-281.

Digital Library

[42]

A framework for immersive virtual environments (FIVE). Presence: Teleoperators & Virtual Environments. v6 i6. 603

[43]

The effects of sound and colour on responses to a computer game. Interacting with Computers. v13 i2. 183-192.

Cited By

Krekhov AEmmerich KDemay LKrüger J(2024)Clothing Sounds in Games: Generation Procedure and Impact on Player ExperienceProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685378(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685378
Zhang HYin LZhang H(2024)A real-time camera-based gaze-tracking system involving dual interactive modes and its application in gamingMultimedia Systems10.1007/s00530-023-01204-930:1Online publication date: 16-Jan-2024
https://dl.acm.org/doi/10.1007/s00530-023-01204-9
Kounalaki MSimou IKomninos A(2023)Pseudo-haptic and Self-haptic Feedback During VR Text EntryProceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter10.1145/3609987.3610002(1-8)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3609987.3610002
Show More Cited By

More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game
1. Human-centered computing

Recommendations

Correlation between heart rate, electrodermal activity and player experience in first-person shooter games
Sandbox '10: Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games

Psychophysiological methods are becoming more popular in game research as covert and reliable measures of affective player experience, emotions, and cognition. Since player experience is not well understood, correlations between self-reports from ...
Studying children’s experience during free-form and formally structured gameplay
Abstract
In this research, we present an assessment study exploring the hypothesis that psychophysiological responses and associated facial expressions should differ significantly while players are engaged in free-form versus formally ...
Highlights
- Validation of the effectiveness of a Freedom of Choice (FoC) model for the quantitative and qualitative assessment in adventure digital games.
Towards the Design of Affective Survival Horror Games: An Investigation on Player Affect
ACII '13: Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction

An upcoming trend of affective gaming is where a player's emotional state is used to manipulate game play. This is an interesting field to explore especially for the survival horror genre that is excellent at producing player's intense emotions. In this ...

Comments

Information & Contributors

Information

Published In

cover image Interacting with Computers

Interacting with Computers Volume 22, Issue 5

September, 2010

127 pages

ISSN:0953-5438

EISSN:1873-7951

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2010.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 September 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

57
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Krekhov AEmmerich KDemay LKrüger J(2024)Clothing Sounds in Games: Generation Procedure and Impact on Player ExperienceProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685378(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685378
Zhang HYin LZhang H(2024)A real-time camera-based gaze-tracking system involving dual interactive modes and its application in gamingMultimedia Systems10.1007/s00530-023-01204-930:1Online publication date: 16-Jan-2024
https://dl.acm.org/doi/10.1007/s00530-023-01204-9
Kounalaki MSimou IKomninos A(2023)Pseudo-haptic and Self-haptic Feedback During VR Text EntryProceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter10.1145/3609987.3610002(1-8)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3609987.3610002
Altmeyer MZenuni BSpelt HJegen TLessel PKrüger A(2022)Do Hexad User Types Matter? Effects of (Non-) Personalized Gamification on Task Performance and User Experience in an Image Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/35494916:CHI PLAY(1-27)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549491
Kao DRatan RMousas CJoshi AMelcer E(2022)Audio Matters Too: How Audial Avatar Customization Enhances Visual Avatar CustomizationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501848(1-27)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501848
Moon JChoi YPark TChoi JHong JKim K(2022)Diversifying dynamic difficulty adjustment agent by integrating player state models into Monte-Carlo tree searchExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.117677205:COnline publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.eswa.2022.117677
Cheng FYu SQin SChu JChen J(2021)User experience evaluation method based on online product reviewsJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-21056441:1(1791-1805)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.3233/JIFS-210564
Tao XWu KYang Y(2021)The Effects of Vibration on Assisting Game Play and Improving Player Engagement When Lacking SoundHCI in Games: Experience Design and Game Mechanics10.1007/978-3-030-77277-2_30(389-407)Online publication date: 24-Jul-2021
https://dl.acm.org/doi/10.1007/978-3-030-77277-2_30
Ribeiro GRogers KAltmeyer MTerkildsen TNacke LMirza-Babaei PMcArthur VVanden Abeele VBirk M(2020)Game AtmosphereProceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3410404.3414245(107-119)Online publication date: 2-Nov-2020
https://dl.acm.org/doi/10.1145/3410404.3414245
Boletsis C(2020)A User Experience Questionnaire for VR Locomotion: Formulation and Preliminary EvaluationAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-58465-8_11(157-167)Online publication date: 7-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58465-8_11
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents