skip to main content
10.1145/3582437.3582474acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfdgConference Proceedingsconference-collections
research-article
Open access

Under Pressure: A Multi-Modal Analysis of Induced Stressors in Games for Resilience

Published: 12 April 2023 Publication History

Abstract

Emotion regulation and coping strategies are key to resilience, problem solving and eventually well-being in everyday life, but investigating or influencing these without adjustable and ecologically valid environments still poses a major challenge. With respect to video games, stressful events can frequently appear and, depending on the individual’s emotion regulation, lead to frustrating experiences, dissatisfied players or even churn – or to a sense of accomplishment, mastery or positive tension. In the greater endeavor of establishing games for studying, controlling and reinforcing resilience, we developed an alternate reality game that unifies the advantages of a fully customizable game environment with the close connection to real-life interactions. To estimate how emotion regulation strategies could be initiated as well as investigated, this work first induces different kinds of established stressors (time pressure, social encounters and being unchangeably stuck) into ordinary gameplay, quantifies the players’ physiological and psychological responses and addresses the participants’ strategies on dealing with these situations. In this paper we present results of the study showing that the induced stressors were effective in constituting stressful situations comparable to real-life experiences; and each of these conditions resulted in different types of physiological and perceived responses and behaviors, e.g. continuous stress in social encounters versus instantaneous stress when notified about time pressure; or frustrating experiences when being forcibly stuck versus stress that participants underwent but were able to work against. With this platform to study how people cope with stress, instituted within a multi-modal mixed-methods evaluation, we contribute to games beyond entertainment towards educating resilience.

References

[1]
[1] Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135 (2020), 102370.
[2]
[2] Karl Albrecht. 2010. Stress and the Manager. Simon and Schuster.
[3]
[3] Carol S Aneshensel. 1992. Social stress: Theory and research. Annual review of sociology (1992), 15–38.
[4]
[4] Tadas Baltrušaitis, Marwa Mahmoud, and Peter Robinson. 2015. Cross-dataset learning and person-specific normalisation for automatic action unit detection. In 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Vol. 6. IEEE, 1–6.
[5]
[5] Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency. 2016. Openface: an open source facial behavior analysis toolkit. In 2016 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 1–10.
[6]
[6] Sian L Beilock. 2008. Math performance in stressful situations. Current Directions in Psychological Science 17, 5 (2008), 339–343.
[7]
[7] Sian L Beilock and Marci S DeCaro. 2007. From poor performance to success under stress: working memory, strategy selection, and mathematical problem solving under pressure.Journal of Experimental Psychology: Learning, Memory, and Cognition 33, 6 (2007), 983.
[8]
[8] Ioannis Bikas, Johannes Pfau, Bastian Dänekas, and Rainer Malaka. 2022. Mental Wear and Tear: An Exploratory Study on Mental Fatigue in Video Games Using the Example of League of Legends. In Entertainment Computing – ICEC 2022, Barbara Göbl, Erik van der Spek, Jannicke Baalsrud Hauge, and Rod McCall (Eds.). Springer International Publishing, Cham, 125–139.
[9]
[9] Jim Blascovich, Wendy Berry Mendes, Sarah B Hunter, and Kristen Salomon. 1999. Social" facilitation" as challenge and threat.Journal of personality and social psychology 77, 1 (1999), 68.
[10]
[10] Jim Blascovich and Joe Tomaka. 1996. The biopsychosocial model of arousal regulation. In Advances in experimental social psychology. Vol. 28. Elsevier, 1–51.
[11]
[11] Paris Mavromoustakos Blom, Sander Bakkes, and Pieter Spronck. 2019. Towards multi-modal stress response modelling in competitive league of legends. In 2019 IEEE Conference on Games (CoG). IEEE, 1–4.
[12]
[12] Joel Brockner. 1988. Self-esteem at work: Research, theory, and practice.Lexington Books/DC Heath and Com.
[13]
[13] Hennie Brugman, Albert Russel, and Xd Nijmegen. 2004. Annotating Multi-media/Multi-modal Resources with ELAN. In LREC. 2065–2068.
[14]
[14] Paul T Costa Jr and Robert R McCrae. 2009. The Five-Factor Model and the NEO Inventories. (2009).
[15]
[15] Edward L Deci and Richard M Ryan. 2012. Self-determination theory. (2012).
[16]
[16] Dan Dixon. 2011. Player types and gamification. In Proceedings of the CHI 2011 Workshop on Gamification. 7–12.
[17]
[17] Jeanette Frost Ebstrup, Lene Falgaard Eplov, Charlotta Pisinger, and Torben Jørgensen. 2011. Association between the Five Factor personality traits and perceived stress: is the effect mediated by general self-efficacy?Anxiety, Stress & Coping 24, 4 (2011), 407–419.
[18]
[18] Paul Ekman and Wallace V Friesen. 1978. Facial action coding system. Environmental Psychology & Nonverbal Behavior (1978).
[19]
[19] Magy Seif El-Nasr, John Yen, and Thomas R Ioerger. 2000. flame. Autonomous Agents and Multi-agent systems 3, 3 (2000), 219–257.
[20]
[20] Anna-Liisa Elo, Anneli Leppänen, and Antti Jahkola. 2003. Validity of a single-item measure of stress symptoms. Scandinavian journal of work, environment & health (2003), 444–451.
[21]
[21] Malte Elson, Johannes Breuer, James D Ivory, and Thorsten Quandt. 2014. More than stories with buttons: Narrative, mechanics, and context as determinants of player experience in digital games. Journal of Communication 64, 3 (2014), 521–542.
[22]
[22] Cathy Mengying Fang, GR Marvez, Neska ElHaouij, and Rosalind Picard. 2022. Cardiac Arrest: Evaluating the Role of Biosignals in Gameplay Strategies and Players’ Physiological Synchrony in Social Deception Games. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–7.
[23]
[23] Susan Folkman and Richard S Lazarus. 1980. An analysis of coping in a middle-aged community sample. Journal of health and social behavior (1980), 219–239.
[24]
[24] Susan Folkman and Richard S Lazarus. 1985. If it changes it must be a process: study of emotion and coping during three stages of a college examination.Journal of personality and social psychology 48, 1 (1985), 150.
[25]
[25] Mihai Gavrilescu and Nicolae Vizireanu. 2019. Predicting depression, anxiety, and stress levels from videos using the facial action coding system. Sensors 19, 17 (2019), 3693.
[26]
[26] Shalom Greene, Himanshu Thapliyal, and Allison Caban-Holt. 2016. A survey of affective computing for stress detection: Evaluating technologies in stress detection for better health. IEEE Consumer Electronics Magazine 5, 4 (2016), 44–56.
[27]
[27] Reza Habibi, Sai Siddartha Maram, Johannes Pfau, Jessica Wei, Shweta K. Sisodiya, Atieh Kashani, Elin Carstensdottir, and Magy Seif El-Nasr. 2022. A Data-Driven Design of AR Alternate Reality Games to Measure Resilience. In HCI in Games, Xiaowen Fang (Ed.). Springer International Publishing, Cham, 586–604.
[28]
[28] Reza Habibi, Johannes Pfau, Jonattan Holmes, and Magy Seif El-Nasr. 2023. Empathetic AI for Empowering Resilience in Games. https://doi.org/10.48550/ARXIV.2302.09070
[29]
[29] Alexander Heimerl, Tobias Baur, Florian Lingenfelser, Johannes Wagner, and Elisabeth André. 2019. NOVA-a tool for eXplainable Cooperative Machine Learning. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 109–115.
[30]
[30] Christoffer Holmgård and Karen-Inge Karstoft. 2016. Games for Treating and Diagnosing Post Traumatic Stress Disorder. In Emotion in Games. Springer, 257–274.
[31]
[31] Christoffer Holmgård, Georgios N Yannakakis, Karen-Inge Karstoft, and Henrik Steen Andersen. 2013. Stress detection for ptsd via the startlemart game. In 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction. IEEE, 523–528.
[32]
[32] Christoffer Holmgård, Georgios N Yannakakis, Hector P Martinez, and Karen-Inge Karstoft. 2015. To rank or to classify? Annotating stress for reliable PTSD profiling. In 2015 International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE, 719–725.
[33]
[33] Gerry Larsson. 1989. Personality, appraisal and cognitive coping processes, and performance during various conditions of stress. Military Psychology 1, 3 (1989), 167–182.
[34]
[34] Richard S Lazarus. 1999. Hope: An emotion and a vital coping resource against despair. Social research (1999), 653–678.
[35]
[35] Richard S Lazarus and Susan Folkman. 1984. Stress, appraisal, and coping. Springer publishing company.
[36]
[36] D Lecic-Tosevski, O Vukovic, and J Stepanovic. 2011. Stress and personality. Psychiatriki 22, 4 (2011), 290–297.
[37]
[37] Therese H Macan, Comila Shahani, Robert L Dipboye, and Amanda P Phillips. 1990. College students’ time management: Correlations with academic performance and stress.Journal of educational psychology 82, 4 (1990), 760.
[38]
[38] Regan L Mandryk, Kori M Inkpen, and Thomas W Calvert. 2006. Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & information technology 25, 2 (2006), 141–158.
[39]
[39] Andrew Mattarella-Micke, Jill Mateo, Megan N Kozak, Katherine Foster, and Sian L Beilock. 2011. Choke or thrive? The relation between salivary cortisol and math performance depends on individual differences in working memory and math-anxiety.Emotion 11, 4 (2011), 1000.
[40]
[40] Gerald Matthews and Sian E Campbell. 1998. Task-induced stress and individual differences in coping. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 42. SAGE Publications Sage CA: Los Angeles, CA, 821–825.
[41]
[41] Paris Mavromoustakos-Blom, Sander Bakkes, and Pieter Spronck. 2020. Multi-Modal Study of the Effect of Time Pressure in a Crisis Management Game. In International Conference on the Foundations of Digital Games. 1–4.
[42]
[42] Philipp Mayring. 2019. Qualitative content analysis: Demarcation, varieties, developments. In Forum: Qualitative Social Research, Vol. 20. Freie Universität Berlin, 1–26.
[43]
[43] Lynn M Oswald, Peter Zandi, Gerald Nestadt, James B Potash, Amanda E Kalaydjian, and Gary S Wand. 2006. Relationship between cortisol responses to stress and personality. Neuropsychopharmacology 31, 7 (2006), 1583–1591.
[44]
[44] Rosalind W Picard 1997. Affective computing, 1997. Google Scholar Google Scholar Digital Library Digital Library (1997).
[45]
[45] Eugenia Politou, Efthimios Alepis, and Constantinos Patsakis. 2017. A survey on mobile affective computing. Computer Science Review 25 (2017), 79–100.
[46]
[46] Anne Marie Porter and Paula Goolkasian. 2019. Video games and stress: How stress appraisals and game content affect cardiovascular and emotion outcomes. Frontiers in psychology 10 (2019), 967.
[47]
[47] Paul Sloane. 1992. Lateral thinking puzzlers. Sterling Publishing Company, Inc.
[48]
[48] Juliane Strack and Francisco Esteves. 2015. Exams? Why worry? Interpreting anxiety as facilitative and stress appraisals. Anxiety, Stress, & Coping 28, 2 (2015), 205–214.
[49]
[49] Lois E Tetrick. 2002. Individual and organizational health. In Historical and current perspectives on stress and health. Emerald Group Publishing Limited.
[50]
[50] Gustavo F Tondello, Rina R Wehbe, Rita Orji, Giovanni Ribeiro, and Lennart E Nacke. 2017. A framework and taxonomy of videogame playing preferences. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 329–340.
[51]
[51] Benny Van der Vijgh, Robbert-Jan Beun, Maarten Van Rood, and Peter Werkhoven. 2015. Meta-analysis of digital game and study characteristics eliciting physiological stress responses. Psychophysiology 52, 8 (2015), 1080–1098.
[52]
[52] Georg Volkmar, Johannes Pfau, Rudolf Teise, and Rainer Malaka. 2019. Player Types and Achievements – Using Adaptive Game Design to Foster Intrinsic Motivation. In Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Barcelona, Spain) (CHI PLAY ’19 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 747–754. https://doi.org/10.1145/3341215.3356278
[53]
[53] Margarete Vollrath. 2001. Personality and stress. Scandinavian Journal of Psychology 42, 4 (2001), 335–347.
[54]
[54] David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: the PANAS scales.Journal of personality and social psychology 54, 6 (1988), 1063.
[55]
[55] Chamila Wijayarathna and Erandi Lakshika. 2022. Towards Stress Detection During Gameplay: A Survey. IEEE Transactions on Games (2022).
[56]
[56] Georgios N Yannakakis, Hector P Martinez, and Maurizio Garbarino. 2016. Psychophysiology in games. In Emotion in games. Springer, 119–137.

Cited By

View all

Index Terms

  1. Under Pressure: A Multi-Modal Analysis of Induced Stressors in Games for Resilience

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    FDG '23: Proceedings of the 18th International Conference on the Foundations of Digital Games
    April 2023
    621 pages
    ISBN:9781450398558
    DOI:10.1145/3582437
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 April 2023

    Check for updates

    Author Tags

    1. Serious games
    2. individual differences in games
    3. resilience
    4. stress detection

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • James S McDonnell Foundation

    Conference

    FDG 2023
    FDG 2023: Foundations of Digital Games 2023
    April 12 - 14, 2023
    Lisbon, Portugal

    Acceptance Rates

    Overall Acceptance Rate 152 of 415 submissions, 37%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)341
    • Downloads (Last 6 weeks)43
    Reflects downloads up to 03 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media