skip to main content
research-article

How To Tame a Toxic Player? A Systematic Literature Review on Intervention Systems for Toxic Behaviors in Online Video Games

Published: 15 October 2024 Publication History

Abstract

Toxic behavior is known to cause harm in online games. Players regularly experience negative, hateful, or inappropriate behavior. Interventions, such as banning players or chat message filtering, can help combat toxicity but are not widely available or even comprehensively studied regarding their approaches and evaluations. We conducted a systematic literature review that provides insights into the current state of interventions literature, outlining their strengths and shortcomings. We identified 36 interventions and qualitatively analyzed their approaches. We describe the types of toxicity being addressed, the entities through which they act, the methods used by intervention systems, and how they are evaluated. Our results provide guidance for future interventions, outlining a design space based on known systems. Furthermore, our findings highlight gaps in the literature, e.g., a sparsity of empirical evaluations, and underexplored areas in the design space, enabling researchers to explore novel directions for future interventions.

References

[1]
Sonam Adinolf and Selen Turkay. 2018. Toxic Behaviors in Esports Games: Player Perceptions and Coping Strategies. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, Melbourne VIC Australia, 365--372. https://doi.org/10.1145/3270316.3271545
[2]
Icek Ajzen. 1985. From intentions to actions: A theory of planned behavior. In Action control: From cognition to behavior. Springer, 11--39.
[3]
R. Algozzine and P. Kay. 2002. Preventing Problem Behaviors: A Handbook of Successful Prevention Strategies. SAGE Publications. https://books.google.nl/books?id=-kQy3rJ1vz8C
[4]
G.R. Andrigueto and E. Araujo. 2020. Fuzzy aggressive behavior assessment of toxic players in multiplayer online battle games. In IEEE International Conference on Fuzzy Systems, Vol. 2020-July. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/FUZZ48607.2020.9177560
[5]
Koray Balci and Albert Ali Salah. 2015. Automatic Analysis and Identification of Verbal Aggression and Abusive Behaviors for Online Social Games. Comput. Hum. Behav. 53, C (Dec. 2015), 517--526. https://doi.org/10.1016/j.chb. 2014.10.025
[6]
N.A. Beres, J. Frommel, E. Reid, R.L. Mandryk, and M. Klarkowski. 2021. Don't you know that you're toxic: Normalization of toxicity in online gaming. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery. https://doi.org/10.1145/3411764.3445157
[7]
Nicole A. Beres, Madison Klarkowski, and Regan L. Mandryk. 2023. Playing with Emotions: A Systematic Review Examining Emotions and Emotion Regulation in Esports Performance. Proceedings of the ACM on Human-Computer Interaction 7, CHI PLAY (Sept. 2023), 558--587. https://doi.org/10.1145/3611041
[8]
Jeremy Blackburn and Haewoon Kwak. 2014. STFU NOOB! Predicting Crowdsourced Decisions on Toxic Behavior in Online Games. In Proceedings of the 23rd International Conference on World Wide Web (WWW '14). Association for Computing Machinery, New York, NY, USA, 877--888. https://doi.org/10.1145/2566486.2567987
[9]
Virginia Braun and Victoria Clarke. 2012. Thematic analysis. In APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. American Psychological Association, Washington, DC, US, 57--71. https://doi.org/10.1037/13620-004
[10]
Johanna Brewer, Morgan Romine, and T. L. Taylor. 2020. Inclusion at Scale: Deploying a Community-Driven Moderation Intervention on Twitch. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS '20). Association for Computing Machinery, New York, NY, USA, 757--769. https://doi.org/10.1145/3357236.3395514
[11]
T. Busch, K. Boudreau, and M. Consalvo. 2015. Toxic gamer culture, corporate regulation, and standards of behavior among players of online games. Taylor and Francis. https://www.scopus.com/inward/record.uri?eid=2-s2.0--85027273907& doi=10.4324%2f9781315748825--13&partnerID=40&md5=a597d7ef15159efc423886e9f3808c7b
[12]
David Byrne. 2022. A worked example of Braun and Clarke's approach to reflexive thematic analysis. Quality & Quantity 56, 3 (June 2022), 1391--1412. https://doi.org/10.1007/s11135-021-01182-y
[13]
A. Canossa, D. Salimov, A. Azadvar, C. Harteveld, and G. Yannakakis. 2021. For Honor, for Toxicity: Detecting Toxic Behavior through Gameplay. Proceedings of the ACM on Human-Computer Interaction 5, CHIPLAY (2021). https://doi.org/10.1145/3474680
[14]
Joel Chapman and FACEIT. 2020. Minerva Gets Ears: Tackling Toxicity in Voice Chat. https://blog.faceit.com/minervagets-ears-tackling-toxicity-in-voice-chat-3eb80471d005
[15]
Joel Chapman and FACEIT. 2021. Fighting Abusive Behaviour ' Product Update. https://medium.com/faceitblog/ fighting-abusive-behaviour-product-update-d39e490c00ce
[16]
Enrique Chaux, Ana María Velásquez, Anja Schultze-Krumbholz, and Herbert Scheithauer. 2016. Effects of the cyberbullying prevention program media heroes (Medienhelden) on traditional bullying. Aggressive behavior 42, 2 (2016), 157--165.
[17]
J.A. Cornel, C. Christian Pablo, J.A. Marzan, V. Julius Mercado, B. Fabito, R. Rodriguez, M. Octaviano, N. Oco, and A.D. La Cruz. 2019. Cyberbullying Detection for Online Games Chat Logs using Deep Learning. In 2019 IEEE 11th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management, HNICEM 2019. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/HNICEM48295.2019.9072811
[18]
G. Daily. 2006. A case of delivering family-friendly entertainment. EContent 29, 4 (2006), 45--47. https://www.scopus. com/inward/record.uri?eid=2-s2.0--33750903305&partnerID=40&md5=4e3c40c38b035dd34f6ab782e9aeaa80
[19]
Julian Dibbell. 1994. A Rape in Cyberspace; or, How an Evil Clown, a Haitian Trickster Spirit, Two Wizards, and a Cast of Dozens Turned a Database into a Society. In Flame Wars, Mark Dery (Ed.). Duke University Press, 237--261. https://doi.org/10.1215/9780822396765-012
[20]
A. Ekiciler, I. Ahioglu, N. Yildirim, I.I. Ajas, and T. Kaya. 2022. The Bullying Game: Sexism Based Toxic Language Analysis on Online Games Chat Logs by Text Mining. Journal of International Women's Studies 24, 3 (2022). https://www. scopus.com/inward/record.uri?eid=2-s2.0--85134998324&partnerID=40&md5=6e6bc81ee9201371bc0a80eb31071f8d
[21]
Blizzard Entertainment. 2004. World of Warcraft. Game [PC].
[22]
Clayton Epp, Michael Lippold, and Regan L Mandryk. 2011. Identifying emotional states using keystroke dynamics. In Proceedings of the sigchi conference on human factors in computing systems. 715--724.
[23]
Ted Feinberg and Nicole Robey. 2009. Cyberbullying: Intervention and prevention strategies. National Association of School Psychologists 38, 4 (2009), 22--24.
[24]
Gerbrich Ferdinands, Raoul Schram, Jonathan De Bruin, Ayoub Bagheri, Daniel L. Oberski, Lars Tummers, Jelle Jasper Teijema, and Rens Van De Schoot. 2023. Performance of active learning models for screening prioritization in systematic reviews: a simulation study into the Average Time to Discover relevant records. Systematic Reviews 12, 1 (June 2023), 100. https://doi.org/10.1186/s13643-023-02257--7
[25]
Michelle Ferrier and Nisha Garud-Patkar. 2018. TrollBusters: Fighting online harassment of women journalists. Mediating misogyny: Gender, technology, and harassment (2018), 311--332.
[26]
Jesse Fox and Wai Yen Tang. 2017. Women's experiences with general and sexual harassment in online video games: Rumination, organizational responsiveness, withdrawal, and coping strategies. NEW MEDIA & SOCIETY 19, 8 (Aug. 2017), 1290--1307. https://doi.org/10.1177/1461444816635778
[27]
Julian Frommel and Regan L. Mandryk. 2023. Individual Control over Exposure to Combat Toxicity in Games. ACM Games 1, 4, Article 24 (dec 2023), 3 pages. https://doi.org/10.1145/3633768
[28]
Julian Frommel, Regan L. Mandryk, and Madison Klarkowski. 2022. Challenges to Combating Toxicity and Harassment in Multiplayer Games: Involving the HCI Games Research Community. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (Bremen, Germany) (CHI PLAY '22). Association for Computing Machinery, New York, NY, USA, 263--265. https://doi.org/10.1145/3505270.3558359
[29]
Julian Frommel, Valentin Sagl, Ansgar E. Depping, Colby Johanson, Matthew K. Miller, and Regan L. Mandryk. 2020. Recognizing Affiliation: Using Behavioural Traces to Predict the Quality of Social Interactions in Online Games. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--16. https://doi.org/10.1145/3313831.3376446
[30]
Julian Frommel, Claudia Schrader, and Michael Weber. 2018. Towards emotion-based adaptive games: Emotion recognition via input and performance features. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. 173--185.
[31]
Riot Games. 2009. League of Legends. Game [PC].
[32]
Gemini Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, et al. 2023. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023).
[33]
Thomas D. Grace, Ian Larson, and Katie Salen. 2022. Policies of Misconduct: A Content Analysis of Codes of Conduct for Online Multiplayer Games. Proceedings of the ACM on Human-Computer Interaction 6, CHI PLAY (Oct. 2022), 1--23. https://doi.org/10.1145/3549513
[34]
Kate Grandprey-Shores, Yilin He, Kristina L. Swanenburg, Robert Kraut, and John Riedl. 2014. The identification of deviance and its impact on retention in a multiplayer game. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, Baltimore Maryland USA, 1356--1365. https://doi.org/10.1145/2531602.2531724
[35]
K. Grieman. 2019. Lakitu's world: Proactive and reactive regulation in video games. Interactive Entertainment Law Review 2, 2 (2019), 67--77. https://doi.org/10.4337/ielr.2019.02.02
[36]
James Grimmelmann. 2017. The Virtues of Moderation. https://doi.org/10.31228/osf.io/qwxf5
[37]
Shengbo Guo, Scott Sanner, Thore Graepel, and Wray Buntine. 2012. Score-Based Bayesian Skill Learning. In Proceedings of the 2012th European Conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I (ECMLPKDD'12). Springer-Verlag, Berlin, Heidelberg, 106--121.
[38]
Robert Hahn, Dawna Fuqua-Whitley, Holly Wethington, Jessica Lowy, Alex Crosby, Mindy Fullilove, Robert Johnson, Akiva Liberman, Eve Moscicki, LeShawndra Price, Susan Snyder, Farris Tuma, Stella Cory, Glenda Stone, Kaushik Mukhopadhaya, Sajal Chattopadhyay, and Linda Dahlberg. 2007. Effectiveness of Universal School-Based Programs to Prevent Violent and Aggressive Behavior. American Journal of Preventive Medicine 33, 2 (Aug. 2007), S114--S129. https://doi.org/10.1016/j.amepre.2007.04.012
[39]
Iain Harris. 2020. Toxicity in Overwatch has seen an 'incredible decrease' due to machine learning. https://www. pcgamesn.com/overwatch/toxic-behaviour-machine-learning.
[40]
Janne Huuskonen. 2022. Toxicity and the hidden dangers of shoddy moderation. https://utopiaanalytics.com/toxicityand-the-hidden-dangers-of-shoddy-content-moderation/
[41]
I.O. Ididi, S. Hassan, A.A.A. Ghani, and N.M. Ali. 2017. Excessive and addictive gaming control using counselling agent in online game design. In AIP Conference Proceedings, Vol. 1891. American Institute of Physics Inc. https://doi.org/10.1063/1.5005398
[42]
Shagun Jhaver, Alice Qian Zhang, Quan Ze Chen, Nikhila Natarajan, Ruotong Wang, and Amy X. Zhang. 2023. Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Labor. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 289 (oct 2023), 33 pages. https://doi.org/10.1145/3610080
[43]
Shagun Jhaver and Amy X Zhang. 2023. Do users want platform moderation or individual control? Examining the role of third-person effects and free speech support in shaping moderation preferences. New Media & Society (Dec. 2023). https://doi.org/10.1177/14614448231217993
[44]
Jialun Aaron Jiang, Peipei Nie, Jed R. Brubaker, and Casey Fiesler. 2023. A Trade-off-centered Framework of Content Moderation. ACM Transactions on Computer-Human Interaction 30, 1 (Feb. 2023), 1--34. https://doi.org/10.1145/3534929
[45]
Edward Kaiser and Wu-chang Feng. 2009. PlayerRating: A Reputation System for Multiplayer Online Games. In Proceedings of the 8th Annual Workshop on Network and Systems Support for Games (NetGames '09). IEEE Press.
[46]
G. Komaç and K. Çagiltay. 2021. Raising Awareness Through Games: The Influence of a Trolling Game on Perception of Toxic Behavior. Springer Series in Design and Innovation 13 (2021), 143--154. https://doi.org/10.1007/978--3-030-65060--5_12
[47]
Bastian Kordyaka, Katharina Jahn, and Bjoern Niehaves. 2020. Towards a unified theory of toxic behavior in video games. INTERNET RESEARCH 30, 4 (Aug. 2020), 1081--1102. https://doi.org/10.1108/INTR-08--2019-0343 Place: HOWARD HOUSE, WAGON LANE, BINGLEY BD16 1WA, W YORKSHIRE, ENGLAND Publisher: EMERALD GROUP PUBLISHING LTD Type: Article.
[48]
Bastian Kordyaka, Solip Park, Jeanine Krath, and Samuli Laato. 2023. Exploring the Relationship Between Offline Cultural Environments and Toxic Behavior Tendencies in Multiplayer Online Games. ACM Transactions on Social Computing 6, 1--2 (June 2023), 1--20. https://doi.org/10.1145/3580346
[49]
Yubo Kou. 2020. Toxic Behaviors in Team-Based Competitive Gaming: The Case of League of Legends. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '20). Association for Computing Machinery, New York, NY, USA, 81--92. https://doi.org/10.1145/3410404.3414243
[50]
Yubo Kou. 2021. Punishment and Its Discontents: An Analysis of Permanent Ban in an Online Game Community. Proc. ACM Hum.-Comput. Interact. 5, CSCW2 (Oct. 2021). https://doi.org/10.1145/3476075
[51]
Y. Kou and X. Gui. 2017. When code governs community. In Proceedings of the Annual Hawaii International Conference on System Sciences, Vol. 2017-January. IEEE Computer Society, 2056--2064. https://www.scopus.com/inward/record. uri?eid=2-s2.0--85108240654&partnerID=40&md5=83c3ad3957b8bdbc96aa5a84a4492893
[52]
Yubo Kou and Xinning Gui. 2021. Flag and Flaggability in Automated Moderation: The Case of Reporting Toxic Behavior in an Online Game Community. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764. 3445279
[53]
Rachel Kowert. 2020. Dark Participation in Games. Frontiers in Psychology 11 (Nov. 2020). https://doi.org/10.3389/fpsyg.2020.598947
[54]
M. Köles and Z. Péter. 2016. "Learn to play, noob!": The identification of ability profiles for different roles in an online multiplayer video game in order to improve the overal quality of the new player experience. In 2016 7th IEEE International Conference on Cognitive Infocommunications (CogInfoCom). 000271--000276. https://doi.org/10.1109/CogInfoCom.2016.7804560
[55]
Anti-Defamation League. 2021. Hate is No Game: Harassment and Positive Social Experiences in Online Games 2021. https://www.adl.org/resources/report/hate-no-game-harassment-and-positive-social-experiences-onlinegames-2021
[56]
Anti-Defamation League. 2022. Hate Is No Game: Hate and Harassment in Online Games 2022 | ADL. https://www.adl.org/resources/report/hate-no-game-hate-and-harassment-online-games-2022
[57]
Anti-Defamation League. 2024. Hate Is No Game: Hate and Harassment in Online Games 2023 | ADL. https://www.adl.org/resources/report/hate-no-game-hate-and-harassment-online-games-2023
[58]
Ho-Suk Lee, Hong-Rae Lee, Jun-U Park, and Yo-Sub Han. 2018. An abusive text detection system based on enhanced abusive and non-abusive word lists. DECISION SUPPORT SYSTEMS 113 (Sept. 2018), 22--31. https://doi.org/10.1016/j. dss.2018.06.009
[59]
Renkai Ma, Yue You, Xinning Gui, and Yubo Kou. 2023. HowDo Users Experience Moderation?: A Systematic Literature Review. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 278 (oct 2023), 30 pages. https://doi.org/10.1145/3610069
[60]
Tim May and Beth Perry. 2014. Reflexivity and the practice of qualitative research. Vol. 109. Sage, Los Angeles, USA, Chapter 8, 109--122.
[61]
Matthew K Miller and Regan L Mandryk. 2016. Differentiating in-game frustration from at-game frustration using touch pressure. In Proceedings of the 2016 ACM international conference on interactive surfaces and spaces. 225--234.
[62]
Makoto Miwa, James Thomas, Alison O'Mara-Eves, and Sophia Ananiadou. 2014. Reducing systematic review workload through certainty-based screening. Journal of Biomedical Informatics 51 (Oct. 2014), 242--253. https://doi.org/10.1016/j.jbi.2014.06.005
[63]
Emily Morrow. 2022. All Anti-Toxicity Changes from Overwatch to Overwatch 2 | Details on Overwatch 2's "Defense Matrix". https://dotesports.com/overwatch/news/all-anti-toxicity-changes-from-overwatch-to-ow2
[64]
Shane Murnion, William J. Buchanan, Adrian Smales, and Gordon Russell. 2018. Machine learning and semantic analysis of in-game chat for cyberbullying. COMPUTERS & SECURITY 76 (July 2018), 197--213. https://doi.org/10. 1016/j.cose.2018.02.016
[65]
Marcus Märtens, Siqi Shen, Alexandru Iosup, and Fernando Kuipers. 2015. Toxicity Detection in Multiplayer Online Games. In Proceedings of the 2015 International Workshop on Network and Systems Support for Games (NetGames '15). IEEE Press.
[66]
Maury Nation, Cindy Crusto, Abraham Wandersman, Karol L. Kumpfer, Diana Seybolt, Erin Morrissey-Kane, and Katrina Davino. 2003. What works in prevention: Principles of effective prevention programs. American Psychologist 58, 6--7 (June 2003), 449--456. https://doi.org/10.1037/0003-066X.58.6--7.449
[67]
Joaquim A. M. Neto and Karin Becker. 2018. Relating conversational topics and toxic behavior effects in a MOBA game. ENTERTAINMENT COMPUTING 26 (May 2018), 10--29. https://doi.org/10.1016/j.entcom.2017.12.004
[68]
Joaquim A. M. Neto, Kazuki M. Yokoyama, and Karin Becker. 2017. Studying Toxic Behavior Influence and Player Chat in an Online Video Game. In Proceedings of the International Conference on Web Intelligence (WI '17). Association for Computing Machinery, New York, NY, USA, 26--33. https://doi.org/10.1145/3106426.3106452
[69]
Call of Duty. 2022. AN UPDATE, CALL OF DUTY ANTI-TOXICITY PROGRESS REPORT. https://www.callofduty. com/blog/2021/05/ANTI-TOXICITY-PROGRESS-REPORT
[70]
Kyle Orland. 2015. Riot rolls out automated, instant bans for League of Legends trolls. https://arstechnica.com/gaming/2015/05/riot-rolls-out-automated-instant-bans-for-league-of-legends-trolls/
[71]
Matthew J Page, Joanne E McKenzie, Patrick M Bossuyt, Isabelle Boutron, Tammy C Hoffmann, Cynthia D Mulrow, Larissa Shamseer, Jennifer M Tetzlaff, Elie A Akl, Sue E Brennan, Roger Chou, Julie Glanville, Jeremy M Grimshaw, Asbjørn Hróbjartsson, Manoj M Lalu, Tianjing Li, Elizabeth W Loder, Evan Mayo-Wilson, Steve McDonald, Luke A McGuinness, Lesley A Stewart, James Thomas, Andrea C Tricco, Vivian A Welch, Penny Whiting, and David Moher. 2021. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ (March 2021), n71. https://doi.org/10.1136/bmj.n71
[72]
Etienne Papegnies, Vincent Labatut, Richard Dufour, and Georges Linares. 2019. Conversational Networks for Automatic Online Moderation. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS 6, 1 (Feb. 2019), 38--55. https://doi.org/10.1109/TCSS.2018.2887240
[73]
Craig Pearson. 2021. Dota 2's player-powered anti-griefing system is here. Rock, Paper, Shotgun (Jan. 2021). https://www.rockpapershotgun.com/dota-2s-player-powered-anti-griefing-system-has-just-gone-live
[74]
C. Platzer. 2011. Sequence-based bot detection in massive multiplayer online games. In 2011 8th International Conference on Information, Communications & Signal Processing. 1--5. https://doi.org/10.1109/ICICS.2011.6174239
[75]
J. Prather, R. Nix, and R. Jessup. 2017. Trust management for cheating detection in distributed massively multiplayer online games. In Annual Workshop on Network and Systems Support for Games. IEEE Computer Society, 40--42. https://doi.org/10.1109/NetGames.2017.7991547
[76]
Elizabeth Reid, Regan L. Mandryk, Nicole A. Beres, Madison Klarkowski, and Julian Frommel. 2022. Feeling Good and In Control: In-Game Tools to Support Targets of Toxicity. Proc. ACM Hum.-Comput. Interact. 6, CHI PLAY (Oct. 2022). https://doi.org/10.1145/3549498
[77]
Elizabeth Reid, Regan L Mandryk, Nicole A Beres, Madison Klarkowski, and Julian Frommel. 2022. 'Bad Vibrations': Sensing Toxicity From In-Game Audio Features. IEEE Transactions on Games 14, 4 (Dec. 2022), 558--568. https://doi.org/10.1109/TG.2022.3176849
[78]
Valentin Riemer, Julian Frommel, Georg Layher, Heiko Neumann, and Claudia Schrader. 2017. Identifying features of bodily expression as indicators of emotional experience during multimedia learning. Frontiers in psychology (2017), 1303.
[79]
Sarah Roberts, Stacy Wood, and Yvonne Eadon. 2023. "We Care About the Internet; We Care About Everything" Understanding Social Media Content Moderators? Mental Models and Support Needs. https://doi.org/10.24251/HICSS. 2023.252
[80]
Kelly Schmidt. 2023. The Results ofWorld ofWarcraft's Social Contract, One Year Later. https://gamerant.com/worldof-warcraft-shadowlands-social-contract-player-behavior-results-good-bad/ Section: Games.
[81]
Dennis Scimeca. 2013. Using science to reform toxic player behavior in League of Legends. https://arstechnica.com/gaming/2013/05/using-science-to-reform-toxic-player-behavior-in-league-of-legends/
[82]
Joseph Seering. 2020. Reconsidering Self-Moderation: the Role of Research in Supporting Community-Based Models for Online Content Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (Oct. 2020), 1--28. https://doi.org/10.1145/3415178
[83]
Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, Portland Oregon USA, 111--125. https://doi.org/10.1145/2998181.2998277
[84]
Sercan Sengün, Joni Salminen, Soon-gyo Jung, Peter Mawhorter, and Bernard J. Jansen. 2019. Analyzing Hate Speech Toward Players from the MENA in League of Legends. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1--6. https://doi.org/10.1145/3290607.3312924
[85]
Sercan Sengün, Joni Salminen, Peter Mawhorter, Soon-gyo Jung, and Bernard Jansen. 2019. Exploring the Relationship Between Game Content and Culture-based Toxicity: A Case Study of League of Legends and MENA Players. In Proceedings of the 30th ACM Conference on Hypertext and Social Media. ACM, Hof Germany, 87--95. https://doi.org/10.1145/3342220.3343652
[86]
L. Shamseer, D. Moher, M. Clarke, D. Ghersi, A. Liberati, M. Petticrew, P. Shekelle, L. A. Stewart, and the PRISMAP Group. 2015. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 349, jan02 1 (Jan. 2015), g7647--g7647. https://doi.org/10.1136/bmj.g7647
[87]
Wai Man Si, Michael Backes, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, Savvas Zannettou, and Yang Zhang. 2022. Why So Toxic? Measuring and Triggering Toxic Behavior in Open-Domain Chatbots. In Proceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security (CCS '22). Association for Computing Machinery, New York, NY, USA, 2659--2673. https://doi.org/10.1145/3548606.3560599
[88]
Peter K. Smith, Jess Mahdavi, Manuel Carvalho, Sonja Fisher, Shanette Russell, and Neil Tippett. 2008. Cyberbullying: its nature and impact in secondary school pupils. Journal of Child Psychology and Psychiatry 49, 4 (April 2008), 376--385. https://doi.org/10.1111/j.1469--7610.2007.01846.x
[89]
Henry Stenhouse. 2020. CS:GO will now auto-mute abusive chatters. https://ag.hyperxgaming.com/article/9447/csgowill-now-auto-mute-abusive-chatters
[90]
Natalia Stepanova, Wesley Muthemba, Ross Todrzak, Michael Cross, Nicholas Ames, and John Raiti. 2021. Natural Language Processing and Sentiment Analysis for Verbal Aggression Detection; A Solution for Cyberbullying during Live Video Gaming. In The 14th PErvasive Technologies Related to Assistive Environments Conference (PETRA 2021). Association for Computing Machinery, New York, NY, USA, 117--118. https://doi.org/10.1145/3453892.3464897
[91]
Facepunch Studios. 2013. Rust. Game [PC].
[92]
John Suler. 2004. The Online Disinhibition Effect. CyberPsychology & Behavior 7, 3 (June 2004), 321--326. https://doi.org/10.1089/1094931041291295
[93]
Paige L. Sweet. 2020. Who Knows? Reflexivity in Feminist Standpoint Theory and Bourdieu. Gender & Society 34, 6 (Nov. 2020), 922--950. https://doi.org/10.1177/0891243220966600
[94]
Anne Clara Tally, Yu Ra Kim, Katreen Boustani, and Christena Nippert-Eng. 2021. Protect and Project: Names, Privacy, and the Boundary Negotiations of Online Video Game Players. Proc. ACM Hum.-Comput. Interact. 5, CSCW1 (April 2021). https://doi.org/10.1145/3449233
[95]
Ibrahim Tanrikulu. 2017. Cyberbullying prevention and intervention programs in schools: A systematic review. School Psychology International (Dec. 2017), 014303431774572. https://doi.org/10.1177/0143034317745721
[96]
Sian Tomkinson and Benn van den Ende. 2022. 'Thank you for your compliance': Overwatch as a Disciplinary System. GAMES AND CULTURE 17, 2 (March 2022), 198--218. https://doi.org/10.1177/15554120211026257
[97]
Selen Türkay, Jessica Formosa, Sonam Adinolf, Robert Cuthbert, and Roger Altizer. 2020. See No Evil, Hear No Evil, Speak No Evil: How Collegiate Players Define, Experience and Cope with Toxicity. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--13. https://doi.org/10.1145/3313831. 3376191
[98]
Uel, Feak Steve, Neichus, and IceFrog. 2003. Defence of the Ancients (DotA).
[99]
Rens Van De Schoot, Jonathan De Bruin, Raoul Schram, Parisa Zahedi, Jan De Boer, Felix Weijdema, Bianca Kramer, Martijn Huijts, Maarten Hoogerwerf, Gerbrich Ferdinands, Albert Harkema, Joukje Willemsen, Yongchao Ma, Qixiang Fang, Sybren Hindriks, Lars Tummers, and Daniel L. Oberski. 2021. An open source machine learning framework for efficient and transparent systematic reviews. Nature Machine Intelligence 3, 2 (Feb. 2021), 125--133. https://doi.org/10.1038/s42256-020-00287--7
[100]
Max van Haastrecht, Injy Sarhan, Bilge Yigit Ozkan, Matthieu Brinkhuis, and Marco Spruit. 2021. SYMBALS: A Systematic Review Methodology Blending Active Learning and Snowballing. Frontiers in Research Metrics and Analytics 6 (May 2021). https://doi.org/10.3389/frma.2021.685591
[101]
C.J. Van Rijsbergen. 1977. A THEORETICAL BASIS FOR THE USE OF CO-OCCURRENCE DATA IN INFORMATION RETRIEVAL. Journal of Documentation 33, 2 (Feb. 1977), 106--119. https://doi.org/10.1108/eb026637
[102]
Hanh Hong-Phuc Vo, Hieu Trung Tran, and Son T Luu. 2021. Automatically Detecting Cyberbullying Comments on Online Game Forums. In 2021 RIVF International Conference on Computing and Communication Technologies (RIVF). 1--5. https://doi.org/10.1109/RIVF51545.2021.9642116
[103]
Michel Wijkstra, Katja Rogers, Regan L. Mandryk, Remco C. Veltkamp, and Julian Frommel. 2023. Help, My Game Is Toxic! First Insights from a Systematic Literature Review on Intervention Systems for Toxic Behaviors in Online Video Games. In Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play (, Stratford, ON, Canada,) (CHI PLAY Companion '23). Association for Computing Machinery, New York, NY, USA, 3--9. https://doi.org/10.1145/3573382.3616068
[104]
Jacob O Wobbrock and Julie A Kientz. 2016. Research contributions in human-computer interaction. interactions 23, 3 (2016), 38--44.
[105]
Jiyoung Woo, Sung Hee Park, and Huy Kang Kim. 2022. Profane or Not: Improving Korean Profane Detection using Deep Learning. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS 16, 1 (Jan. 2022), 305--318. https://doi.org/10.3837/tiis.2022.01.017
[106]
Austin P Wright, Omar Shaikh, Haekyu Park, Will Epperson, Muhammed Ahmed, Stephane Pinel, Duen Horng Chau, and Diyi Yang. 2021. RECAST: Enabling user recourse and interpretability of toxicity detection models with interactive visualization. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1--26.
[107]
Bo Sophia Xiao. 2013. Cyber-Bullying Among University Students: An Empirical Investigation from the Social Cognitive Perspective. 8, 1 (2013).
[108]
Ryan Yen, Li Feng, Brinda Mehra, Ching Christie Pang, Siying Hu, and Zhicong Lu. 2023. StoryChat: Designing a Narrative-Based Viewer Participation Tool for Live Streaming Chatrooms. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1--18. https://doi.org/10.1145/3544548.3580912
[109]
M. Yousefi and D. Emmanouilidou. 2021. Audio-based Toxic Language Classification using Self-attentive Convolutional Neural Network. In 2021 29th European Signal Processing Conference (EUSIPCO). 11--15. https://doi.org/10.23919/ EUSIPCO54536.2021.9616001
[110]
Zhe Yu, Jeffrey C. Carver, Gregg Rothermel, and Tim Menzies. 2022. Assessing expert system-assisted literature reviews with a case study. Expert Systems with Applications 200 (Aug. 2022), 116958. https://doi.org/10.1016/j.eswa.2022.116958

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue CHI PLAY
CHI PLAY
October 2024
1726 pages
EISSN:2573-0142
DOI:10.1145/3700823
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2024
Published in PACMHCI Volume 8, Issue CHI PLAY

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. interventions
  2. online games
  3. systematic literature review
  4. toxicity

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)287
  • Downloads (Last 6 weeks)138
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media