poster

Investigating the Non-verbal Behavior Features of Bullying for the Development of an Automatic Recognition System in Social Virtual Reality

Authors:

Cristina Fiani,

Stacy MarsellaAuthors Info & Claims

AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

Article No.: 67, Pages 1 - 3

https://doi.org/10.1145/3531073.3534492

Published: 06 June 2022 Publication History

Abstract

We look at the possibilities of automatically detecting social discomfort and social anxiety via non-verbal behaviours in social Virtual Reality (VR). This is important because a well-developed automatic recognition system could facilitate interventions and moderation in social VR without requiring real-time parental supervision. To initially explore this question of recognition, we prototyped a small set of 3D stimuli representing a bullying scenario and explored in a small formative preliminary study what human observers perceived from the stimuli. Future work is required with different problematic situations in social VR and evaluations with more participants before developing an automatic recognition system.

Supplemental Material

PDF File

Appendix

Download
6.61 MB

ZIP File

Supplemental videos

Download
65.67 MB

References

[1]

2022. Character Creator 3 - Free Trial. https://www.reallusion.com/character-creator/download.html

[2]

Jeremy N Bailenson, Nick Yee, Dan Merget, and Ralph Schroeder. 2006. The Effect of Behavioral Realism and Form Realism of Real-Time Avatar Faces on Verbal Disclosure, Nonverbal Disclosure, Emotion Recognition, and Copresence in Dyadic Interaction. 15 (2006), 359–372. Issue 4. http://direct.mit.edu/pvar/article-pdf/15/4/359/1624480/pres.15.4.359.pdf

[3]

Woodrow Barfield and Claudia Hendrix. 1995. The effect of update rate on the sense of presence within virtual environments. Virtual Reality 1995 1:1 1 (6 1995), 3–15. Issue 1. https://doi.org/10.1007/BF02009709

Digital Library

[4]

Judee K. Burgoon and Norah E. Dunbar. 2006. Nonverbal expressions of dominance and power in human relationships. The SAGE Handbook of Nonverbal Communication (1 2006), 279–298. https://doi.org/10.4135/9781412976152.N15

[5]

Cristina Fiani. 2022. Animations. https://youtube.com/playlist?list=PL0U-U5mRRSYxbQujtEWxj75IZWkt5tq3a

[6]

Geoffrey Gorisse. 2021. Virtual human (avatar and agent) procedural animation toolkit for Unity. https://github.com/GeoffreyGorisse/VHProject

[7]

Edward Hall. 1968. Proxemics. Current Anthropology 9(1968), 83–108. Issue 2/3. https://www.jstor.org/stable/2740724?seq=1

[8]

Katherine Isbister and Clifford Nass. 2000. Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics. International Journal of Human-Computer Studies 53 (8 2000), 251–267. Issue 2. https://doi.org/10.1006/IJHC.2000.0368

Digital Library

[9]

Fakhra Jabeen, Jan Treur, Nizar A. Hirzalla, Thomas M. Maaiveld, and Charlotte Gerritsen. 2020. Victim no more: a temporal-causal analysis of how a mediator can help out a bullying victim. https://doi.org/10.1080/24751839.2020.1724739 4 (2020), 229–250. Issue 2. https://doi.org/10.1080/24751839.2020.1724739

[10]

Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence: Teleoperators and Virtual Environments 21 (11 2012), 373–387. Issue 4. https://doi.org/10.1162/PRES_A_00124

Digital Library

[11]

Tobias Kolodziey. 2016. Linus - CC Project - Character Creator/actor - Reallusion Marketplace. https://marketplace.reallusion.com/linus---cc-project

[12]

Leon O.H. Kroczek, Michael Pfaller, Bastian Lange, Mathias Müller, and Andreas Mühlberger. 2020. Interpersonal Distance During Real-Time Social Interaction: Insights From Subjective Experience, Behavior, and Physiology. Frontiers in Psychiatry 11 (6 2020), 561. https://doi.org/10.3389/FPSYT.2020.00561/BIBTEX

[13]

Divine Maloney, Guo Freeman, and Andrew Robb. 2020. A Virtual Space for All: Exploring Children’s Experience in Social Virtual Reality. CHI PLAY 2020 - Proceedings of the Annual Symposium on Computer-Human Interaction in Play (11 2020), 472–483. https://doi.org/10.1145/3410404.3414268

Digital Library

[14]

Divine Maloney, Guo Freeman, and Andrew Robb. 2021. Stay Connected in An Immersive World: Why Teenagers Engage in Social Virtual Reality. Proceedings of Interaction Design and Children, IDC 2021 (6 2021), 69–79. https://doi.org/10.1145/3459990.3460703

Digital Library

[15]

Divine Maloney, Guo Freeman, and Donghee Yvette Wohn. 2020. ”Talking without a Voice”: Understanding Non-Verbal Communication in Social Virtual Reality. Proceedings of the ACM on Human-Computer Interaction 4 (10 2020). Issue CSCW2. https://doi.org/10.1145/3415246

Digital Library

[16]

Corey A. Pavlich, Stephen A. Rains, and Chris Segrin. 2017. The Nonverbal Bully: Effects of Shouting and Conversational Distance on Bystanders’ Perceptions. http://dx.doi.org/10.1080/08934215.2017.1315439 30 (9 2017), 129–141. Issue 3. https://doi.org/10.1080/08934215.2017.1315439

[17]

Giuseppe Riva, Luca Bernardelli, Matthew H.E.M. Browning, Gianluca Castelnuovo, Silvia Cavedoni, Alice Chirico, Pietro Cipresso, Dirce Maria Bengel de Paula, Daniele Di Lernia, Javier Fernández-Álvarez, Natàlia Figueras-Puigderrajols, Kei Fuji, Andrea Gaggioli, Jose Gutiérrez-Maldonado, Upyong Hong, Valentina Mancuso, Milena Mazzeo, Enrico Molinari, Luciana F. Moretti, Angelica B. Ortiz de Gortari, Francesco Pagnini, Elisa Pedroli, Claudia Repetto, Francesca Sforza, Chiara Stramba-Badiale, Cosimo Tuena, Clelia Malighetti, Daniela Villani, and Brenda K. Wiederhold. 2020. COVID Feel Good—An Easy Self-Help Virtual Reality Protocol to Overcome the Psychological Burden of Coronavirus. Frontiers in Psychiatry 11 (9 2020). https://doi.org/10.3389/FPSYT.2020.563319

[18]

Lara Rösler, Stefan Göhring, Michael Strunz, and Matthias Gamer. 2021. Social anxiety is associated with heart rate but not gaze behavior in a real social interaction. Journal of Behavior Therapy and Experimental Psychiatry 70 (3 2021), 101600. https://doi.org/10.1016/J.JBTEP.2020.101600

[19]

Lars Schulze, Babette Renneberg, and Janek S. Lobmaier. 2013. Gaze perception in social anxiety and social anxiety disorder. Frontiers in Human Neuroscience 7 (12 2013), 872. Issue DEC. https://doi.org/10.3389/FNHUM.2013.00872/BIBTEX

[20]

Masanori Takano and Takaaki Tsunoda. 2019. Self-Disclosure of Bullying Experiences and Social Support in Avatar Communication: Analysis of Verbal and Nonverbal Communications. https://ojs.aaai.org/index.php/ICWSM/article/view/3353/3221

[21]

Julie Williamson, Jie Li, Vinoba Vinayagamoorthy, David A. Shamma, and Pablo Cesar. 2021. Proxemics and Social Interactions in an Instrumented Virtual Reality Workshop. Conference on Human Factors in Computing Systems - Proceedings (1 2021). https://doi.org/10.1145/3411764.3445729

Digital Library

Cited By

Freeman GFrommel JMandryk RGugenheimer JLi LJohnson DAragon CAsif SBailey JBarkallah MBurger BCmentowski SHancock JHides LHu HHu YLi WPanchanadikar RSayadi NTebbe DWöhler LYou XZhang ZZytko DFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Understanding and Mitigating New Harms in Immersive and Embodied Virtual Spaces: A Speculative Dystopian Design Fiction ApproachCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681865(288-295)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681865
Freeman GFrommel JMandryk RGugenheimer JLi LJohnson D(2024)Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024Extended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636288(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636288
Fiani CBretin RMacdonald SKhamis MMcgill M(2024)"Pikachu would electrocute people who are misbehaving": Expert, Guardian and Child Perspectives on Automated Embodied Moderators for Safeguarding Children in Social Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642144(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642144
Show More Cited By

Recommendations

My Body, My Avatar: How People Perceive Their Avatars in Social Virtual Reality
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

The perception and experience of avatars has been critical to understand the social dynamics in virtual environments, online gaming, and collaborative systems. How would emerging sociotechnical systems further complicate the role of avatars in our online ...
A Virtual Space for All: Exploring Children's Experience in Social Virtual Reality
CHI PLAY '20: Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Social virtual reality (VR) is increasingly becoming an emerging online social ecosystem where multiple users can interact with one another through VR head-mounted displays in 3Dvirtual spaces. The co-existence of minors and adults in social VR presents ...
Exploring the Perspectives of Social VR-Aware Non-Parent Adults and Parents on Children's Use of Social Virtual Reality
CSCW

Social Virtual Reality (VR), where people meet in virtual spaces via 3D avatars, is used by children and adults alike. Children experience new forms of harassment in social VR where it is often inaccessible to parental oversight. To date, there is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

June 2022

414 pages

ISBN:9781450397193

DOI:10.1145/3531073

General Chair:
Paolo Bottoni
Sapienza University of Rome, Italy
,
Program Chair:
Emanuele Panizzi
Sapienza University of Rome, Italy

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2022

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Data Availability

Appendix https://dl.acm.org/doi/10.1145/3531073.3534492#Appendix.pdf

Supplemental videos https://dl.acm.org/doi/10.1145/3531073.3534492#animation.zip

Conference

AVI 2022

AVI 2022: International Conference on Advanced Visual Interfaces

June 6 - 10, 2022

Frascati, Rome, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
207
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)5

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Freeman GFrommel JMandryk RGugenheimer JLi LJohnson DAragon CAsif SBailey JBarkallah MBurger BCmentowski SHancock JHides LHu HHu YLi WPanchanadikar RSayadi NTebbe DWöhler LYou XZhang ZZytko DFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Understanding and Mitigating New Harms in Immersive and Embodied Virtual Spaces: A Speculative Dystopian Design Fiction ApproachCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681865(288-295)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681865
Freeman GFrommel JMandryk RGugenheimer JLi LJohnson D(2024)Novel Approaches for Understanding and Mitigating Emerging New Harms in Immersive and Embodied Virtual Spaces: A Workshop at CHI 2024Extended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636288(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636288
Fiani CBretin RMacdonald SKhamis MMcgill M(2024)"Pikachu would electrocute people who are misbehaving": Expert, Guardian and Child Perspectives on Automated Embodied Moderators for Safeguarding Children in Social Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642144(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642144
Ribeiro AVieira VAlves LMaciel C(2024)VISHnuInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103243185:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103243
Zheng QXu SWang LTang YSalvi RFreeman GHuang Y(2023)Understanding Safety Risks and Safety Design in Social VR EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/35796307:CSCW1(1-37)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579630
Fang SYatani K(2023)Towards Understanding Sense of Inclusion in Social VR OnboardingExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585751(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585751

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents