research-article

Open access

A user study on the relationship between empathy and facial-based emotion simulation in Virtual Reality

Authors:

Genoveffa TortoraAuthors Info & Claims

AVI '24: Proceedings of the 2024 International Conference on Advanced Visual Interfaces

Article No.: 17, Pages 1 - 9

https://doi.org/10.1145/3656650.3656691

Published: 03 June 2024 Publication History

All formats PDF

Abstract

In the contemporary metaverse landscape, comprehending the intricacies of human interaction is imperative for enhancing communication within Virtual Reality (VR) experiences. At the core of meaningful social relationships lie empathy and trust, pivotal elements nurtured by the capacity to comprehend both self and others’ thoughts and intentions. Conventional face-to-face interactions heavily rely on non-verbal cues, such as body language and facial expressions, to convey messages and display empathy.

To investigate the relationship between emotional simulation in VR and empathetic skills, in this paper we conducted a user study involving 37 participants, which were requested of simulating facial expressions in a virtual environment. In order to capture their facial behavior, we employed the Meta Quest Pro, a virtual reality headset featured with accurate built-in sensors for capturing 63 microexpressions, accordingly to the Facial Action Coding System (FACS)[11]. Furthermore, the Interpersonal reactivity index (IRI)[9] questionnaire was used to assess the participants’ empathetic abilities.

The results of this study underscore a statistically significant correlation between participants’ empathetic skills and their capacity to simulate emotions through facial expressions within the context of VR scenarios. Additionally, this research offers valuable insights into the prevalence of human micro-expressions during the simulation of seven distinct emotions. These findings lay the foundation for potential applications in the field of mental health and emotional well-being within the context of metaverse.

References

[1]

Zaheer Allam, Ayyoob Sharifi, Simon Elias Bibri, David Sydney Jones, and John Krogstie. 2022. The metaverse as a virtual form of smart cities: Opportunities and challenges for environmental, economic, and social sustainability in urban futures. Smart Cities 5, 3 (2022), 771–801.

Abstract

References

Cited By

Index Terms

Recommendations

Haptic Vibration for Emotional Expression of Avatar to Enhance the Realism of Virtual Reality

Heightened Empathy: A Multi-user Interactive Experience in a Bioresponsive Virtual Reality

The effect of avatar facial expressions on trust building in social virtual reality

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

HTML Format

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations