An Experimental Video Conference Platform to Bridge the Gap Between Digital and In-Person Communication
Authors: 
Chloe Eghtebas, Alexander Liebald, Maria Pospelova, Ashika Manjunath, Julian Geheeb, Norma Puspitasari, Jamie A Ward, Gudrun KlinkerAuthors Info & Claims
Chloe Eghtebas, Alexander Liebald, Maria Pospelova, Ashika Manjunath, Julian Geheeb, Norma Puspitasari, Jamie A Ward, Gudrun KlinkerAuthors Info & ClaimsPages 35 - 39
Abstract
With many contemporary video conferencing platforms available, there is still a need for platforms that afford a researcher workflow to conduct controlled online experiments. We have developed an open source experimental video conferencing platform that enables researchers to design and conduct remote experiments. Our platform provides a high level of control over the user interface and video streams, which is essential for studying the differences between remote and in-person social interactions. We give an overview of our platform’s usage and architecture and conduct a take-home study (N=9) to evaluate how accessible our system is to potential new contributors. We also follow up with an initial evaluation of technical performance bottlenecks for when our experimental platform is deployed, and show that the computational resources increases per each video stream as well as the type of filters applied to each participant. We end with a short discussion on next steps and the experimental hub’s potential to be extended as a sandbox for testing browser based augmented reality (WebAR) filters to be adopted in interdisciplinary experimental procedures.
References
[1]
Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency. 2016. Openface: an open source facial behavior analysis toolkit. In 2016 IEEE winter conference on applications of computer vision (WACV). IEEE, 1–10.
[2]
Virginia Braun and Victoria Clarke. 2022. Thematic Analysis: a Practical Guide. SAGE, Los Angeles London New Delhi Singapore Washington DC Melbourne.
[3]
Chloe Eghtebas, Gudrun Klinker, Susanne Boll, and Marion Koelle. 2023. Co-Speculating on Dark Scenarios and Unintended Consequences of a Ubiquitous(Ly) Augmented Reality. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 2392–2407. https://doi.org/10.1145/3563657.3596073
[4]
Chris Elsden, David Chatting, Michael Duggan, Andrew Carl Dwyer, and Pip Thornton. 2022. Zoom Obscura: Counterfunctional Design for Video-Conferencing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 143, 17 pages. https://doi.org/10.1145/3491102.3501973
[5]
Sean Follmer, Hayes Raffle, Janet Go, and Hiroshi Ishii. 2010. Video Play: Playful Interactions in Video Conferencing for Long-Distance Families with Young Children. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3397–3402. https://doi.org/10.1145/1753846.1753991
[6]
Shrikant Garg, Ayushi Srivastava, Mashhuda Glencross, and Ojaswa Sharma. 2022. A Study of the Effects of Network Latency on Visual Task Performance in Video Conferencing. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 213, 7 pages. https://doi.org/10.1145/3491101.3519678
[7]
Maximilian Henneberg, Chloe Eghtebas, Oliver De Candido, Kai Kunze, and Jamie A Ward. 2023. Detecting an Offset-Adjusted Similarity Score Based on Duchenne Smiles. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 83, 5 pages. https://doi.org/10.1145/3544549.3585709
[8]
Margaret A Hughes and Deb Roy. 2021. Keeper: A synchronous online conversation environment informed by in-person facilitation practices. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
[9]
Bart Jansen, Timothy Goodwin, Varun Gupta, Fernando Kuipers, and Gil Zussman. 2018. Performance Evaluation of WebRTC-Based Video Conferencing. SIGMETRICS Perform. Eval. Rev. 45, 3 (mar 2018), 56–68. https://doi.org/10.1145/3199524.3199534
[10]
Ross Johnstone, Neil McDonnell, and Julie R. Williamson. 2022. When Virtuality Surpasses Reality: Possible Futures of Ubiquitous XR. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 6, 8 pages. https://doi.org/10.1145/3491101.3516396
[11]
Jaewook Lee, Raahul Natarrajan, Sebastian S. Rodriguez, Payod Panda, and Eyal Ofek. 2022. RemoteLab: A VR Remote Study Toolkit. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 51, 9 pages. https://doi.org/10.1145/3526113.3545679
[12]
Tobias Loetscher, Nadia Siena Jurkovic, Stefan Carlo Michalski, Mark Billinghurst, and Gun Lee. 2023. Online platforms for remote immersive Virtual Reality testing: an emerging tool for experimental behavioral research. Multimodal Technologies and Interaction 7, 3 (2023), 32.
[13]
Mark Roman Miller, Hanseul Jun, Fernanda Herrera, Jacob Yu Villa, Greg Welch, and Jeremy N Bailenson. 2019. Social interaction in augmented reality. PloS one 14, 5 (2019), e0216290.
[14]
Le Nguyen, Manuel Lage Cañellas, Constantino Álvarez Casado, Xiaoting Wu, and Miguel Bordallo López. 2023. Synchrony-Based Depression Score Aggregation from Single-Modality Models. In Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers (Cambridge, United Kingdom) (UbiComp/ISWC ’22 Adjunct). Association for Computing Machinery, New York, NY, USA, 198–201. https://doi.org/10.1145/3544793.3563410
[15]
Alexandra Paxton, Rick Dale, and Daniel C Richardson. 2016. Social coordination of verbal and non-verbal behaviours. In Interpersonal coordination and performance in social systems. Routledge, 277–292.
[16]
Alexandra Paxton, Nelle Varoquaux, Chris Holdgraf, and R Stuart Geiger. 2022. Community, Time, and (Con) text: A Dynamical Systems Analysis of Online Communication and Community Health among Open-Source Software Communities. Cognitive Science 46, 5 (2022), e13134.
[17]
Susruthi Rajanala, Mayra BC Maymone, and Neelam A Vashi. 2018. Selfies—living in the era of filtered photographs. JAMA facial plastic surgery 20, 6 (2018), 443–444.
[18]
Rabindra Ratan, Dave B Miller, and Jeremy N Bailenson. 2022. Facial appearance dissatisfaction explains differences in zoom fatigue. Cyberpsychology, Behavior, and Social Networking 25, 2 (2022), 124–129.
[19]
Zhaodong Sun, Alexander Vedernikov, Virpi-Liisa Kykyri, Mikko Pohjola, Miriam Nokia, and Xiaobai Li. 2023. Estimating Stress in Online Meetings by Remote Physiological Signal and Behavioral Features. In Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers (Cambridge, United Kingdom) (UbiComp/ISWC ’22 Adjunct). Association for Computing Machinery, New York, NY, USA, 216–220. https://doi.org/10.1145/3544793.3563406
[20]
Takuro Yonezawa and Hideyuki Tokuda. 2012. Enhancing Communication and Dramatic Impact of Online Live Performance with Cooperative Audience Control. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (Pittsburgh, Pennsylvania) (UbiComp ’12). Association for Computing Machinery, New York, NY, USA, 103–112. https://doi.org/10.1145/2370216.2370234
Index Terms
- An Experimental Video Conference Platform to Bridge the Gap Between Digital and In-Person Communication
Recommendations
Gestural communication over video stream: supporting multimodal interaction for remote collaborative physical tasks
ICMI '03: Proceedings of the 5th international conference on Multimodal interfacesWe present a system integrating gesture and live video to support collaboration on physical tasks. The architecture combines network IP cameras, desktop PCs, and tablet PCs to allow a remote helper to draw on a video feed of a workspace as he/she ...
Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace
GROUP '10: Proceedings of the 2010 ACM International Conference on Supporting Group WorkIn this paper we present a mixed presence groupware device called "CollaBoard". The device improves collaboration between co-located and remote partners by providing a high level of workspace awareness. This is achieved by superimposing a life-size ...
Exploring trust in group-to-group video-conferencing
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsPrevious work has shown that supporting trust via computer-mediated communication can be a challenge, especially among strangers. In this paper, we report on an experiment comparing two group-to-group video-conferencing environments and face-to-face ...
Comments
Information & Contributors
Information
Published In
October 2023
822 pages
ISBN:9798400702006
DOI:10.1145/3594739
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 October 2023
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Funding Sources
Conference
UbiComp/ISWC '23: The 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing
October 8 - 12, 2023
Cancun, Quintana Roo, Mexico
Acceptance Rates
Overall Acceptance Rate 764 of 2,912 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 175Total Downloads
- Downloads (Last 12 months)92
- Downloads (Last 6 weeks)1
Reflects downloads up to 22 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format