skip to main content
10.1145/3411764.3445698acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

MirrorBlender: Supporting Hybrid Meetings with a Malleable Video-Conferencing System

Published: 07 May 2021 Publication History

Abstract

In hybrid meetings, multiple co-located participants communicate with remote participants through video. But video communication inhibits non-verbal cues, and this often causes remote participants to feel excluded. To address this issue, we built MirrorBlender: a What-You-See-Is-What-I-See video-conferencing system for blending, repositioning, and resizing mirrors. Mirrors here denote shared video feeds of people and screens. In a qualitative study of MirrorBlender with three hybrid meeting sessions, we found that the shared control of mirrors supported users in negotiating a blended interpersonal space. Moreover, it enabled diverse acts of inclusion of remote participants. In particular, remote participants brought attention to themselves by manipulating the position, scale, and translucency of their camera and screen feeds. Participants also embodied and leveraged their mirror images for deictic gestures and playful interactions. Based on these findings, we discuss new opportunities for supporting video-mediated collaboration.

Supplementary Material

VTT File (3411764.3445698_videofigurecaptions.vtt)
MP4 File (3411764.3445698_videopreview.mp4)
Preview video
MP4 File (3411764.3445698_videofigure.mp4)
Supplemental video

References

[1]
Ignacio Avellino, Cédric Fleury, and Michel Beaudouin-Lafon. 2015. Accuracy of Deictic Gestures to Support Telepresence on Wall-Sized Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2393–2396. https://doi.org/10.1145/2702123.2702448
[2]
Ignacio Avellino, Cédric Fleury, Wendy E. Mackay, and Michel Beaudouin-Lafon. 2017. CamRay: Camera Arrays Support Remote Collaboration on Wall-Sized Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6718–6729. https://doi.org/10.1145/3025453.3025604
[3]
Mathilde M. Bekker, Judith S. Olson, and Gary M. Olson. 1995. Analysis of Gestures in Face-to-Face Design Teams Provides Guidance for How to Use Groupware in Design. In Proceedings of the 1st Conference on Designing Interactive Systems: Processes, Practices, Methods, & Techniques (Ann Arbor, Michigan, USA) (DIS ’95). Association for Computing Machinery, New York, NY, USA, 157–166. https://doi.org/10.1145/225434.225452
[4]
Steve Benford, Chris Greenhalgh, Gail Reynard, Chris Brown, and Boriana Koleva. 1998. Understanding and constructing shared spaces with mixed-reality boundaries. ACM Transactions on computer-human interaction (TOCHI) 5, 3(1998), 185–223.
[5]
Mark Billinghurst and Hirokazu Kato. 1999. Real World Teleconferencing. In CHI ’99 Extended Abstracts on Human Factors in Computing Systems (Pittsburgh, Pennsylvania) (CHI EA ’99). Association for Computing Machinery, New York, NY, USA, 194–195. https://doi.org/10.1145/632716.632838
[6]
Sara A. Bly, Steve R. Harrison, and Susan Irwin. 1993. Media Spaces: Bringing People Together in a Video, Audio, and Computing Environment. Commun. ACM 36, 1 (Jan. 1993), 28–46. https://doi.org/10.1145/151233.151235
[7]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
[8]
Barrett Ens, Joel Lanir, Anthony Tang, Scott Bateman, Gun Lee, Thammathip Piumsomboon, and Mark Billinghurst. 2019. Revisiting collaboration through mixed reality: The evolution of groupware. International Journal of Human-Computer Studies 131 (2019), 81–98.
[9]
Rachel Franklin. 2017. Facebook spaces: A new way to connect with friends in vr. https://about.fb.com/news/2017/04/facebook-spaces/.
[10]
Susan R. Fussell, Leslie D. Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam D. I. Kramer. 2004. Gestures over Video Streams to Support Remote Collaboration on Physical Tasks. Hum.-Comput. Interact. 19, 3 (Sept. 2004), 273–309. https://doi.org/10.1207/s15327051hci1903_3
[11]
Saul Greenberg, Carl Gutwin, and Mark Roseman. 1996. Semantic telepointers for groupware. In Proceedings Sixth Australian Conference on Computer-Human Interaction. IEEE, 54–61.
[12]
Simon N. B. Gunkel, Hans M. Stokking, Martin J. Prins, Nanda van der Stap, Frank B. ter Haar, and Omar A. Niamut. 2018. Virtual Reality Conferencing: Multi-User Immersive VR Experiences on the Web. In Proceedings of the 9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18). Association for Computing Machinery, New York, NY, USA, 498–501. https://doi.org/10.1145/3204949.3208115
[13]
Steve Harrison and Paul Dourish. 1996. Re-Place-Ing Space: The Roles of Place and Space in Collaborative Systems. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (Boston, Massachusetts, USA) (CSCW ’96). Association for Computing Machinery, New York, NY, USA, 67–76. https://doi.org/10.1145/240080.240193
[14]
Christian Heath and Paul Luff. 1992. Media space and communicative asymmetries: Preliminary observations of video-mediated interaction. Human–Computer Interaction 7, 3 (1992), 315–346.
[15]
Christian Heath and Paul Luff. 1993. Disembodied conduct: Interactional asymmetries in video-mediated communication. Technology in working order: Studies of work, interaction, and technology (1993), 35–54.
[16]
Jim Hollan and Scott Stornetta. 1992. Beyond Being There. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI ’92). Association for Computing Machinery, New York, NY, USA, 119–125. https://doi.org/10.1145/142750.142769
[17]
Hiroshi Ishii, Minoru Kobayashi, and Jonathan Grudin. 1993. Integration of Interpersonal Space and Shared Workspace: ClearBoard Design and Experiments. ACM Trans. Inf. Syst. 11, 4 (Oct. 1993), 349–375. https://doi.org/10.1145/159764.159762
[18]
Demetrios Karis, Daniel Wildman, and Amir Mané. 2016. Improving Remote Collaboration With Video Conferencing and Video Portals. Human–Computer Interaction 31, 1 (2016), 1–58. https://doi.org/10.1080/07370024.2014.921506
[19]
David Kirk, Tom Rodden, and Danaë Stanton Fraser. 2007. Turn it this way: grounding collaborative action with remote gestures. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 1039–1048.
[20]
David Kirk and Danae Stanton Fraser. 2006. Comparing remote gesture technologies for supporting collaborative physical tasks. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 1191–1200.
[21]
Clemens N. Klokmose, James R. Eagan, Siemen Baader, Wendy Mackay, and Michel Beaudouin-Lafon. 2015. Webstrates: Shareable Dynamic Media. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 280–290. https://doi.org/10.1145/2807442.2807446
[22]
Peter Gall Krogh, Marianne Graves Petersen, Kenton O’Hara, and Jens Emil Grønbæk. 2017. Sensitizing Concepts for Socio-Spatial Literacy in HCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6449–6460. https://doi.org/10.1145/3025453.3025756
[23]
Anastasia Kuzminykh and Sean Rintel. 2020. Classification of Functional Attention in Video Meetings. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[24]
Anastasia Kuzminykh and Sean Rintel. 2020. Low Engagement As a Deliberate Practice of Remote Participants in Video Meetings. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–9.
[25]
Joshua McVeigh-Schultz, Anya Kolesnichenko, and Katherine Isbister. 2019. Shaping Pro-Social Interaction in VR: An Emerging Design Framework. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300794
[26]
Osamu Morikawa and Takanori Maesako. 1998. HyperMirror: Toward Pleasant-to-Use Video Mediated Communication System. In Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’98). Association for Computing Machinery, New York, NY, USA, 149–158. https://doi.org/10.1145/289444.289489
[27]
Thomas Neumayr, Hans-Christian Jetter, Mirjam Augstein, Judith Friedl, and Thomas Luger. 2018. Domino: A descriptive framework for hybrid collaboration and coupling styles in partially distributed teams. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–24.
[28]
Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-Time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 741–754. https://doi.org/10.1145/2984511.2984517
[29]
Kenton O’hara, Jesper Kjeldskov, and Jeni Paay. 2011. Blended Interaction Spaces for Distributed Team Collaboration. ACM Trans. Comput.-Hum. Interact. 18, 1, Article 3 (May 2011), 28 pages. https://doi.org/10.1145/1959022.1959025
[30]
Roman Rädle, Midas Nouwens, Kristian Antonsen, James R. Eagan, and Clemens N. Klokmose. 2017. Codestrates: Literate Computing with Webstrates. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 715–725. https://doi.org/10.1145/3126594.3126642
[31]
Banu Saatçi, Kaya Akyüz, Sean Rintel, and Clemens Nylandsted Klokmose. 2020. (Re)Configuring Hybrid Meetings: Moving from User-Centered Design to Meeting-Centered Design. Computer Supported Cooperative Work (CSCW) 29, 6 (Nov 2020), 769–794. https://doi.org/10.1007/s10606-020-09385-x
[32]
Banu Saatçi, Roman Rädle, Sean Rintel, Kenton O’Hara, and Clemens Nylandsted Klokmose. 2019. Hybrid Meetings in the Modern Workplace: Stories of Success and Failure. In International Conference on Collaboration and Technology. Springer, 45–61.
[33]
Stacey D Scott, M Sheelagh T Carpendale, and Kori M Inkpen. 2004. Territoriality in collaborative tabletop workspaces. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. 294–303.
[34]
Sofia Seinfeld, Tiare Feuchtner, Antonella Maselli, and Jörg Müller. 2020. User Representations in Human-Computer Interaction. Human–Computer Interaction 0, 0 (2020), 1–39. https://doi.org/10.1080/07370024.2020.1724790
[35]
Jared Spataro. 2020. The future of work—the good, the challenging & the unknown. https://www.microsoft.com/en-us/microsoft-365/blog/2020/07/08/future-work-good-challenging-unknown/. (Accessed on 14/08/2020).
[36]
M. Stefik, D. G. Bobrow, G. Foster, S. Lanning, and D. Tatar. 1987. WYSIWIS Revised: Early Experiences with Multiuser Interfaces. ACM Trans. Inf. Syst. 5, 2 (April 1987), 147–167. https://doi.org/10.1145/27636.28056
[37]
Anthony Tang, Michael Boyle, and Saul Greenberg. 2003. Display and presence disparity in Mixed Presence Groupware. (2003).
[38]
Aiden Wickey and Leila Alem. 2007. Analysis of Hand Gestures in Remote Collaboration: Some Design Recommendations. In Proceedings of the 19th Australasian Conference on Computer-Human Interaction: Entertaining User Interfaces (Adelaide, Australia) (OZCHI ’07). Association for Computing Machinery, New York, NY, USA, 87–93. https://doi.org/10.1145/1324892.1324909
[39]
Nelson Wong and Carl Gutwin. 2014. Support for Deictic Pointing in CVEs: Still Fragmented after All These Years’. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (Baltimore, Maryland, USA) (CSCW ’14). Association for Computing Machinery, New York, NY, USA, 1377–1387. https://doi.org/10.1145/2531602.2531691
[40]
Nicole Yankelovich, Nigel Simpson, Jonathan Kaplan, and Joe Provino. 2007. Porta-person: telepresence for the connected conference room. In CHI’07 extended abstracts on Human factors in computing systems. 2789–2794.
[41]
Nicole Yankelovich, William Walker, Patricia Roberts, Mike Wessler, Jonathan Kaplan, and Joe Provino. 2004. Meeting central: making distributed meetings more effective. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. 419–428.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
May 2021
10862 pages
ISBN:9781450380966
DOI:10.1145/3411764
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Hybrid meetings
  2. blended interaction spaces
  3. inclusive meetings
  4. shareable dynamic media
  5. video conferencing

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHI '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)352
  • Downloads (Last 6 weeks)19
Reflects downloads up to 09 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Revisiting Grudin’s eight challenges for developers of groupware technologies 30 years lateri-com10.1515/icom-2023-003923:1(7-31)Online publication date: 21-Mar-2024
  • (2024)Assessing Cognitive and Social Awareness among Group Members in AI-assisted CollaborationProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701582(338-350)Online publication date: 1-Dec-2024
  • (2024)There Is More to Avatars Than Visuals: Investigating Combinations of Visual and Auditory User Representations for Remote Collaboration in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981488:ISS(540-568)Online publication date: 24-Oct-2024
  • (2024)The Quest for "How to do Hybrid right": Moving Beyond Compensating Asymmetries to Experience-Driven CooperationProceedings of the ACM on Human-Computer Interaction10.1145/36869838:CSCW2(1-30)Online publication date: 8-Nov-2024
  • (2024)TableBot: Getting a Handle on Hybrid Collaboration by Negotiating Control of a Tabletop Telepresence RobotProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685350(1-15)Online publication date: 13-Oct-2024
  • (2024)MyWebstrates: Webstrates as Local-first SoftwareProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676445(1-12)Online publication date: 13-Oct-2024
  • (2024)BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AIProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676326(1-19)Online publication date: 13-Oct-2024
  • (2024)The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video MeetingsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661507(1638-1657)Online publication date: 1-Jul-2024
  • (2024)Comparing the Agency of Hybrid Meeting Remote Users in 2D and 3D Interfaces of the Hybridge SystemExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651103(1-12)Online publication date: 11-May-2024
  • (2024)Temaneki: Map-Based Collaboration Tool for Consensus-Building in Student-Run Festival Management TeamsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651013(1-8)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media