poster

Towards Enabling Eye Contact and Perspective Control in Video Conference

Authors:

Md Tahsin Tausif,

Sang Won LeeAuthors Info & Claims

UIST '20 Adjunct: Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Pages 96 - 98

https://doi.org/10.1145/3379350.3416197

Published: 20 October 2020 Publication History

Abstract

Eye contact is an important part of in-person communication. However, in modern remote communication - video conference calls, non-verbal cues through eye contact are lost. This is because it is not possible to make eye contact in a video call; to make it look like a person is making an eye contact, the user has to look at the camera directly, but then this means that the user is not looking at the visual of the interlocutor on the screen. In our research, we aim to build a hardware and software system that helps the users to make eye contact in video conference and change their perspective, placing a moving camera behind a semi-transparent screen. The system keeps the position of camera right behind the remote user's eye position on screen tracked by a computer vision algorithm, so users will be able to make eye contact during the video call. We believe the system will lead to better user experience in remote conference calls. In this work, we share our motivation, design choices, the current progress, and a plan to evaluate the system.

References

[1]

Hironori Akechi, Atsushi Senju, Helen Uibo, Yukiko Kikuchi, Toshikazu Hasegawa, and Jari K Hietanen. 2013. Attention to eye contact in the West and East: Autonomic responses and evaluative ratings. PloS one 8, 3 (2013), e59312.

[2]

Milton Chen. 2002. Leveraging the asymmetric sensitivity of eye contact for videoconference. In Proceedings of the SIGCHI conference on Human factors in computing systems. 49--56.

Digital Library

[3]

Meia Chita-Tegmark. 2016. Social attention in ASD: a review and meta-analysis of eye-tracking studies. Research in developmental disabilities 48 (2016), 79--93.

[4]

J. Gemmell, K. Toyama, C. L. Zitnick, T. Kang, and S. Seitz. 2000. Gaze awareness for video-conferencing: a software approach. IEEE MultiMedia 7, 4 (2000), 26--35.

Digital Library

[5]

Hiroshi Ishii and Minoru Kobayashi. 1992. ClearBoard: A Seamless Medium for Shared Drawing and Conversation with Eye Contact. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). Association for Computing Machinery, New York, NY, USA, 525--532.

Digital Library

[6]

Seungwon Kim, Mark Billinghurst, Gun Lee, Mitchell Norman, Weidong Huang, and Jian He. 2019. Sharing emotion by displaying a partner near the gaze point in a Telepresence system. In 2019 23rd International Conference in Information Visualization--Part II. IEEE, 86--91.

[7]

Claudia Kuster, Tiberiu Popa, Jean-Charles Bazin, Craig Gotsman, and Markus Gross. 2012. Gaze correction for home video conferencing. ACM Transactions on Graphics (TOG) 31, 6 (2012), 1--6.

Digital Library

[8]

Carman Neustaedter and Saul Greenberg. 2012. Intimacy in long-distance relationships over video chat. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 753--762.

Digital Library

[9]

David Nguyen and John Canny. 2005a. MultiView: Spatially Faithful Group Video Conferencing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). Association for Computing Machinery, New York, NY, USA, 799--808.

Digital Library

[10]

David Nguyen and John Canny. 2005b. MultiView: spatially faithful group video conferencing. In Proceedings of the SIGCHI conference on human factors in computing systems. 799--808.

Digital Library

[11]

David T Nguyen and John Canny. 2007. Multiview: improving trust in group video conferencing through spatial faithfulness. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1465--1474.

Digital Library

[12]

Ken-Ichi Okada, Fumihiko Maeda, Yusuke Ichikawaa, and Yutaka Matsushita. 1994. Multiparty Videoconferencing at Virtual Social Distance: MAJIC Design. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work (CSCW '94). Association for Computing Machinery, New York, NY, USA, 385--393.

Digital Library

[13]

Gary M Olson and Judith S Olson. 2000. Distance matters. Human--computer interaction 15, 2--3 (2000), 139--178.

Digital Library

[14]

Alexandra Papoutsaki, Patsorn Sangkloy, James Laskey, Nediyana Daskalova, Jeff Huang, and James Hays. 2016. WebGazer: Scalable Webcam Eye Tracking Using User Interactions. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI). AAAI, 3839--3845.

Digital Library

[15]

Magdalena Rychlowska, Leah Zinner, Serban C Musca, and Paula M Niedenthal. 2012. From the eye to the heart: Eye contact triggers emotion simulation. In Proceedings of the 4th workshop on eye gaze in intelligent human machine interaction. 1--7.

Digital Library

[16]

Roel Vertegaal, Ivo Weevers, Changuk Sohn, and Chris Cheung. 2003. GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction. In Proceedings of the SIGCHI conference on Human factors in computing systems. 521--528.

Digital Library

[17]

Noortje Vriends, Yasemin Meral, Javier A Bargas-Avila, Christina Stadler, and Susan M Bögels. 2017. How do I look? Self-focused attention during a video chat of women with social anxiety (disorder). Behaviour Research and Therapy 92 (2017), 77--86.

[18]

Emma Warnock-Parkes, Jennifer Wild, Richard Stott, Nick Grey, Anke Ehlers, and David M Clark. 2017. Seeing is believing: Using video feedback in cognitive therapy for social anxiety disorder. Cognitive and behavioral practice 24, 2 (2017), 245--255.

Cited By

Mori AKato INarumi KTakekuma YIshikawa SKashiwagi HSato YSugawara MKobayashi M(2025)Impact of Eye Contact on Communication during Online Medication Counseling: An Analysis Using the Roter Interaction Analysis SystemBiological and Pharmaceutical Bulletin10.1248/bpb.b24-0048948:1(17-22)Online publication date: 23-Jan-2025
https://doi.org/10.1248/bpb.b24-00489
Atarashi YYokoyama KShizuki B(2024)Investigation of Unconscious Gaze and Head Direction in Videoconference - Turning off Microphone/Camera by Unconscious Gaze and Head Direction -Proceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3655645(1-3)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3655645
Li NRomera Rodriguez GXu YBhatt PNguyen HSerpi ATsai CCarroll JKizilcec RDavis KOchoa X(2022)Picturing One's Self: Camera Use in Zoom Classes during the COVID-19 PandemicProceedings of the Ninth ACM Conference on Learning @ Scale10.1145/3491140.3528284(151-162)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1145/3491140.3528284
Show More Cited By

Index Terms

Towards Enabling Eye Contact and Perspective Control in Video Conference

Recommendations

Video-oculography eye tracking towards clinical applications: A review
Abstract
Most neurological diseases are usually accompanied by a broad spectrum of oculomotor alterations. Being able to record and analyze these different types of eye movements would be a valuable tool to understand the functional integrity ...
Highlights
- Invariance to head movements is one of the biggest challenges in eye tracking.
- ...
Towards the detection of driver–pedestrian eye contact
Abstract
Non-verbal communication, such as eye contact between drivers and pedestrians, has been regarded as one way to reduce accident risk. So far, studies have assumed rather than objectively measured the occurrence of eye contact. We ...
Eye contact sensing glasses for attention-sensitive wearable video blogging
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing Systems

We present ECSGlasses: eye contact sensing glasses that report when people look at their wearer. When eye contact is detected, the glasses stream this information to appliances to inform these about the wearer's engagement. We present one example of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '20 Adjunct: Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

October 2020

203 pages

ISBN:9781450375153

DOI:10.1145/3379350

General Chairs:
Shamsi Iqbal
Microsoft Research, USA
,
Karon MacLean
University of British Columbia, Canada
,
Program Chairs:
Fanny Chevalier
University of Toronto, Canada
,
Stefanie Mueller
MIT CSAIL, USA

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2020

Check for updates

Author Tags

Qualifiers

Poster

Conference

UIST '20

Sponsor:

UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology

October 20 - 23, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
376
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)4

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mori AKato INarumi KTakekuma YIshikawa SKashiwagi HSato YSugawara MKobayashi M(2025)Impact of Eye Contact on Communication during Online Medication Counseling: An Analysis Using the Roter Interaction Analysis SystemBiological and Pharmaceutical Bulletin10.1248/bpb.b24-0048948:1(17-22)Online publication date: 23-Jan-2025
https://doi.org/10.1248/bpb.b24-00489
Atarashi YYokoyama KShizuki B(2024)Investigation of Unconscious Gaze and Head Direction in Videoconference - Turning off Microphone/Camera by Unconscious Gaze and Head Direction -Proceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3655645(1-3)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3655645
Li NRomera Rodriguez GXu YBhatt PNguyen HSerpi ATsai CCarroll JKizilcec RDavis KOchoa X(2022)Picturing One's Self: Camera Use in Zoom Classes during the COVID-19 PandemicProceedings of the Ninth ACM Conference on Learning @ Scale10.1145/3491140.3528284(151-162)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1145/3491140.3528284
Zhang YYang JLiu ZWang RChen GTong XGuo B(2022)VirtualCube: An Immersive 3D Video Communication SystemIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.315051228:5(2146-2156)Online publication date: May-2022
https://doi.org/10.1109/TVCG.2022.3150512

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten