research-article

FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs

Authors:

MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 22, Pages 1 - 5

https://doi.org/10.1145/3098279.3098548

Published: 04 September 2017 Publication History

Get Access

Abstract

A head-mounted display (HMD) immerses users in a virtual world, but separates them from outsiders in the real world. We present FrontFace, which is a novel HMD that combines an eye-tracker with a front-facing screen, to lower the communication barrier between HMD users and outsiders. The front-facing screen reveals user attention (e.g., the users eye motions) and user presence in the virtual or real world by displaying the scene in the virtual world or a skin background respectively, enabling eye-contact interactions between the HMD user and the outsiders. FrontFace has the following benefits. Firstly, it communicates the presence of the HMD user to outsiders; secondly, it reveals the player's visual attention by introducing the HMD users originally occluded eye motions, enabling outsiders to make sense of the HMD user's reaction in the virtual world or the real world. Three interactive techniques for the outsiders to initiate communication to HMD users are proposed: they are tap-trigger, hand-gesture trigger, and voice-trigger interactions. A small focus group provided feedback.

References

[1]

B. Ens, T. Grossman, F. Anderson, J. Matejka, and G. Fitzmaurice. 2015. Candid Interaction: Revealing Hidden Mobile and Wearable Computing Activities. In 28th An. ACM Symp. on User Interface Software Technology (UIST '15). ACM, New York, NY, USA, 467--476.

Digital Library

Google Scholar

[2]

J. Falk and S. Björk. 1999. The BubbleBadge: A Wearable Public Display. In Extended Abstracts on Human Factors in Computing Systems (CHI EA '99). ACM, New York, NY, USA, 318--319.

Digital Library

Google Scholar

[3]

J. Gugenheimer, E. Stemasov, J. Frommel, and E. Rukzio. 2017. ShareVR: Enabling Co-Located Experiences for Virtual Reality Between HMD and Non-HMD Users. In Conf. on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4021--4033.

Digital Library

Google Scholar

[4]

H. Ibayashi, Y. Sugiura, D. Sakamoto, N. Miyata, M. Tada, T. Okuma, T. Kurata, M. Mochimaru, and T. Igarashi. 2015. Dollhouse VR: A Multi-view, Multi-user Collaborative Design Workspace with VR Technology. In SIGGRAPH Asia 2015 Emerging Technologies (SA '15). ACM, New York, NY, USA, Article 8, 2 pages.

Digital Library

Google Scholar

[5]

M. McGill, D. Boland, R. Murray-Smith, and S. Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In 33rd An. ACM Conf. on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2143--2152.

Digital Library

Google Scholar

[6]

K. Misawa and J. Rekimoto. 2015. Wearing Another's Personality: A Human-surrogate System with a Telepresence Face. In ACM Int. Symp. on Wearable Computers (ISWC '15). ACM, New York, NY, USA, 125--132.

Digital Library

Google Scholar

[7]

H. Osawa. 2014. Emotional Cyborg: Human Extension with Agency for Emotional Labor. In ACM/IEEE Int. Conf. on Human-robot Interaction (HRI '14). ACM, New York, NY, USA, 108--108.

Digital Library

Google Scholar

[8]

M. Page and A. V. Moere. 2007. Evaluating a Wearable Display Jersey for Augmenting Team Sports Awareness. In 5th Int. Conf. on Pervasive Computing (PERVASIVE'07). Springer-Verlag, Berlin, Heidelberg, 91--108.

Digital Library

Google Scholar

[9]

J. Pearson, S. Robinson, and M. Jones. 2015. It's About Time: Smartwatches As Public Displays. In 33rd An. ACM Conf. on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1257--1266.

Digital Library

Google Scholar

[10]

S. Qiu, S.A. Anas, H. Osawa, M. Rauterberg, and J. Hu. 2016. E-Gaze Glasses: Simulating Natural Gazes for Blind People. In 10th Int. Conf. on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 563--569.

Digital Library

Google Scholar

[11]

X. Yang, K. Hasan, N. Bruce, and P. Irani. 2013. Surround-see: Enabling Peripheral Vision on Smartphones During Active Use. In 26th An. ACM Symp. on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 291--300.

Digital Library

Google Scholar

Cited By

View all

SHINDO AFUKUSHIMA SHAUTASAARI ANAEMURA T(2024)CoVR+: Design of Visual Effects for Promoting Joint Attention During Shared VR Experiences via a Projection of HMD User's ViewIEICE Transactions on Information and Systems10.1587/transinf.2023HCP0011E107.D:3(374-382)Online publication date: 1-Mar-2024
https://doi.org/10.1587/transinf.2023HCP0011
Bozgeyikli EBozgeyikli LGomes V(2024)Googly Eyes: Exploring Effects of Displaying User’s Eyes Outward on a Virtual Reality Head-Mounted Display on User Experience2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00117(979-989)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00117
Krois SYigitbas E(2024)Prototyping Cross-Reality Escape RoomsHuman-Centered Software Engineering10.1007/978-3-031-64576-1_5(84-104)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-64576-1_5
Show More Cited By

Index Terms

FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs
1. Human-centered computing

Recommendations

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

We present SoEs (Sword of Elements), an attachable augmented haptic device for enhancing gaming controller in the immersive first-person game. Generally, Player can easily receive visual and auditory feedback through head-mounted displays (HMD) and ...
Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...

Comments

Information & Contributors

Information

Published In

MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2017

874 pages

ISBN:9781450350754

DOI:10.1145/3098279

General Chairs:
Matt Jones
Swansea University
,
Manfred Tscheligi
University of Salzburg and AIT
,
Program Chairs:
Yvonne Rogers
University College London
,
Roderick Murray-Smith
University of Glasgow

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 September 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministry of Science and Technology, Taiwan
JST ACCEL Embodied Media Project

Conference

MobileHCI '17

Sponsor:

SIGCHI

MobileHCI '17: 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 4 - 7, 2017

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 23 of 95 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
1,148
Total Downloads

Downloads (Last 12 months)71
Downloads (Last 6 weeks)11

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

SHINDO AFUKUSHIMA SHAUTASAARI ANAEMURA T(2024)CoVR+: Design of Visual Effects for Promoting Joint Attention During Shared VR Experiences via a Projection of HMD User's ViewIEICE Transactions on Information and Systems10.1587/transinf.2023HCP0011E107.D:3(374-382)Online publication date: 1-Mar-2024
https://doi.org/10.1587/transinf.2023HCP0011
Bozgeyikli EBozgeyikli LGomes V(2024)Googly Eyes: Exploring Effects of Displaying User’s Eyes Outward on a Virtual Reality Head-Mounted Display on User Experience2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00117(979-989)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00117
Krois SYigitbas E(2024)Prototyping Cross-Reality Escape RoomsHuman-Centered Software Engineering10.1007/978-3-031-64576-1_5(84-104)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-64576-1_5
Li JPark HWelsch RMayer SButz A(2023)SeatmateVR: Proxemic Cues for Close Bystander-Awareness in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36264747:ISS(266-285)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626474
Auda JGruenefeld UFaltaous SMayer SSchneegass S(2023)A Scoping Survey on Cross-reality SystemsACM Computing Surveys10.1145/361653656:4(1-38)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3616536
Zhang SLi YMan KYue YSmith J(2023)Towards Cross-Reality Interaction and Collaboration: A Comparative Study of Object Selection and Manipulation in Reality and Virtuality2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00075(330-337)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00075
Wu SLi JSousa MGrossman T(2023)Investigating Guardian Awareness Techniques to Promote Safety in Virtual Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00078(631-640)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00078
Auda JFaltaous SGruenefeld UMayer SSchneegass S(2023)The Actuality-Time Continuum: Visualizing Interactions and Transitions Taking Place in Cross-Reality Systems2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00015(35-40)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00015
Wang CChen BChan L(2022)RealityLens: A User Interface for Blending Customized Physical World View into Virtual RealityProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545686(1-11)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545686
Bozgeyikli EGomes V(2022)Googly Eyes: Displaying User's Eyes on a Head-Mounted Display for Improved Nonverbal CommunicationExtended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play10.1145/3505270.3558348(253-260)Online publication date: 2-Nov-2022
https://dl.acm.org/doi/10.1145/3505270.3558348
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality

SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction

Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations