abstract

Head and gaze control of a telepresence robot with an HMD

Authors:

Guangtao ZhangAuthors Info & Claims

ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Article No.: 82, Pages 1 - 3

https://doi.org/10.1145/3204493.3208330

Published: 14 June 2018 Publication History

Get Access

Abstract

Gaze interaction with telerobots is a new opportunity for wheelchair users with severe motor disabilities. We present a video showing how head-mounted displays (HMD) with gaze tracking can be used to monitor a robot that carries a 360° video camera and a microphone. Our interface supports autonomous driving via way-points on a map, along with gaze-controlled steering and gaze typing. It is implemented with Unity, which communicates with the Robot Operating System (ROS).

Supplementary Material

MP4 File (a82-hansen.mp4)

Download
97.86 MB

References

[1]

Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, 424--433.

Digital Library

Google Scholar

[2]

John Paulin Hansen, Javier San Agustin, and Henrik Skovsgaard. 2011. Gaze Interaction from Bed. In Proceedings of the 1st Conference on Novel Gaze-Controlled Applications (NGCA '11). ACM, New York, NY, USA, Article 11, 4 pages.

Digital Library

Google Scholar

[3]

Katsumi Minakata, Martin Thomsen, and John Paulin Hansen. 2018. Bicycles and Wheelchairs for Locomotion Control of a Simulated Telerobot Supported by Gaze- and Head-Interaction. In Proceedings of the 11th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '18). ACM.

Digital Library

Google Scholar

[4]

Kana Misawa and Jun Rekimoto. 2015. ChameleonMask: Embodied Physical and Social Telepresence Using Human Surrogates. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 401--411.

Digital Library

Google Scholar

[5]

Veronica Ahumada Newhart and Judith S. Olson. 2017. My Student is a Robot: How Schools Manage Telepresence Experiences for Students. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 342--347.

Digital Library

Google Scholar

[6]

Vijay Rajanna and John Paulin Hansen. 2018. Gaze Typing in Virtual Reality: Impact of Keyboard Design, Selection Method, and Motion. In Proceedings of the Tenth Biennial ACM Symposium on Eye Tracking Research and Applications (ETRA '18). ACM, New York, NY, USA.

Digital Library

Google Scholar

[7]

Lars Yndal Sørensen and John Paulin Hansen. 2017. A Low-cost Virtual Reality Wheelchair Simulator. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '17). ACM, New York, NY, USA, 242--243.

Digital Library

Google Scholar

[8]

Martin Tall, Alexandre Alapetite, Javier San Agustin, Henrik H.T Skovsgaard, John Paulin Hansen, Dan Witzner Hansen, and Emilie Møllenbach. 2009. Gaze-controlled Driving. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 4387--4392.

Digital Library

Google Scholar

Cited By

View all

Loewen GCochrane KGirouard A(2024)From Imagination to Innovation: Using Participatory Design Fiction to Envision the Future of Accessible Gaming Wearables for Players with Upper Limb Motor DisabilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36770738:CHI PLAY(1-30)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677073
Wu NLiu KCheng RHan BZhou POkoshi TKo JLiKamWa R(2024)Theia: Gaze-driven and Perception-aware Volumetric Content Delivery for Mixed Reality HeadsetsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661858(70-84)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661858
Seo JLim HSuh BLee J(2024)I feel being there, they feel being together: Exploring How Telepresence Robots Facilitate Long-Distance Family CommunicationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642305(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642305
Show More Cited By

Index Terms

Head and gaze control of a telepresence robot with an HMD
1. Human-centered computing
  1. Accessibility
    1. Accessibility technologies

Recommendations

People with Motor Disabilities Using Gaze to Control Telerobots
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Telerobots may give people with motor disabilities access to education, events and places. Eye-gaze interaction with these robots is an option when hands are not functional. Gaze control of telerobots has not yet been evaluated by people from this target ...
Hand- and gaze-control of telepresence robots
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Mobile robotic telepresence systems are increasingly used to promote social interaction between geographically dispersed people. People with severe motor disabilities may use eye-gaze to control a telepresence robots. However, use of gaze control for ...
Accessible control of telepresence robots based on eye tracking
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Gaze may be a good alternative input modality for people with limited hand mobility. This accessible control based on eye tracking can be implemented into telepresence robots, which are widely used to promote remote social interaction and providing the ...

Comments

Information & Contributors

Information

Published In

ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

June 2018

595 pages

ISBN:9781450357067

DOI:10.1145/3204493

Conference Chairs:
Bonita Sharif
Youngstown State University
,
Krzysztof Krejtz
University of Social Sciences and Humanities, Warsaw, Poland

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2018

Check for updates

Author Tags

Qualifiers

Abstract

Conference

ETRA '18

Sponsor:

ETRA '18: 2018 Symposium on Eye Tracking Research and Applications

June 14 - 17, 2018

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
710
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)1

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Loewen GCochrane KGirouard A(2024)From Imagination to Innovation: Using Participatory Design Fiction to Envision the Future of Accessible Gaming Wearables for Players with Upper Limb Motor DisabilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36770738:CHI PLAY(1-30)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677073
Wu NLiu KCheng RHan BZhou POkoshi TKo JLiKamWa R(2024)Theia: Gaze-driven and Perception-aware Volumetric Content Delivery for Mixed Reality HeadsetsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661858(70-84)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661858
Seo JLim HSuh BLee J(2024)I feel being there, they feel being together: Exploring How Telepresence Robots Facilitate Long-Distance Family CommunicationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642305(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642305
Barbareschi GKawaguchi MKato HNagahiro MTakeuchi KShiiba YKasahara SKunze KMinamizawa K(2023)“I am both here and there” Parallel Control of Multiple Robotic Avatars by Disabled Workers in a CaféProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581124(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581124
Cai JGe XTian YGe LShi HWan HXu J(2023)Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye ClickInternational Journal of Human–Computer Interaction10.1080/10447318.2023.216999240:10(2500-2514)Online publication date: 26-Jan-2023
https://doi.org/10.1080/10447318.2023.2169992
Colley MWankmüller BRukzio E(2022)A Systematic Evaluation of Solutions for the Final 100m Challenge of Highly Automated VehiclesProceedings of the ACM on Human-Computer Interaction10.1145/35467136:MHCI(1-19)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546713
Plopski AHirzle TNorouzi NQian LBruder GLanglotz T(2022)The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended RealityACM Computing Surveys10.1145/349120755:3(1-39)Online publication date: 25-Mar-2022
https://dl.acm.org/doi/10.1145/3491207
Vatavu RUngurean O(2022)Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor ImpairmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501964(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501964
Yuan ZLiu YYu L(2022)MEinVR: Multimodal Interaction Paradigms in Immersive Exploration2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00026(85-90)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00026
Zhang GHansen J(2022)Telepresence Robots for People with Special Needs: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2021.200967338:17(1651-1667)Online publication date: 10-Feb-2022
https://doi.org/10.1080/10447318.2021.2009673
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

People with Motor Disabilities Using Gaze to Control Telerobots

Hand- and gaze-control of telepresence robots

Accessible control of telepresence robots based on eye tracking