research-article

Hand- and gaze-control of telepresence robots

Authors:

Guangtao Zhang,

John Paulin Hansen,

Katsumi MinakataAuthors Info & Claims

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Article No.: 70, Pages 1 - 8

https://doi.org/10.1145/3317956.3318149

Published: 25 June 2019 Publication History

Abstract

Mobile robotic telepresence systems are increasingly used to promote social interaction between geographically dispersed people. People with severe motor disabilities may use eye-gaze to control a telepresence robots. However, use of gaze control for navigation of robots needs to be explored. This paper presents an experimental comparison between gaze-controlled and hand-controlled telepresence robots with a head-mounted display. Participants (n = 16) had similar experience of presence and self-assessment, but gaze control was 31% slower than hand control. Gaze-controlled robots had more collisions and higher deviations from optimal paths. Moreover, with gaze control, participants reported a higher workload, a reduced feeling of dominance, and their situation awareness was significantly degraded. The accuracy of their post-trial reproduction of the maze layout and the trial duration were also significantly lower.

References

[1]

Margaret M Bradley and Peter J Lang. 1994. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry 25, 1 (1994), 49--59.

[2]

Jan Ciger, Bruno Herbelin, and Daniel Thalmann. 2004. Evaluation of gaze tracking technology for social interaction in virtual environments. In Proc. of the 2nd Workshop on Modeling and Motion Capture Techniques for Virtual Environments (CAPTECH'04). 1--6.

[3]

Francis T Durso, M Kathryn Bleckley, and Andrew R Dattel. 2006. Does situation awareness add to the validity of cognitive tests? Human Factors 48, 4 (2006), 721--733.

[4]

Mohamad A Eid, Nikolas Giakoumidis, and Abdulmotaleb El-Saddik. 2016. A Novel Eye-Gaze-Controlled Wheelchair System for Navigating Unknown Environments: Case Study With a Person With ALS. IEEE Access 4 (2016), 558--573.

[5]

Mica R Endsley. 1995. Measurement of situation awareness in dynamic systems. Human factors 37, 1 (1995), 65--84.

[6]

Mica R Endsley. 2000. Direct Measurement of Situation Awareness: Validity and Use of SAGAT. In Situation Awareness Analysis and Measurement, M. R. Endsley & D. J. Garland (Ed.). Lawrence Erlbaum Associates, Mahwah NJ, 147--173.

[7]

Gauthier Gras and Guang-Zhong Yang. 2016. Intention recognition for gaze controlled robotic minimally invasive laser ablation. In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on. IEEE, 2431--2437.

Digital Library

[8]

John Paulin Hansen, Alexandre Alapetite, I Scott MacKenzie, and Emilie Møllenbach. 2014. The use of gaze to control drones. In Proceedings of the Symposium on Eye Tracking Research and Applications. ACM, 27--34.

Digital Library

[9]

John Paulin Hansen, Alexandre Alapetite, Martin Thomsen, Zhongyu Wang, Katsumi Minakata, and Guangtao Zhang. 2018. Head and gaze control of a telepresence robot with an HMD. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications. ACM, Article 82.

Digital Library

[10]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183.

[11]

Yasamin Heshmat, Brennan Jones, Xiaoxuan Xiong, Carman Neustaedter, Anthony Tang, Bernhard E Riecke, and Lillian Yang. 2018. Geocaching with a Beam: Shared Outdoor Activities through a Telepresence Robot with 360 Degree Viewing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 359.

Digital Library

[12]

PA Howarth and M Finch. 1999. The nauseogenicity of two methods of navigating within a virtual environment. Applied Ergonomics 30, 1 (1999), 39--45.

[13]

Poika Isokoski, Markus Joos, Oleg Spakov, and Benoît Martin. 2009. Gaze controlled games. Universal Access in the Information Society 8, 4 (2009), 323.

Digital Library

[14]

Anja Jackowski and Marion Gebhard. 2017. Evaluation of hands-free human-robot interaction using a head gesture based interface. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 141--142.

Digital Library

[15]

Steven Johnson, Irene Rae, Bilge Mutlu, and Leila Takayama. 2015. Can you see me now?: How field of view affects collaboration in robotic telepresence. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2397--2406.

Digital Library

[16]

Min Kyung Lee and Leila Takayama. 2011. Now, I have a body: Uses and social norms for mobile remote presence in the workplace. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 33--42.

Digital Library

[17]

Robert Leeb, Luca Tonin, Martin Rohm, Lorenzo Desideri, Tom Carlson, and José del R Millán. 2015. Towards independence: a BCI telepresence robot for people with sever emotor disabilities. Proc. IEEE 103, 6 (2015), 969--982.

[18]

Päivi Majaranta, Ulla-Kaija Ahola, and Oleg Špakov. 2009. Fast gaze typing with an adjustable dwell time. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 357--360.

Digital Library

[19]

Marvin Minsky. 1980. Telepresence. Omni 2, 9 (1980), 44--52.

[20]

Irene Rae and Carman Neustaedter. 2017. Robotic Telepresence at Scale. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 313--324.

Digital Library

[21]

Irene Rae, Leila Takayama, and Bilge Mutlu. 2013. The influence of height in robot-mediated communication. In Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction. IEEE Press, 1--8.

Digital Library

[22]

Thomas B Sheridan. 1992. Musings on telepresence and virtual presence. Presence: Teleoperators & Virtual Environments 1, 1 (1992), 120--126.

[23]

Aaron Steinfeld, Terrence Fong, David Kaber, Michael Lewis, Jean Scholtz, Alan Schultz, and Michael Goodrich. 2006. Common metrics for human-robot interaction. In Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. ACM, 33--40.

Digital Library

[24]

Martin Tall, Alexandre Alapetite, Javier San Agustin, Henrik HT Skovsgaard, John Paulin Hansen, Dan Witzner Hansen, and Emilie Mollenbach. 2009. Gaze-controlled driving. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, 4387--4392.

Digital Library

[25]

Fumihide Tanaka, Toshimitsu Takahashi, Shizuko Matsuzoe, Nao Tazawa, and Masahiko Morita. 2014. Telepresence robot helps children in communicating with teachers who speak a different language. In Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction. ACM, 399--406.

Digital Library

[26]

Anthony Tang and Omid Fakourfar. 2017. Watching 360 videos together. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 4501--4506.

Digital Library

[27]

Anthony Tang, Omid Fakourfar, Carman Neustaedter, and Scott Bateman. 2017. Collaboration in 360 Videochat: Challenges and Opportunities. Technical Report. University of Calgary.

[28]

Katherine M Tsui, Kelsey Flynn, Amelia McHugh, Holly A Yanco, and David Kontak. 2013. Designing speech-based interfaces for telepresence robots for people with disabilities. In Rehabilitation Robotics (ICORR), 2013 IEEE International Conference on. IEEE, 1--8.

[29]

Ker-Jiun Wang, Hsiao-Wei Tung, Zihang Huang, Prakash Thakur, Zhi-Hong Mao, and Ming-Xian You. 2018. EXGbuds: Universal Wearable Assistive Device for Disabled People to Interact with the Environment Seamlessly. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 369--370.

Digital Library

[30]

Bob G Witmer and Michael J Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence 7, 3 (1998), 225--240.

Digital Library

[31]

Lillian Yang, Brennan Jones, Carman Neustaedter, and Samarth Singhal. 2018. Shopping Over Distance through a Telepresence Robot. Proceedings of the ACM on Human-Computer Interaction 2, CSCW, Article 191 (2018).

Digital Library

[32]

Lillian Yang and Carman Neustaedter. 2018. Our House: Living Long Distance with a Telepresence Robot. Proceedings of the ACM on Human-Computer Interaction 2, CSCW, Article 190 (2018).

Digital Library

[33]

Lillian Yang, Carman Neustaedter, and Thecla Schiphorst. 2017. Communicating through a telepresence robot: A study of long distance relationships. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3027--3033.

Digital Library

[34]

Guangtao Zhang, John Paulin Hansen, Katsumi Minakata, Alexandre Alapetite, and Zhongyu Wang. 2019. Eye-Gaze-Controlled Telepresence Robots for People with Motor Disabilities. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 574--575.

Cited By

Kimoto MShiomi M(2024)The experience of a tele-operated avatar being touched increases operator’s sense of discomfortPeerJ Computer Science10.7717/peerj-cs.192610(e1926)Online publication date: 19-Mar-2024
https://doi.org/10.7717/peerj-cs.1926
Seo JLim HSuh BLee J(2024)I feel being there, they feel being together: Exploring How Telepresence Robots Facilitate Long-Distance Family CommunicationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642305(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642305
Ikoma HTakeuchi Y(2024) Automatic Joint Gaze Generation between Local and Remote Persons through Telepresence Robot * 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731321(631-637)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731321
Show More Cited By

Index Terms

Hand- and gaze-control of telepresence robots
1. Human-centered computing
  1. Accessibility
    1. Accessibility technologies

Recommendations

People with Motor Disabilities Using Gaze to Control Telerobots
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Telerobots may give people with motor disabilities access to education, events and places. Eye-gaze interaction with these robots is an option when hands are not functional. Gaze control of telerobots has not yet been evaluated by people from this target ...
Head and gaze control of a telepresence robot with an HMD
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Gaze interaction with telerobots is a new opportunity for wheelchair users with severe motor disabilities. We present a video showing how head-mounted displays (HMD) with gaze tracking can be used to monitor a robot that carries a 360° video camera and ...
Accessible control of telepresence robots based on eye tracking
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Gaze may be a good alternative input modality for people with limited hand mobility. This accessible control based on eye tracking can be implemented into telepresence robots, which are widely used to promote remote social interaction and providing the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

June 2019

623 pages

ISBN:9781450367097

DOI:10.1145/3314111

Conference Chairs:
Krzysztof Krejtz
SWPS University, Poland
,
Bonita Sharif
University of Nebraska-Lincoln

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

ETRA '19

Sponsor:

ETRA '19: 2019 Symposium on Eye Tracking Research and Applications

June 25 - 28, 2019

Colorado, Denver

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
595
Total Downloads

Downloads (Last 12 months)63
Downloads (Last 6 weeks)3

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kimoto MShiomi M(2024)The experience of a tele-operated avatar being touched increases operator’s sense of discomfortPeerJ Computer Science10.7717/peerj-cs.192610(e1926)Online publication date: 19-Mar-2024
https://doi.org/10.7717/peerj-cs.1926
Seo JLim HSuh BLee J(2024)I feel being there, they feel being together: Exploring How Telepresence Robots Facilitate Long-Distance Family CommunicationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642305(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642305
Ikoma HTakeuchi Y(2024) Automatic Joint Gaze Generation between Local and Remote Persons through Telepresence Robot * 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)10.1109/RO-MAN60168.2024.10731321(631-637)Online publication date: 26-Aug-2024
https://doi.org/10.1109/RO-MAN60168.2024.10731321
Zhang GHansen SBehrens OHansen J(2024)Saccade response testing during teleoperations with a head-mounted displayCognition, Technology and Work10.1007/s10111-023-00750-626:1(127-138)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s10111-023-00750-6
Zhang HYin LZhang H(2024)A real-time camera-based gaze-tracking system involving dual interactive modes and its application in gamingMultimedia Systems10.1007/s00530-023-01204-930:1Online publication date: 16-Jan-2024
https://dl.acm.org/doi/10.1007/s00530-023-01204-9
Barth VJones VAthapaththu AMcCue L(2023)Gaze Controlled Underwater Remotely Operated Vehicle (ROV) to Improve Accessibility in Maritime RoboticsOCEANS 2023 - Limerick10.1109/OCEANSLimerick52467.2023.10244706(1-6)Online publication date: 5-Jun-2023
https://doi.org/10.1109/OCEANSLimerick52467.2023.10244706
Joos LKlein KFischer MDennig FKeim DKrone M(2023)Exploring Trajectory Data in Augmented Reality: A Comparative Study of Interaction Modalities2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00094(790-799)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00094
Zdravkova KKrasniqi VDalipi FFerati M(2022)Cutting-edge communication and learning assistive technologies for disabled children: An artificial intelligence perspectiveFrontiers in Artificial Intelligence10.3389/frai.2022.9704305Online publication date: 28-Oct-2022
https://doi.org/10.3389/frai.2022.970430
Colley MWankmüller BRukzio E(2022)A Systematic Evaluation of Solutions for the Final 100m Challenge of Highly Automated VehiclesProceedings of the ACM on Human-Computer Interaction10.1145/35467136:MHCI(1-19)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546713
Plopski AHirzle TNorouzi NQian LBruder GLanglotz T(2022)The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended RealityACM Computing Surveys10.1145/349120755:3(1-39)Online publication date: 25-Mar-2022
https://dl.acm.org/doi/10.1145/3491207
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents