UAV Control Using Eye Gestures: Exploring the Skies Through Your Eyes
Authors: 
Brandon Dominic Vilela, Kshitij Kokkera, Amirahmad Chapnevis, Eyuphan BulutAuthors Info & Claims
Brandon Dominic Vilela, Kshitij Kokkera, Amirahmad Chapnevis, Eyuphan BulutAuthors Info & ClaimsPages 447 - 452
Abstract
Unmanned aerial vehicle (UAV) technology has become increasingly pivotal in various industries including agriculture, emergencies, and transportation. However, there is a growing need for more intuitive and unobtrusive control mechanisms. In response, our team has developed a groundbreaking technique that optimizes drone control and tracking through operator gaze. Through the use of eye-tracking interaction, we have created a more intuitive approach to human operation, which reduces operator workload and improves overall efficiency. After extensive testing on the Parrot ANAFI drone, we have concluded that this implementation has the potential to revolutionize drone control and elevate it to new heights.
References
[1]
Eyuphan Bulut and Ismail Guevenc. 2018. Trajectory optimization for cellular-connected UAVs with disconnectivity constraint. In 2018 IEEE International Conference on Communications Workshops (ICC Workshops). IEEE, 1--6.
[2]
Amirahmad Chapnevis and Eyuphan Bulut. 2023. AoI-Optimal Cellular-Connected UAV Trajectory Planning for IoT Data Collection. In IEEE 48th Conference on Local Computer Networks (LCN).
[3]
Amirahmad Chapnevis, Ismail Güvenç, Laurent Njilla, and Eyuphan Bulut. 2021. Collaborative trajectory optimization for outage-aware cellular-enabled UAVs. In 2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring). IEEE, 1--6.
[4]
Md Moin Uddin Chowdhury, Sung Joon Maeng, Eyuphan Bulut, and Ismail Güvenç. 2020. 3-D trajectory optimization in UAV-assisted cellular networks considering antenna radiation pattern and backhaul constraint. IEEE Trans. Aerospace Electron. Systems 56, 5 (2020), 3735--3750.
[5]
Okan Erat, Werner Alexander Isop, Denis Kalkofen, and Dieter Schmalstieg. 2018. Drone-Augmented Human Vision: Exocentric Control for Drones Exploring Hidden Areas. IEEE Transactions on Visualization and Computer Graphics 24, 4 (2018), 1437--1446.
[6]
Zabih Ghelichi, Monica Gentili, and Pitu B Mirchandani. 2021. Logistics for a fleet of drones for medical item delivery: A case study for Louisville, KY. Computers & Operations Research 135 (2021), 105443.
[7]
John Paulin Hansen, Alexandre Alapetite, I Scott MacKenzie, and Emilie Møllenbach. 2014. The use of gaze to control drones. In Proceedings of the symposium on eye tracking research and applications. 27--34.
[8]
Mohamed Khamis, Anna Kienle, Florian Alt, and Andreas Bulling. 2018. Gaze-Drone: Mobile eye-based interaction in public space without augmenting the user. In Proceedings of the 4th ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications. 66--71.
[9]
Saifuddin Mahmud, Xiangxu Lin, Jong-Hoon Kim, Hasib Iqbal, MD Rahat-Uz-Zaman, Sakib Reza, and M Asifur Rahman. 2019. A multi-modal human machine interface for controlling a smart wheelchair. In IEEE 7th conference on systems, process and control (ICSPC). 10--13.
[10]
Eleni Mangina, Evan O'Keeffe, Joe Eyerman, and Lizbeth Goodman. 2016. Drones for live streaming of visuals for people with limited mobility. In 22nd International Conference on Virtual System Multimedia (VSMM). 1--6.
[11]
James Mardell, Mark Witkowski, and Robert Spence. 2009. Detecting search and rescue targets in moving aerial images using eye-Gaze. COGAIN2009 Proceedings (2009), 67.
[12]
Parrot. 2023. https://developer.parrot.com/docs/olympe/index.html.
[13]
Kayla Pineda, Bhanuka Mahanama, Vikas Ashok, and Sampath Jayarathna. 2023. Gaze-Augmented Drone Navigation. In Proceedings of the Augmented Humans International Conference 2023. 363--366.
[14]
Hazim Shakhatreh, Ahmad H Sawalmeh, Ala Al-Fuqaha, Zuochao Dou, Eyad Almaita, Issa Khalil, Noor Shamsiah Othman, Abdallah Khreishah, and Mohsen Guizani. 2019. Unmanned aerial vehicles (UAVs): A survey on civil applications and key research challenges. Ieee Access 7 (2019), 48572--48634.
[15]
Tobii Pro Nano Specifications. 2023. https://www.tobii.com/products/eye-trackers/screen-based/tobii-pro-nanospecifications.
[16]
Tobii Pro Coordinate System. 2023. https://developer.tobiipro.com/commoncon-cepts/coordinatesystems.html.
[17]
Ginger S Watson, Yiannis E Papelis, and Katheryn C Hicks. 2016. Simulation-based environment for the eye-tracking control of tele-operated mobile robots. In Proceedings of the Modeling and Simulation of Complexity in Intelligent, Adaptive and Autonomous Systems 2016 (MSCIAAS 2016) and Space Simulation for Planetary Space Exploration (SPACE 2016). 1--7.
[18]
Liangzhe Yuan, Christopher Reardon, Garrett Warnell, and Giuseppe Loianno. 2019. Human gaze-driven spatial tasking of an autonomous MAV. IEEE Robotics and Automation Letters 4, 2 (2019), 1343--1350.
Index Terms
- UAV Control Using Eye Gestures: Exploring the Skies Through Your Eyes
Recommendations
Simple gaze gestures and the closure of the eyes as an interaction technique
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and ApplicationsWe created a set of gaze gestures that utilize the following three elements: simple one-segment gestures, off-screen space, and the closure of the eyes. These gestures are to be used as the moving tool in a gaze-only controlled drawing application. We ...
Automatic Control for Aerobatic Maneuvering of Agile Fixed-Wing UAVs
The use of unmanned aerial vehicles (UAVs) has become ubiquitous in a broadening range of applications, including many civilian uses. UAVs are typically categorized into two categories: conventional fixed-wing aircraft, which are associated with ...
ITU Tailless UAV Design
Nowadays, mini Unmanned Aerial Vehicles (UAVs) are utilized in a wide range of reconnaissance and surveillance missions with an ever increasing need for endurance and range. Thus, a slight improvement on these two primary performance parameters is ...
Comments
Information & Contributors
Information
Published In
October 2023
621 pages
ISBN:9781450399265
DOI:10.1145/3565287
- General Chairs:
- Jie Wu,
- Suresh Subramaniam,
- Program Chairs:
- Bo Ji,
- Carla Fabiana Chiasserini
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- NSF
Conference
MobiHoc '23
Sponsor:
MobiHoc '23: Twenty-fourth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing
October 23 - 26, 2023
DC, Washington, USA
Acceptance Rates
Overall Acceptance Rate 296 of 1,843 submissions, 16%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 94Total Downloads
- Downloads (Last 12 months)63
- Downloads (Last 6 weeks)10
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in