Busy beeway: a game for testing human-automation collaboration for navigation
Article No.: 9, Pages 1 - 6
Abstract
This study presents Busy Beeway, a mobile game platform to investigate human-automation collaboration in dynamic environments. In Busy Beeway, users collaborate with automation to evade stochastically moving obstacles and reach a series of goals, in game levels of increasing difficulty. We are motivated by the need for reliable navigation aids in stochastic, dynamic environments, which are highly relevant for self-driving vehicles, UAVs, underwater and surface vehicles, and other applications. The proposed mobile game platform is agnostic to the particular algorithm underlying the autonomous system, can be used to evaluate both fully autonomous as well as human-in-the-loop systems, and is easily deployable, for large, remote user studies. This last element is key for rigorous study of human factors in navigation aids. Through a small 32--user study, we evaluate preliminary findings regarding the relative efficacy of collaborative and fully autonomous navigation, the relationship between success rate and users' learned trust in the automation (gathered via pre- and post-experiment surveys), and tolerance to error (for decisions made by the automation and by the user). This study validates the feasibility of Busy Beeway as a platform for human subject studies on human-automation collaboration, and suggests directions for future research in human-aided planning in difficult environments.
Supplementary Material
MP4 File (a9-adamson.mp4)
- Download
- 47.72 MB
References
[1]
Andrew Bacha, Cheryl Bauman, Ruel Faruque, Michael Fleming, Chris Terwelp, Charles Reinholtz, Dennis Hong, Al Wicks, Thomas Alberi, David Anderson, et al. 2008. Odin: Team VictorTango's entry in the DARPA urban challenge. J. Field Rob. 25,8 (2008), 467--492.
[2]
Rodrigo Benenson, Stéphane Petti, Thierry Fraichard, and Michel Parent. 2006. Integrating perception and planning for autonomous navigation of urban vehicles. In Intel. Rob. Sys. IEEE/RSJ Intl. Conf. 98--104.
[3]
James Bruce and Manuela Veloso. 2002. Real-time randomized path planning for robot navigation. In Intel. Rob. Sys. IEEE/RSJ Intl. Conf. 2383--2388.
[4]
Sylvain Bruni, Jessica J Marquez, Amy Brzezinski, Carl Nehme, and Yves Boussemart. 2007. Introducing a human-automation collaboration taxonomy (HACT) in command and control decision-support systems. In Intl. Command and Control Res. and Technol. Symp. 1--13.
[5]
John Canny. 1988. Some algebraic and geometric computations in PSPACE. In ACM Symp. Theory Proc. 460--467.
[6]
John Canny and John Reif. 1987. New lower bound techniques for robot motion planning problems. In Found. Comp. Sci. Symp. 49--60.
[7]
Hao-Tien Chiang, Baisravan HomChaudhuri, Abraham P. Vinod, Meeko Oishi, and Lydia Tapia. To appear, 2017. Dynamic Risk Tolerance: Motion Planning by Balancing Short-Term and Long-Term Stochastic Dynamic Predictions. In Proc. IEEE Intl. Conf. Rob. Auto. 3762--3769.
[8]
Hao-Tien Chiang, Nathanael Rackley, and Lydia Tapia. 2015. Stochastic ensemble simulation motion planning in stochastic dynamic environments. In Intel. Rob. Sys. IEEE/RSJ Intl. Conf. 3836--3843.
[9]
Kajal T. Claypool and Mark Claypool. 2007. On frame rate and player performance in first person shooter games. Multimedia Sys. 13, 1 (2007), 3--17.
[10]
Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popovic, and Foldit Players. 2010. Predicting protein structures with a multiplayer online game. Nature 466 (2010), 756--760.
[11]
Dick de Waard, Monique van der Hulst, Marika Hoedemaeker, and Karel A Brookhuis. 1999. Driver behavior in an emergency situation in the Automated Highway System. Trans. Hum. Fact. 1, 1 (1999), 67--82.
[12]
Joost CF de Winter and Dimitra Dodou. 2011. Preparing drivers for dangerous situations: A critical reflection on continuous shared control. In Sys., Man, and Cybern. IEEE Intl. Conf. 1050--1056.
[13]
Anca D Dragan, Kenton CT Lee, and Siddhartha S Srinivasa. 2013. Legibility and predictability of robot motion. In Hum. Rob. Inter. ACM/IEEE Intl. Conf. 301--308.
[14]
Andreas Dunser, Martin Lochner, Ulrich Engelke, and David Rozado Fernandez. 2015. Visual and manual control for human-robot teleoperation. Comp. Graph. App. 35, 3 (2015), 22--32.
[15]
Alexandra Eveleigh, Charlene Jennett, Ann Blandford, Philip Brohan, and Anna L. Cox. 2014. Designing for Dabblers and Deterring Drop-outs in Citizen Science. In Proc. SIGCHI Conf. Hum. Factors Comput. Syst. 2985--2994.
[16]
Alexandra Eveleigh, Charlene Jennett, Stuart Lynn, and Anna L. Cox. 2013. 'I Want to Be a Captain! I Want to Be a Captain!': Gamification in the Old Weather Citizen Science Project. In Proc. Intl. Conf. Gameful Design, Research, and Applications. 79--82.
[17]
Dave Ferguson, Nidhi Kalra, and Anthony Stentz. 2006. Replanning with RRTs. In Proc. IEEE Intl. Conf. Rob. Auto. 1243--1248.
[18]
Paolo Fiorini and Zvi Shiller. 1998. Motion Planning in Dynamic Environments using Velocity Obstacles. Intl. J. Rob. Res. 17, 7 (1998), 760--772.
[19]
Frank Flemisch, Johann Kelsch, Christan Löper, Anna Schieben, Julian Schindler, and Matthias Heesen. 2008. Cooperative Control and Active Interfaces for Vehicle Assistance and Automation. FISITA World Automotive Congress (2008).
[20]
William Glover and John Lygeros. 2004. A Stochastic Hybrid Model for Air Traffic Control Simulation. In Proc. ACM Intl. Conf. Hybrid Sys.: Comp. Control. 372--386.
[21]
Dirk Helbing and Péter Molnár. 1995. Social force model for pedestrian dynamics. Phys. Rev. E. 51, 5 (1995), 4282--4286.
[22]
Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust. Trans. Hum. Fact. 57, 3 (2015), 407--434.
[23]
Mishel Johns, Brian Mok, David Michael Sirkin, Nikhil Manjunath Gowda, Catherine Allison Smith, Walter J. Talamonti Jr, and Wendy Ju. 2016. Exploring Shared Control in Automated Driving. In Hum. Rob. Inter. ACM/IEEE Intl. Conf. 91--98.
[24]
Oussama Khatib. 1986. Real-Time Obstacle Avoidance for Manipulators and Mobile Robots. Intl. J. Rob. Res. 5, 1 (1986), 90--98.
[25]
Steven LaValle and Rajeev Sharma. 1995. A framework for motion planning in stochastic environments: modeling and analysis. In Proc. IEEE Intl. Conf. Rob. Auto., Vol. 3. 3057--3062.
[26]
Nick Malone, Hao-Tien Chiang, Kendra Lesser, Meeko Oishi, and Lydia Tapia. 2017. Hybrid Dynamic Moving Obstacle Avoidance Using a Stochastic Reachable Set-Based Potential Field. IEEE Trans. Rob. PP (2017), 1--15. Issue 99.
[27]
Raja Parasuraman and Victor Riley. 1997. Humans and Automation: Use, Misuse, Disuse, Abuse. Trans. Hum. Fact. 39, 2 (1997), 230--253.
[28]
Justin Storms, Kevin Chen, and Dawn Tilbury. 2017. A shared control method for obstacle avoidance with mobile robots and its interaction with communication delay. Intl. J. Rob. Res. 36, 5-7 (2017), 820--839.
[29]
Luis von Ahn and Laura Dabbish. 2004. Labeling images with a computer game. In Proc. SIGCHI Conf. Hum. Factors Comput. Syst. 319--326.
[30]
Anqi Xu and Gregory Dudek. 2016. Maintaining Efficient Collaboration with Trust-Seeking Robots. In Intel. Rob. Sys. IEEE/RSJ Intl. Conf. 3312--3319.
[31]
Kathrin Zeeb, Axel Buchner, and Michael Schrauf. 2015. What determines the take-over time? An integrated model approach of driver take-over after automated driving. Accident Analysis & Prevention 78 (2015), 212--221.
Index Terms
- Busy beeway: a game for testing human-automation collaboration for navigation
Recommendations
Autonomous SLAM based humanoid navigation in a cluttered environment while transporting a heavy load
Although in recent years there have been quite a few studies aimed at the navigation of robots in cluttered environments, few of these have addressed the problem of robots navigating while moving a large or heavy objects. This is especially useful when ...
Proposal of collaborative navigation for multi users from different departure points to the same goal
UbiComp '11: Proceedings of the 13th international conference on Ubiquitous computingThis paper presents a proposal of two new modes of collaborative human navigation. Both are used in a situation in which two users depart from different points simultaneously, but they want to reach common goal. One mode of navigation is used in a ...
Motion autonomy for humanoids: experiments on HRP-2 No. 14
International Workshop Motion in Games (MIG08)This paper deals with whole-body motion planning and dynamic control for humanoid from two aspects: locomotion including manipulation and reaching. In the first part, we address a problem of simultaneous locomotion and manipulation planning that ...
Comments
Information & Contributors
Information
Published In
November 2017
128 pages
ISBN:9781450355414
DOI:10.1145/3136457
- Conference Chair:
- Nuria Pelechano,
- Editor:
- Stephen N. Spencer,
- Program Chairs:
- Carol O'Sullivan,
- Julien Pettré
Copyright © 2017 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 November 2017
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
MiG '17
Sponsor:
Acceptance Rates
Overall Acceptance Rate -9 of -9 submissions, 100%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 438Total Downloads
- Downloads (Last 12 months)65
- Downloads (Last 6 weeks)8
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in