Effectiveness of Teamwork-Level Interventions through Decision-Theoretic Reasoning in a Minecraft Search-and-Rescue Task
Authors: 
David V. Pynadath, Nikolos Gurney, Sarah Kenny, Rajay Kumar, Stacy C. Marsella, Haley Matuszak, Hala Mostafa, Pedro Sequeira, Volkan Ustun, Peggy WuAuthors Info & Claims
David V. Pynadath, Nikolos Gurney, Sarah Kenny, Rajay Kumar, Stacy C. Marsella, Haley Matuszak, Hala Mostafa, Pedro Sequeira, Volkan Ustun, Peggy WuAuthors Info & ClaimsPages 2334 - 2336
Abstract
Autonomous agents offer the promise of improved human teamwork through automated assessment and assistance during task performance [15, 16, 18]. Studies of human teamwork have identified various processes that underlie joint task performance, while abstracting away the specifics of the task [7, 11, 13, 17].We present here an agent that focuses exclusively on teamwork-level variables in deciding what interventions to use in assisting a human team. Our agent does not directly observe or model the environment or the people in it, but instead relies on input from analytic components (ACs) (developed by other research teams) that process environmental information and output only teamwork-relevant measures. Our agent models these teamwork variables and updates its beliefs over them using a Bayesian Theory of Mind [1], applying Partially Observable Markov Decision Processes (POMDPs) [9] in a recursive manner to assess the state of the team it is currently observing and to choose interventions to best assist them.
References
[1]
Chris Baker, Rebecca Saxe, and Joshua Tenenbaum. 2011. Bayesian theory of mind: Modeling joint belief-desire attribution. In Proceedings of the Annual Meeting of the Cognitive Science Society.
[2]
Simon Baron-Cohen, Sally Wheelwright, Jacqueline Hill, Yogini Raste, and Ian Plumb. 2001. The "Reading the Mind in the Eyes" Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. The Journal of Child Psychology and Psychiatry and Allied Disciplines, Vol. 42, 2 (2001), 241--251.
[3]
Rhyse Bendell, Jessica Williams, Stephen M Fiore, and Florian Jentsch. 2021. Towards artificial social intelligence: Inherent features, individual differences, mental models, and theory of mind. In International Conference on Applied Human Factors and Ergonomics. 20--28.
[4]
Christopher C Corral, Keerthi Shrikar Tatapudi, Verica Buchanan, Lixiao Huang, and Nancy J Cooke. 2021. Building a synthetic task environment to support artificial social intelligence research. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 65, 1 (2021), 660--664.
[5]
Jared T Freeman, Lixiao Huang, Matt Woods, and Stephen J Cauffman. 2021. Evaluating artificial social intelligence in an urban search and rescue task environment. In AAAI Fall Symposium on Computational Theory of Mind for Human-Machine Teams.
[6]
Piotr J Gmytrasiewicz and Prashant Doshi. 2004. Interactive POMDPs: Properties and preliminary results. In Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, Vol. 3. 1374--1375.
[7]
J Richard Hackman and Ruth Wageman. 2005. A theory of team coaching. Academy of Management Review, Vol. 30, 2 (2005), 269--287.
[8]
Mary Hegarty, Anthony E Richardson, Daniel R Montello, Kristin Lovelace, and Ilavanil Subbiah. 2002. Development of a self-report measure of environmental spatial ability. Intelligence, Vol. 30, 5 (2002), 425--447.
[9]
Leslie Pack Kaelbling, Michael L Littman, and Anthony R Cassandra. 1998. Planning and acting in partially observable stochastic domains. Artificial intelligence, Vol. 101, 1--2 (1998), 99--134.
[10]
Ellyn Maese, Pablo Diego-Rosell, Les DeBusk-Lane, and Nathan Kress. 2021. Development of emergent leadership measurement: Implications for human-machine teams. In AAAI Fall Symposium on Computational Theory of Mind for Human-Machine Teams.
[11]
Michelle A Marks, John E Mathieu, and Stephen J Zaccaro. 2001. A temporally based framework and taxonomy of team processes. Academy of Management Review, Vol. 26, 3 (2001), 356--376.
[12]
John E Mathieu, Margaret M Luciano, Lauren D'Innocenzo, Elizabeth A Klock, and Jeffery A LePine. 2020. The development and construct validity of a team processes survey measure. Organizational Research Methods, Vol. 23, 3 (2020), 399--431.
[13]
Philip M Podsakoff, Scott B MacKenzie, Robert H Moorman, and Richard Fetter. 1990. Transformational leader behaviors and their effects on followers' trust in leader, satisfaction, and organizational citizenship behaviors. The Leadership Quarterly, Vol. 1, 2 (1990), 107--142.
[14]
David V Pynadath and Stacy C Marsella. 2005. PsychSim: Modeling theory of mind with decision-theoretic agents. In Proceedings of the International Joint Conference on Artificial Intelligence. 1181--1186.
[15]
Sangwon Seo, Lauren R Kennedy-Metz, Marco A Zenati, Julie A Shah, Roger D Dias, and Vaibhav V Unhelkar. 2021. Towards an AI coach to infer team mental model alignment in healthcare. In Proceedings of the IEEE Conference on Cognitive and Computational Aspects of Situation Management. 39--44.
[16]
Gita Sukthankar, Katia Sycara, Joseph A Giampapa, Chris Burnett, and Alun Preece. 2007. Towards a model of agent-assisted team search. In Procceedings of the First Annual Conference of the International Technology Alliance in Network and Information Science.
[17]
Bruce W Tuckman and Mary Ann C Jensen. 1977. Stages of small-group development revisited. Group & Organization Studies, Vol. 2, 4 (1977), 419--427.
[18]
Sheila Simsarian Webber, Jodi Detjen, Tammy L MacLean, and Dominic Thomas. 2019. Team challenges: Is artificial intelligence the solution? Business Horizons, Vol. 62, 6 (2019), 741--750.
Index Terms
- Effectiveness of Teamwork-Level Interventions through Decision-Theoretic Reasoning in a Minecraft Search-and-Rescue Task
Recommendations
Semi-Automated Construction of Decision-Theoretic Models of Human Behavior
AAMAS '16: Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent SystemsMultiagent social simulation provides a powerful mechanism for policy makers to understand the potential outcomes of their decisions before implementing them. However, the value of such simulations depends on the accuracy of their underlying agent ...
Risk-sensitive planning in partially observable environments
AAMAS '10: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1Partially Observable Markov Decision Process (POMDP) is a popular framework for planning under uncertainty in partially observable domains. Yet, the POMDP model is risk-neutral in that it assumes that the agent is maximizing the expected reward of its ...
Optimistic MLE: A Generic Model-Based Algorithm for Partially Observable Sequential Decision Making
STOC 2023: Proceedings of the 55th Annual ACM Symposium on Theory of ComputingThis paper introduces a simple efficient learning algorithms for general sequential decision making. The algorithm combines Optimism for exploration with Maximum Likelihood Estimation for model estimation, which is thus named OMLE. We prove that OMLE ...
Comments
Information & Contributors
Information
Published In
May 2023
3131 pages
ISBN:9781450394321
- General Chairs:
- Noa Agmon,
- Bo An,
- Program Chairs:
- Alessandro Ricci,
- William Yeoh
Sponsors
Publisher
International Foundation for Autonomous Agents and Multiagent Systems
Richland, SC
Publication History
Published: 30 May 2023
Check for updates
Author Tags
Qualifiers
- Poster
Funding Sources
- DARPA
Conference
AAMAS '23
Sponsor:
AAMAS '23: International Conference on Autonomous Agents and Multiagent Systems
May 29 - June 2, 2023
London, United Kingdom
Acceptance Rates
Overall Acceptance Rate 1,155 of 5,036 submissions, 23%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 85Total Downloads
- Downloads (Last 12 months)64
- Downloads (Last 6 weeks)17
Reflects downloads up to 28 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in