skip to main content
research-article

Market Clearing–based Dynamic Multi-agent Task Allocation

Published: 21 January 2020 Publication History

Abstract

Realistic multi-agent team applications often feature dynamic environments with soft deadlines that penalize late execution of tasks. This puts a premium on quickly allocating tasks to agents. However, when such problems include temporal and spatial constraints that require tasks to be executed sequentially by agents, they are NP-hard, and thus are commonly solved using general and specifically designed incomplete heuristic algorithms.
We propose FMC_TA, a novel such incomplete task allocation algorithm that allows tasks to be easily sequenced to yield high-quality solutions. FMC_TA first finds allocations that are fair (envy-free), balancing the load and sharing important tasks among agents, and efficient (Pareto optimal) in a simplified version of the problem. It computes such allocations in polynomial or pseudo-polynomial time (centrally or distributedly, respectively) using a Fisher market with agents as buyers and tasks as goods. It then heuristically schedules the allocations, taking into account inter-agent constraints on shared tasks.
We empirically compare our algorithm to state-of-the-art incomplete methods, both centralized and distributed, on law enforcement problems inspired by real police logs. We present a novel formalization of the law enforcement problem, which we use to perform our empirical study. The results show a clear advantage for FMC_TA in total utility and in measures in which law enforcement authorities measure their own performance. Besides problems with realistic properties, the algorithms were compared on synthetic problems in which we increased the size of different elements of the problem to investigate the algorithm’s behavior when the problem scales. The domination of the proposed algorithm was found to be consistent.

References

[1]
Sofia Amador, Steven Okamoto, and Roie Zivan. 2014. Dynamic multi-agent task allocation with spatial and temporal constraints. In Proceedings of the International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 1495--1496.
[2]
M. Arshad and M. C. Silaghi. 2004. Distributed simulated annealing. In Distributed Constraint Problem Solving and Reasoning in Multi-Agent Systems: Frontiers in Artificial Intelligence and Applications. IOS Press.
[3]
William C. Brainard and Herbert E. Scarf. 2000. How to Compute Equilibrium Prices in 1891. Cowles Foundation for Research in Economics - Yale University.
[4]
Arne Brutschy, Giovanni Pini, Carlo Pinciroli, Mauro Birattari, and Marco Dorigo. 2014. Self-organized task allocation to sequentially interdependent tasks in swarm robotics. Auton. Agents Multi-Agent Syst. 28, 1 (2014), 101--125.
[5]
Han-Lim Choi, Luc Brunet, and Jonathan P. How. 2009. Consensus-based decentralized auctions for robust task allocation. IEEE Trans. Robotics 25, 4 (2009), 912--926.
[6]
Gautham P. Das, Thomas M. McGinnity, Sonya A. Coleman, and Laxmidhar Behera. 2015. A distributed task allocation algorithm for a multi-robot system in healthcare facilities. J. Intell. Robotic Syst. 80, 1 (2015), 33--58.
[7]
N. R. Devanur, C. H. Papadimitriou, A. Saberi, and V. V. Vazirani. 2002. Market equilibrium via a primal-dual-type algorithm. In Proceedings of the 43rd Symposium on Foundations of Computer Science (FOCS’02). 389--395.
[8]
M. B. Dias, R. Zlot, N. Kalra, and A. Stentz. 2006. Market-based multirobot coordination: A survey and analysis. Proc. IEEE 94, 7 (2006), 1257--1270.
[9]
Alessandro Farinelli, Luca Iocchi, and Daniele Nardi. 2017. Distributed on-line dynamic task assignment for multi-robot patrolling. Auton. Robots 41, 6 (2017), 1321--1345.
[10]
Alessandro Farinelli, Alex Rogers, and Nick R. Jennings. 2014. Agent-based decentralised coordination for sensor networks using the max-sum algorithm. Auton. Agents Multi-Agent Syst. 28, 3 (2014), 337--380.
[11]
A. Farinelli, A. Rogers, A. Petcu, and N. R. Jennings. 2008. Decentralised coordination of low-power embedded devices using the max-sum algorithm. In Proceedings of the 7th International Conference on Autonomous Agents and Multiagent Systems (AAMAS’08). 639--646.
[12]
S. Shaheen Fatima and Michael Wooldridge. 2001. Adaptive task resources allocation in multi-agent systems. In Proceedings of the 5th International Conference on Autonomous Agents. ACM, 537--544.
[13]
D. Gale. 1960. The Theory of Linear Economic Models. McGraw-Hill.
[14]
J. Godoy and M. Gini. 2013. Task allocation for spatially and temporally distributed tasks. In Intelligent Autonomous Systems 12. Springer, 603--612.
[15]
Yichuan Jiang. 2015. A survey of task allocation and load balancing in distributed systems. IEEE Trans. Parallel Distrib. Syst. 27, 2 (2015), 585--599.
[16]
E. G. Jones, M. B. Dias, and A. Stentz. 2007. Learning-enhanced market-based task allocation for oversubscribed domains. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’07). IEEE, 2308--2313.
[17]
S. Koenig, C. Tovey, M. Lagoudakis, V. Markakis, D. Kempe, P. Keskinocak, A. Kleywegt, A. Meyerson, and S. Jain. 2006. The power of sequential single-item auctions for agent coordination. In Proceedings of the National Conference on Artificial Intelligence, Vol. 21.
[18]
K. Lai, L. Rasmusson, E. Adar, L. Zhang, and A. Huberman. 2005. Tycoon: An implementation of a distributed, market-based resource allocation system. Multiag. Grid Syst. 1, 3 (2005), 169--182.
[19]
K. S. Macarthur, R. Stranders, S. Ramchurn, and N. R. Jennings. 2011. A distributed anytime algorithm for dynamic task allocation in multi-agent systems. In Proceedings of the 25th Conference on Artificial Intelligence (AAAI’11). AAAI Press, 701--706.
[20]
R. T. Maheswaran, M. Tambe, E. Bowring, J. P. Pearce, and P. Varakantham. 2004. Distributed algorithms for DCOP: A graphical-game-based approach. In Proceedings of the 17th International Conference on Parallel and Distributed Computing Systems. 15--17.
[21]
M. Nanjanath and M. Gini. 2010. Repeated auctions for robust task execution by a robot team. Robotics Auton. Syst. 58, 7 (2010), 900--909.
[22]
Ernesto Nunes and Maria Gini. 2015. Multi-robot auctions for allocation of tasks with temporal constraints. In Proceedings of the 29th AAAI Conference on Artificial Intelligence.
[23]
Ernesto Nunes, Marie Manner, Hakim Mitiche, and Maria Gini. 2017. A taxonomy for task allocation problems with temporal and ordering constraints. Robotics Auton. Syst. 90, C (April 2017), 55--70.
[24]
James Parker and Maria Gini. 2014. Tasks with cost growing over time and agent reallocation delays. In Proceedings of the International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 381--388.
[25]
James Parker, Ernesto Nunes, Julio Godoy, and Maria L. Gini. 2016. Exploiting spatial locality and heterogeneity of agents for search and rescue teamwork. J. Field Robotics 33, 7 (2016), 877--900.
[26]
T. O. Paulussen, N. R. Jennings, K. S. Decker, and A. Heinzl. 2003. Distributed patient scheduling in hospitals. In Proceedings of the 18th International Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers Inc., 1224--1229.
[27]
Graham Pinhey, John A. Doucette, and Robin Cohen. 2018. Using reservations for multiagent resource allocation with costly preemption. Multiag. Grid Syst. 14, 3 (2018), 219--242.
[28]
Sameera S. Ponda, Luke B. Johnson, and Jonathan P. How. 2012. Distributed chance-constrained task allocation for autonomous multi-agent teams. In Proceedings of the American Control Conference (ACC’12). 4528--4533.
[29]
D. Poole and A. K. Mackworth. 2010. Artificial Intelligence—Foundations of Computational Agents. Cambridge University Press.
[30]
S. D. Ramchurn, A. Farinelli, K. S. Macarthur, and N. R. Jennings. 2010. Decentralized coordination in RoboCup Rescue. Comput. J. 53, 9 (2010), 1447--1461.
[31]
S. D. Ramchurn, M. Polukarov, A. Farinelli, C. Truong, and N. R. Jennings. 2010. Coalition formation with spatial and temporal constraints. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS’10). 1181--1188.
[32]
C. R. Reeves. 1993. Modern Heuristic Techniques for Combinatorial Problems. John Wiley 8 Sons, Inc.
[33]
J. H. Reijnierse and J. A. M. Potters. 1998. On finding an envy-free Pareto-optimal division. Math. Progr. 83 (1998), 291--311.
[34]
A. Schoneveld, J. F. de Ronde, and P. M. A. Sloot. 1997. On the complexity of task allocation. J. Complex. 3 (1997), 52--60.
[35]
O. Shehory and S. Kraus. 1998. Methods for task allocation via agent coalition formation. Artific. Intell. 101, 1 (1998), 165--200.
[36]
Steven Skiena. 2008. The Algorithm Design Manual (2nd ed.). Springer.
[37]
W. E. Walsh and M. P. Wellman. 1998. A market protocol for decentralized task allocation. In Proceedings of the International Conference on Multi-Agent Systems. 325--332.
[38]
Changyun Wei, Koen V. Hindriks, and Catholijn M. Jonker. 2016. Dynamic task allocation for multi-robot search and retrieval tasks. Appl. Intell. 45, 2 (2016), 383--401.
[39]
R. Wolski, J. S. Plank, J. Brevik, and T. Bryan. 2001. Analyzing market-based resource allocation strategies for the computational grid. Int. J. High Perf. Comput. Appl. 15, 3 (2001), 258--281.
[40]
Dayong Ye, Minjie Zhang, and Athanasios V. Vasilakos. 2016. A survey of self-organization mechanisms in multiagent systems. IEEE Trans. Syst., Man, and Cyber.: Syst. 47, 3 (2016), 441--461.
[41]
Harel Yedidsion, Roie Zivan, and Alessandro Farinelli. 2018. Applying max-sum to teams of mobile sensing agents. Eng. Appl. Artific. Intell. 71 (2018), 87--99.
[42]
L. Zhang. 2011. Proportional response dynamics in the Fisher market. Theor. Comput. Sci. 412, 24 (2011), 2691--2698.
[43]
W. Zhang, Z. Xing, G. Wang, and L. Wittenburg. 2005. Distributed stochastic search and distributed breakout: Properties, comparison, and applications to constraints optimization problems in sensor networks. Artific. Intell. 161:1-2 (Jan. 2005), 55--88.
[44]
R. Zivan, S. Okamoto, and H. Peled. 2014. Explorative anytime local search for distributed constraint optimization. Artific. Intell. 211 (2014).
[45]
R. Zlot and A. Stentz. 2006. Market-based multirobot coordination for complex tasks. Int. J. Robotics Res. 25, 1 (2006), 73--101.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 11, Issue 1
February 2020
304 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3375625
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 January 2020
Accepted: 01 August 2019
Revised: 01 July 2019
Received: 01 January 2019
Published in TIST Volume 11, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Distributed Task Allocation
  2. Multi agent system

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)74
  • Downloads (Last 6 weeks)15
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media