research-article

Coevolutionary Algorithm for Evolving Competitive Strategies in the Weapon Target Assignment Problem

Authors:

Madeleine Cochrane,

Ruhul SarkerAuthors Info & Claims

ISMSI '22: Proceedings of the 2022 6th International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence

Pages 9 - 18

https://doi.org/10.1145/3533050.3533052

Published: 24 June 2022 Publication History

Abstract

This paper considers a non-cooperative real-time strategy game between two teams; each has multiple homogeneous players with identical capabilities. In particular, the first team consists of multiple land vehicles under attack by a team of drones, and the vehicles are equipped with weapons to counterattack the drones. However, with the increase in the number of drones, it may become difficult for human operators to coordinate actions across vehicles in a timely manner. Therefore, we explore a coevolutionary approach to simultaneously evolve competitive weapon target assignment strategies for the land vehicles and drone threats to address this problem. Different scenarios involving a different number of land vehicles and drone threats have been considered to evaluate the performance of the proposed approach. Results showed some advantages of applying such a coevolutionary approach.

References

[1]

Navin K Adhikari, Sushil J. Louis, Siming Liu, and Walker Spurgeon. 2019. Co-evolving Real-Time Strategy Game Micro. In Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence, SSCI 2018. 1990–1997.

[2]

Christopher A. Ballinger and Sushil J. Louis. 2014. Learning Robust Build-Orders from Previous Opponents with Coevolution. In IEEE Conference on Computatonal Intelligence and Games, CIG.

[3]

Madeleine Cochrane and Robert Hunjet. 2020. A Multi-Armed Bandit Strategy for Countermeasure Selection. In 2020 IEEE Symposium Series on Computational Intelligence (SSCI). 2510–2515.

[4]

Mariela Nogueira Collazo, Carlos Cotta, and Antonio J. Fernandez-Leiva. 2014. Virtual Player Design Using Self-Learning via Competitive Coevolutionary Algorithms. Natural Computing 13, 2 (2014), 131–144.

[5]

Ehab Z. Elfeky, Saber Elsayed, Luke Marsh, Daryl Essam, Madeleine Cochrane, Brendan Sims, and Ruhul Sarker. 2021. A Systematic Review of Coevolution in Real-Time Strategy Games. IEEE Access 9(2021), 136647–136665.

[6]

Sevan G Ficici and Jordan B Pollack. 1998. Challenges in Coevolutionary Learning: Arms-Race Dynamics, Open-Endedness, and Mediocre Stable States. In Proceedings of the sixth international conference on Artificial life. 238–247.

[7]

Dario Floreano and Stefano Nolfi. 1997. God Save the Red Queen! Competition in Co-Evolutionary Robotics. In GENETIC PROGRAMMING 1997: PROCEEDINGS OF THE SECOND ANNUAL CONFERENCE. Morgan Kaufmann, 398–406.

[8]

Steffen Herbold. 2020. Autorank: A Python package for automated ranking of classifiers. Journal of Open Source Software 5, 48 (2020), 2173. https://doi.org/10.21105/joss.02173

[9]

Fredrik Johansson and Göran Falkman. 2010. Real-time allocation of defensive resources to rockets, artillery, and mortars. In 2010 13th International Conference on Information Fusion. 1–8.

[10]

Alexander Kline, Darryl Ahner, and Raymond Hill. 2019. Survey in Operations Research and Management Science: The Weapon-Target Assignment Problem. Computers and Operations Research 105 (2019), 226–236.

Digital Library

[11]

Raul Lara-Cabrera, Carlos Cotta, and Antonio J. Fernandez-Leiva. 2013. A Review of Computational Intelligence in RTS Games. 2013 Ieee Symposium on Foundations of Computational Intelligence (Foci) (2013), 114–121.

[12]

S.P. Lloyd and H.S. Witsenhausen. 1986. Weapons allocation is NP-complete. In Proceedings of the 1986 Summer Computer Simulation Conference, Reno, Nevada. 1054–1058.

[13]

A. S. Manne. 1958. A target-assignment problem. Operations Research 6, 3 (1958), 346–351.

Digital Library

[14]

Luke Marsh, Madeleine Cochrane, Riley Lodge, Brendan Sims, Jason Traish, and Richard Xu. 2020. Autonomous Target Allocation Recommendations. In 2020 IEEE Symposium Series on Computational Intelligence (SSCI). 1403–1410.

[15]

Chris Miles, Juan Quiroz, Ryan Leigh, and Sushil J. Louis. 2007. Co-evolving Influence Map Tree Based Strategy Game Players. In Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007. 88–95.

Digital Library

[16]

Antonio M. Mora, Antonio Fernández-Ares, Juan-Julián Merelo-Guervós, and Pablo García-Sánchez. 2012. Dealing with Noisy Fitness in the Design of a RTS Game Bot. In Applications of Evolutionary Computation, Di Chio C. et al. (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 234–244.

[17]

Munir Naveed, Diane Kitchin, Andrew Crampton, Lukáš Chrpa, and Peter Gregory. 2012. A Monte-Carlo path planner for dynamic and partially observable environments. In 2012 IEEE Conference on Computational Intelligence and Games (CIG). 211–218.

[18]

Mariela Nogueira, Carlos Cotta, and Antonio J. Fernandez-Leiva. 2013. An Analysis of Hall-of-Fame Strategies in Competitive Coevolutionary Algorithms for Self-Learning in RTS Games. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7997 LNCS. Springer, Berlin, Heidelberg, 174–188.

[19]

Mariela Nogueira, Juan M. Galvez, Carlos Cotta, and Antonio J. Fernandez-Leiva. 2012. Hall-of-Fame Competitive Coevolutionary Algorithms for Optimizing Opponent Strategies in a New Game. In 13th International Conference on Intelligent Games and Simulation, GAME-ON 2012. 71–78.

[20]

Santiago Ontanon, Gabriel Synnaeve, Alberto Uriarte, Florian Richoux, David Churchill, and Mike Preuss. 2013. A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft. IEEE Transactions on Computational Intelligence and AI in Games 5, 4(2013), 293–311.

[21]

Christopher D. Rosin and Richard K. Belew. 1997. New Methods for Competitive Coevolution. Evolutionary Computation 5, 1 (March 1997), 1–29.

Digital Library

[22]

Manu Sharma, M. Holmes, J. C. Santamaría, A. Irani, C. Isbell, and A. Ram. 2007. Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL. In IJCAI.

[23]

Oriol Vinyals, I. Babuschkin, Wojciech M. Czarnecki, and et al.2019. Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature (2019), 1–5.

[24]

R. P. Wiegand and J. Sarma. 2004. Spatial Embedding and Loss of Gradient in Cooperative Coevolutionary Algorithms. In PPSN.

[25]

Ling Wu, Hang yu Wang, Fa xing Lu, and Peifa Jia. 2008. An anytime algorithm based on modified GA for dynamic weapon-target allocation problem. In 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence). 2020–2025.

[26]

Wang Yanxia, Qian Longjun, Guo Zhi, and Ma Lifeng. 2008. Weapon target assignment problem satisfying expected damage probabilities based on ant colony algorithm. Journal of Systems Engineering and Electronics 19, 5(2008), 939–944.

Cited By

Elfeky ECochrane MCrase SElsayed SSims BEssam DSarker R(2022)Coevolution with Danger Zone Levels Strategy for the Weapon Target Assignment Problem2022 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI51031.2022.10022268(596-603)Online publication date: 4-Dec-2022
https://doi.org/10.1109/SSCI51031.2022.10022268

Index Terms

Coevolutionary Algorithm for Evolving Competitive Strategies in the Weapon Target Assignment Problem
1. Computing methodologies
  1. Artificial intelligence
    1. Control methods
    2. Search methodologies
      1. Heuristic function construction
2. Theory of computation
  1. Design and analysis of algorithms
    1. Algorithm design techniques
      1. Dynamic programming

Index terms have been assigned to the content through auto-classification.

Recommendations

Diversity Improved Genetic Algorithm for Weapon Target Assignment
Advances in Swarm Intelligence
Abstract
There are many optimization problems in military applications, among which the weapon target assignment (WTA) problem is the most typical and the most widely studied problem. Plenty of evolutionary algorithms-based methods are studied for ...
A cooperative coevolutionary biogeography-based optimizer

With its unique migration operator and mutation operator, Biogeography-Based Optimization (BBO), which simulates migration of species in natural biogeography, is different from existing evolutionary algorithms, but it has shortcomings such as poor ...
Dynamic Gaussian mutation beetle swarm optimization method for large-scale weapon target assignment problems
Abstract
The weapon target assignment is a crucial issue for firepower resources optimization in modern warfare. Such a problem is complicated, multi-constrained, strongly nonlinear, NP-complete and the existing studies did not consider the suitability ...
Highlights
- An improved beetle swarm optimization algorithm is proposed for weapon target assignment.
- The weapon-target suitability is considered in the optimization model.
- The dynamical parameters and Gaussian mutation are employed to enhance ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ISMSI '22: Proceedings of the 2022 6th International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence

April 2022

117 pages

ISBN:9781450396288

DOI:10.1145/3533050

Copyright © 2022 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Department of Defence, Australian Government

Conference

ISMSI 2022

ISMSI 2022: 2022 6th International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence

April 9 - 10, 2022

Seoul, Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
75
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)2

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Elfeky ECochrane MCrase SElsayed SSims BEssam DSarker R(2022)Coevolution with Danger Zone Levels Strategy for the Weapon Target Assignment Problem2022 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI51031.2022.10022268(596-603)Online publication date: 4-Dec-2022
https://doi.org/10.1109/SSCI51031.2022.10022268

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten