A Survey on Learning Classifier Systems from 2022 to 2024
Pages 1797 - 1806
Abstract
Learning classifier systems (LCSs) are a state-of-the-art methodology for developing rule-based machine learning by applying discovery algorithms and learning components. LCSs have become proficient at linking environmental features to describe simple patterns in data. They have a natural ability to split a solution into niches. The decision-making process of an LCS-based system is interpretable, which is a step toward explainable AI. A broad range of LCS-based applications have been developed to solve real-world problems. The International Workshop on Learning Classifier Systems (IWLCS) is one of the pioneer and successful workshops at GECCO. It serves as a beacon for the next generation of researchers, inspiring them to delve deep into evolutionary rule-based machine learning, with a particular focus on LCSs. This work follows the tradition of previous surveys at the workshop and provides an overview of the LCS-related publications from March 2022 to March 2024. Based on the nature of contributions, the publications selected for review are divided into the following five groups: (i) Theoretical and Architectural Enhancements, (ii) Explainability, (iii) Applications, (iv) Role of Metaheuristics in LCSs, and (v) Miscellaneous Contributions. This survey provides an easy entry point to the most recent progress and achievements in the field of LCSs.
References
[1]
Ahmed Al-Ajeli, Eman S Al-Shamery, and Raaid Alubady. 2022. An intelligent spam email filtering approach using a learning classifier system. International Journal of Fuzzy Logic and Intelligent Systems 22, 3 (2022), 233--244.
[2]
Kawthar Alzboon, Jehad Al-Nihoud, and Wafa Alsharafat. 2023. Novel Network Intrusion Detection Based on Feature Filtering Using FLAME and New Cuckoo Selection in a Genetic Algorithm. Applied Sciences 13, 23 (2023), 12755.
[3]
Hayden Andersen, Andrew Lensen, and Will N. Browne. 2022. Improving the search of learning classifier systems through interpretable feature clustering. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 1752--1756.
[4]
Christopher M Bishop. 2006. Pattern recognition and machine learning. Springer, Berlin, Heidelberg.
[5]
Jordan T. Bishop, Marcus Gallagher, and Will N. Browne. 2022. Pittsburgh learning classifier systems for explainable reinforcement learning: comparing with XCS. In Proceedings of the Genetic and Evolutionary Computation Conference (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 323--331.
[6]
Martin V Butz. 2006. Rule-based evolutionary online learning systems. Springer, Berlin, Heidelberg.
[7]
Martin V. Butz and Wolfgang Stolzmann. 2002. An Algorithmic Description of ACS2. In Advances in Learning Classifier Systems. Springer, Berlin, Heidelberg, 211--229.
[8]
Jan Drugowitsch. 2008. Design and Analysis of Learning Classifier Systems - A Probabilistic Approach. Studies in Computational Intelligence, Vol. 139. Springer Berlin Heidelberg, Berlin, Heidelberg.
[9]
Melanie Feist, Martin Breitbach, Heiko Trötsch, Christian Becker, and Christian Krupitzer. 2022. Rango: An Intuitive Rule Language for Learning Classifier Systems in Cyber-Physical Systems. In 2022 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). 31--40.
[10]
Rahma Ferjani, Lilia Rejeb, Chedi Abdelkarim, and Lamjed Ben Said. 2024. Evidential Supervised Classifier System: A New Learning Classifier System Dealing with Imperfect Information. International Journal of Information Technology & Decision Making 23, 02 (2024), 917--938.
[11]
Markus Görlich-Bucher and Jörg Hähner. 2022. Towards XCSF-based Identification of Physical Disturbances. (2022). https://ceur-ws.org/Vol-3461/
[12]
Markus Görlich-Bucher and Jörg Hähner. 2022. XCSF under limited supervision. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 2080--2085.
[13]
Tim Hansmeier and Marco Platzner. 2022. Integrating Safety Guarantees into the Learning Classifier System XCS. In Applications of Evolutionary Computation. Springer International Publishing, Cham, 386--401.
[14]
Michael Heider, Richard Nordsieck, and Jörg Hähner. 2021. Learning classifier systems for self-explaining socio-technical-systems. In 9th Edition in the Evolution of the Workshop Series of Autonomously Learning and Optimizing Systems (SAOS), Anthony Stein, Sven Tomforde, Jean Botev, and Peter Lewis (Eds.). http://ceur-ws.org/Vol-3007/2021-short-3.pdf
[15]
Michael Heider, David Pätzel, Helena Stegherr, and Jörg Hähner. 2023. A Metaheuristic Perspective on Learning Classifier Systems. Springer Nature Singapore, Singapore, 73--98.
[16]
Michael Heider, David Pätzel, and Alexander R. M. Wagner. 2022. An overview of LCS research from 2021 to 2022. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 2086--2094.
[17]
Michael Heider, Helena Stegherr, Richard Nordsieck, and Jörg Hähner. 2023. Assessing model requirements for explainable AI: A template and exemplary case study. Artificial Life 29, 4 (2023), 468--486.
[18]
Michael Heider, Helena Stegherr, David Pätzel, Roman Sraj, Jonathan Wurth, Benedikt Volger, and Jörg Hähner. 2022. Approaches for Rule Discovery in a Learning Classifier System. In Proceedings of the 14th International Joint Conference on Computational Intelligence. SCITEPRESS - Science and Technology Publications, 39--49.
[19]
Michael Heider, Helena Stegherr, David Pätzel, Roman Sraj, Jonathan Wurth, Benedikt Volger, and Jörg Hähner. 2023. Discovering Rules for Rule-Based Machine Learning with the Help of Novelty Search. SN Computer Science 4, 6 (2023), 778.
[20]
Michael Heider, Helena Stegherr, Roman Sraj, David Pätzel, Jonathan Wurth, and Jörg Hähner. 2023. SupRB in the context of rule-based machine learning methods: A comparative study. Applied Soft Computing 147 (2023), 110706.
[21]
Michael Heider, Helena Stegherr, Jonathan Wurth, Roman Sraj, and Jörg Hähner. 2022. Investigating the Impact of Independent Rule Fitnesses in a Learning Classifier System. In Bioinspired Optimization Methods and Their Applications, Marjan Mernik, Tome Eftimov, and Matej Črepinšek (Eds.). Springer International Publishing, 142--156.
[22]
Michael Heider, Helena Stegherr, Jonathan Wurth, Roman Sraj, and Jörg Hähner. 2022. Separating rule discovery and global solution composition in a learning classifier system. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. ACM.
[23]
JH Holland and JS Reitman. 1998. Cognitive systems based on adaptive algorithms Reprinted in: Evolutionary computation. The fossil record. IEEE Press, New York (1998).
[24]
Po-Hsun Huang, Lian-Yu Chen, Wei-Chan Chung, Chau-Chyun Sheu, Tzu-Chien Hsiao, and Jong-Rung Tsai. 2022. Toward evaluating critical factors of extubation outcome with XCSR-generated rules. Bioengineering 9, 11 (2022), 701.
[25]
Muhammad Iqbal, Will N. Browne, and Mengjie Zhang. 2014. Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems. IEEE Transactions on Evolutionary Computation 18, 4 (2014), 465--480.
[26]
Muhammad Irfan, Zheng Jiangbin, Muhammad Iqbal, Zafar Masood, and Muhammad Hassan Arif. 2022. Knowledge extraction and retention based continual learning by using convolutional autoencoder-based learning classifier system. Information Sciences 591 (2022), 287--305.
[27]
Sooraj K Babu, Tim Schneider, and Sebastian von Mammen. 2023. User-centred Design and Development of a Graphical User Interface for Learning Classifier Systems. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO '23 Companion). Association for Computing Machinery, New York, NY, USA, 1830--1837.
[28]
Sooraj K Babu and Sebastian von Mammen. 2022. Learning Classifier Systems as Recommender Systems. (2022).
[29]
Tim Kovacs. 1996. Evolving optimal populations with XCS classifier systems. Master's thesis, School of Computer Science, University of Birmingham, Birmingham, UK (1996).
[30]
Norbert Kozlowski and Olgierd Unold. 2022. Internalizing Knowledge for Anticipatory Classifier Systems in Discretized Real-Valued Environments. IEEE Access 10 (2022), 33816--33828.
[31]
Yi Liu, Yu Cui, Will Browne, Bing Xue, Wen Cheng, Yong Li, and Lingfang Zeng. 2023. Absumption and Subsumption based Learning Classifier System for Real-World Continuous-based Problems. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO '23 Companion). Association for Computing Machinery, New York, NY, USA, 299--302.
[32]
Edwin Lughofer and Mahardhika Pratama. 2023. Evolving multi-user fuzzy classifier system with advanced explainability and interpretability aspects. Information Fusion 91 (2023), 458--476.
[33]
Temitope Mapayi, Pius A. Owolawi, and Adedayo O. Adio. 2023. Multi-objective Evolutionary-Fuzzy for Vessel Tortuosity Characterisation. In Proceedings of Seventh International Congress on Information and Communication Technology. Springer Nature Singapore, Singapore, 581--588.
[34]
Trung B. Nguyen, Will N. Browne, and Mengjie Zhang. 2023. ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean Problems. IEEE Transactions on Evolutionary Computation 27, 4 (2023), 1057--1071.
[35]
Romain Orhand, Pierre Collet, Pierre Parrend, and Anne Jeannin-Girardon. 2023. CRACS: Compaction of Rules in Anticipatory Classifier Systems. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO '23 Companion). Association for Computing Machinery, New York, NY, USA, 1838--1845.
[36]
Romain Orhand, Anne Jeannin-Girardon, Pierre Parrend, and Pierre Collet. 2022. Accurate and Interpretable Representations of Environments with Anticipatory Learning Classifier Systems. In Genetic Programming. Springer International Publishing, Cham, 245--261.
[37]
Albert Orriols-Puig, Jorge Casillas, and Ester Bernado-Mansilla. 2009. Fuzzy-UCS: A Michigan-Style Learning Fuzzy-Classifier System for Supervised Learning. IEEE Transactions on Evolutionary Computation 13, 2 (2009), 260--283.
[38]
Jelani Owens, Kishor Datta Gupta, Xuyang Yan, Lydia Asrat Zeleke, and Abdollah Homaifar. 2022. Interpretable Convolutional Learning Classifier System (C-LCS) for higher dimensional datasets. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC). 846--853.
[39]
David Pätzel and Jörg Hähner. 2022. The Bayesian learning classifier system: implementation, replicability, comparison with XCSF. In Proceedings of the Genetic and Evolutionary Computation Conference (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 413--421.
[40]
David Pätzel, Michael Heider, and Jörg Hähner. 2023. Towards Principled Synthetic Benchmarks for Explainable Rule Set Learning Algorithms. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO '23 Companion). Association for Computing Machinery, New York, NY, USA, 1657--1662.
[41]
David Pätzel, Michael Heider, and Alexander R. M. Wagner. 2021. An overview of LCS research from 2020 to 2021. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Lille, France) (GECCO '21). Association for Computing Machinery, New York, NY, USA, 1648--1656.
[42]
Lukas Rosenbauer, David Pätzel, Anthony Stein, and Jörg Hähner. 2022. A learning classifier system for automated test case prioritization and selection. SN Computer Science 3, 5 (2022), 373.
[43]
Connor Schönberner and Sven Tomforde. 2022. Deep Reinforcement Learning with a Classifier System---First Steps. In International Conference on Architecture of Computing Systems, Martin Schulz, Carsten Trinitis, Nikela Papadopoulou, and Thilo Pionteck (Eds.). Springer, Springer International Publishing, Cham, 256--270.
[44]
Harisu Abdullahi Shehu, Abubakar Siddique, Will N. Browne, and Hedwig Eisenbarth. 2021. Lateralized Approach for Robustness Against Attacks in Emotion Categorization from Images. In Applications of Evolutionary Computation. Springer International Publishing, Cham, 469--485.
[45]
Hiroki Shiraishi, Yohei Havamizu, Hiroyuki Sato, and Keiki Takadama. 2022. Beta Distribution based XCS Classifier System. In 2022 IEEE Congress on Evolutionary Computation (CEC). 1--8.
[46]
Hiroki Shiraishi, Yohei Hayamizu, and Tomonori Hashiyama. 2023. Fuzzy-UCS Revisited: Self-Adaptation of Rule Representations in Michigan-Style Learning Fuzzy-Classifier Systems. In Proceedings of the Genetic and Evolutionary Computation Conference (Lisbon, Portugal) (GECCO '23). Association for Computing Machinery, New York, NY, USA, 548--557.
[47]
Hiroki Shiraishi, Yohei Hayamizu, Iko Nakari, Hiroyuki Sato, and Keiki Takadama. 2022. Inheritance vs. Expansion: Generalization Degree of Nearest Neighbor Rule in Continuous Space as Covering Operator of XCS. In Applications of Evolutionary Computation. Springer International Publishing, Cham, 352--368.
[48]
Hiroki Shiraishi, Yohei Hayamizu, Hiroyuki Sato, and Keiki Takadama. 2022. Absumption based on overgenerality and condition-clustering based specialization for XCS with continuous-valued inputs. In Proceedings of the Genetic and Evolutionary Computation Conference (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 422--430.
[49]
Hiroki Shiraishi, Yohei Hayamizu, Hiroyuki Sato, and Keiki Takadama. 2022. Can the same rule representation change its matching area? enhancing representation in XCS for continuous space by probability distribution in multiple dimension. In Proceedings of the Genetic and Evolutionary Computation Conference (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 431--439.
[50]
Abubakar Siddique. 2021. Lateralized Learning to Solve Complex Problems. Ph. D. Dissertation. Open Access Te Herenga Waka-Victoria University of Wellington.
[51]
Abubakar Siddique and Will Browne. 2022. Learning classifier systems: cognitive inspired machine learning for eXplainable AI. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 1081--1110.
[52]
Abubakar Siddique, Will N. Browne, and Gina M. Grimshaw. 2020. Lateralized learning for robustness against adversarial attacks in a visual classification system. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference (Cancún, Mexico) (GECCO '20). Association for Computing Machinery, New York, NY, USA, 395--403.
[53]
Abubakar Siddique, Will N. Browne, and Gina M. Grimshaw. 2022. Frames-of-Reference-Based Learning: Overcoming Perceptual Aliasing in Multistep Decision-Making Tasks. IEEE Transactions on Evolutionary Computation 26, 1 (2022), 174--187.
[54]
Abubakar Siddique, Will N Browne, and Gina M Grimshaw. 2023. Lateralized Learning for Multi-Class Visual Classification Tasks. arXiv preprint arXiv:2301.12637 (2023).
[55]
Abubakar Siddique, Will N. Browne, and Gina M. Grimshaw. 2023. Lateralized Learning to Solve Complex Boolean Problems. IEEE Transactions on Cybernetics 53, 11 (2023), 6761--6775.
[56]
Abubakar Siddique, Muhammad Iqbal, and Will N. Browne. 2016. A comprehensive strategy for mammogram image classification using learning classifier systems. In 2016 IEEE Congress on Evolutionary Computation (CEC). 2201--2208.
[57]
Abubakar Siddique, Muhammad Iqbal, Shahab Din, and Will Browne. 2023. Attention in Rule-Based Machine Learning: Exploiting Learning Classifier Systems' Generalization for Image Classification. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO '23 Companion). Association for Computing Machinery, New York, NY, USA, 323--326.
[58]
Łukasz Smierzchała, Norbert Kozłowski, and Olgierd Unold. 2023. Anticipatory Classifier System With Episode-Based Experience Replay. IEEE Access 11 (2023), 41190--41204.
[59]
Rui Sugawara and Masaya Nakata. 2022. Theoretical Analysis of Accuracy-Based Fitness on Learning Classifier Systems. IEEE Access 10 (2022), 64862--64872.
[60]
Olgierd Unold, Norbert Kozłowski, and Łukasz undefinedmierzchała. 2022. Preliminary tests of an anticipatory classifier system with experience replay. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 2095--2103.
[61]
Ryan J Urbanowicz and Jason H Moore. 2009. Learning classifier systems: a complete introduction, review, and roadmap. Journal of Artificial Evolution and Applications 2009 (2009), 1.
[62]
Fumito Uwano and Will Browne. 2023. Hierarchical Frames-of-References in Learning Classifier Systems. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation. 335--338.
[63]
Jonathan Wurth, Michael Heider, Helena Stegherr, Roman Sraj, and Jörg Hähner. 2022. Comparing different metaheuristics for model selection in a supervised learning classifier system. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO '22). Association for Computing Machinery, New York, NY, USA, 316--319.
[64]
Naoya Yatsu, Hiroki Shiraishi, Hiroyuki Sato, and Keiki Takadama. 2022. XCSR with VAE using Gaussian Distribution Matching: From Point to Area Matching in Latent Space for Less-overlapped Rule Generation in Observation Space. In 2022 IEEE Congress on Evolutionary Computation (CEC). 1--8.
[65]
Naoya Yatsu, Hiroki Shiraishi, Hiroyuki Sato, and Keiki Takadama. 2023. Exploring High-dimensional Rules Indirectly via Latent Space Through a Dimensionality Reduction for XCS. In Proceedings of the Genetic and Evolutionary Computation Conference (Lisbon, Portugal) (GECCO '23). Association for Computing Machinery, New York, NY, USA, 606--614.
[66]
Ali Yousefi, Kambiz Badie, Mohammad Mehdi Ebadzadeh, and Arash Sharifi. 2023. Improving the efficiency of the XCS learning classifier system using evolutionary memory. Wireless Networks (2023), 1--16.
[67]
Muthana Zouri and Alex Ferworn. 2022. An Approach for Automatic Discovery of Rules Based on ECG Data Using Learning Classifier Systems. In 2022 IEEE World AI IoT Congress (AIIoT). 145--154.
Index Terms
- A Survey on Learning Classifier Systems from 2022 to 2024
Recommendations
Fuzzy-UCS: preliminary results
GECCO '07: Proceedings of the 9th annual conference companion on Genetic and evolutionary computationThis paper presents Fuzzy-UCS, a Michigan-style Learning Fuzzy-Classifier System designed for supervised learning tasks. Fuzzy-UCS combines the generalization capabilities of UCS with the good interpretability of fuzzy rules to evolve highly accurate ...
Accuracy-based learning classifier systems: models, analysis and applications to classification tasks
Recently, Learning Classifier Systems (LCS) and particularly XCS have arisen as promising methods for classification tasks and data mining. This paper investigates two models of accuracy-based learning classifier systems on different types of ...
A Learning Classifier System with Mutual-Information-Based Fitness
Learning Classifier SystemsThis paper introduces a new variety of learning classifier system (LCS), called MILCS, which utilizes mutual information as fitness feedback. Unlike most LCSs, MILCS is specifically designed for supervised learning. We present preliminary results, and ...
Comments
Information & Contributors
Information
Published In
July 2024
2187 pages
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 August 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
GECCO '24 Companion
Sponsor:
GECCO '24 Companion: Genetic and Evolutionary Computation Conference Companion
July 14 - 18, 2024
VIC, Melbourne, Australia
Acceptance Rates
Overall Acceptance Rate 1,465 of 3,840 submissions, 38%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 49Total Downloads
- Downloads (Last 12 months)49
- Downloads (Last 6 weeks)8
Reflects downloads up to 31 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in