skip to main content
10.1145/2330163.2330247acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Linkage neighbors, optimal mixing and forced improvements in genetic algorithms

Published: 07 July 2012 Publication History

Abstract

Recently, the Linkage Tree Genetic Algorithm (LTGA) was introduced as one of the latest developments in a line of EA research that studies building models to capture and exploit linkage information between problem variables. LTGA was reported to exhibit excellent performance on several linkage benchmark problems, mainly attributed to use of the LT linkage model. In this paper we consider a technique called Forced Improvements (FI), that allows LTGA to converge to a single solution without requiring an explicit, diversity-reducing, selection step. We further consider a different linkage model, called Linkage Neighbors (LN), that is more flexible, yet can be learned equally efficiently from data. Even with the simplest learning approach for configuring the LN, better results are obtained on the linkage benchmark problems than when the LT model is used. However, on weighted MAXCUT (a combinatorial optimization problem), very poor results are obtained and a more involved multiscale LN variant is required to obtain a performance near that of LTGA. Our results underline the advantage of processing linkage in a single model on multiple scales as well as the importance of also considering problems other problems than common linkage benchmark problems when judging the merits of linkage learning techniques.

References

[1]
P. A. N. Bosman and D. Thierens. Negative log-likelihood and statistical hypothesis testing as the basis of model selection in IDEAs. In A. Feelders, editor, Proceedings of the Tenth Belgium-Netherlands Conference on Machine Learning - BENELEARN 2000, pages 109--116, Tilburg, 2000. Tilburg University.
[2]
D. R. Cox and D. V. Hinkley. Theoretical Statistics. Chapman and Hall, London, 1974.
[3]
K. Deb and D. E. Goldberg. Sufficient conditions for arbitrary binary functions. Annals of Mathematics and Artificial Intelligence, 10(4):385--408, 1994.
[4]
I. Gronau and S. Moran. Optimal implementations of UPGMA and other common clustering algorithms. Information Processing Letters, 104(9):205--210, 2007.
[5]
G. R. Harik, F. G. Lobo, and K. Sastry. Linkage learning via probabilistic modeling in the extended compact genetic algorithm (ECGA). In M. Pelikan et al., editors, Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications, pages 39--61. Springer-Verlag, Berlin, 2006.
[6]
M. Pelikan, M. W. Hauschild, and D. Thierens. Pairwise and problem-specific distance metrics in the linkage tree genetic algorithm. In Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2011, pages 1005--1012, New York, New York, 2011. ACM Press.
[7]
M. Pelikan, K. Sastry, D. E. Goldberg, M. V. Butz, and M. Hauschild. Performance of evolutionary algorithms on NK landscapes with nearest neighbor interactions and tunable overlap. In Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2009, pages 851--858, New York, New York, 2009. ACM Press.
[8]
E. Radetic and M. Pelikan. Spurious dependencies and EDA scalability. In Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2010, pages 303--310, New York, New York, 2010. ACM Press.
[9]
F. Rendl, G. Rinaldi, and A. Wiegele. Solving Max-Cut to optimality by intersecting semidefinite and polyhedral relaxations. Math. Programming, 121(2):307, 2010.
[10]
R. Y. Rubinstein. Cross-entropy and rare events for maximal cut and partition problems. ACM Transactions on Modeling and Computer Simulation, 12(1):27--53, 2002.
[11]
F. Teytaud and O. Teytaud. Why one must use reweighting in estimation of distribution algorithms. In G. Raidl et al., editors, Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2009, pages 453--460, New York, New York, 2009. ACM Press.
[12]
D. Thierens. The linkage tree genetic algorithm. In Parallel Problem Solving from Nature - PPSN XI, pages 264--273, Berlin, 2010. Springer-Verlag.
[13]
D. Thierens and P. A. N. Bosman. Optimal mixing evolutionary algorithms. In Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2011, pages 617--624, New York, New York, 2011. ACM Press.
[14]
D. Thierens and D. E. Goldberg. Mixing in genetic algorithms. In Proceedings of the 5th International Conference on Genetic Algorithms, pages 38--47, San Francisco, CA, 1993. Morgan Kaufmann Publishers Inc.
[15]
S. S. Wilks. The large-sample distribution of the likelihood ratio for testing composite hypotheses. The Annals of Mathematical Statistics, 9:60--62, 1938.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '12: Proceedings of the 14th annual conference on Genetic and evolutionary computation
July 2012
1396 pages
ISBN:9781450311779
DOI:10.1145/2330163
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. estimation-of-distribution algorithms
  2. genetic algorithms
  3. linkage learning
  4. optimal mixing

Qualifiers

  • Research-article

Conference

GECCO '12
Sponsor:
GECCO '12: Genetic and Evolutionary Computation Conference
July 7 - 11, 2012
Pennsylvania, Philadelphia, USA

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)0
Reflects downloads up to 29 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media