skip to main content
10.1145/1569901.1570081acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Distributed hyper-heuristics for real parameter optimization

Published: 08 July 2009 Publication History

Abstract

Hyper-heuristics (HHs) are heuristics that work with an arbitrary set of search operators or algorithms and combine these algorithms adaptively to achieve a better performance than any of the original heuristics. While HHs lend themselves naturally for distributed deployment, relatively little attention has been paid so far on the design and evaluation of distributed HHs. To our knowledge, our work is the first to present a detailed evaluation and comparison of distributed HHs for real parameter optimization in an island model. Our set of test functions includes well-known benchmark functions and two realistic space-probe trajectory optimization problems. The set of algorithms available to the HHs include several variants of differential evolution, and uniform random search. Our main conclusion is that some of the simplest HHs are surprisingly successful in a distributed environment, and the best HHs we tested provide a robust and stable good performance over a wide range of scenarios and parameters.

References

[1]
B. Addis, A. Cassioli, M. Locatelli, and F. Schoen. Global optimization for the design of space trajectories, 2008. Optimization Online eprint archive http://www.optimization-online.org/DB_HTML/2008/11/2150.html.
[2]
E. Alba. Parallel Metaheuristics: A New Class of Algorithms. Wiley, 2005.
[3]
M.G. Arenas, P. Collet, A.E. Eiben, M. Jelasity, J.J. Merelo, B. Paechter, M. Preuß, and M. Schoenauer. A framework for distributed evolutionary algorithms. In J.J. Merelo Guervos, P. Adamidis, H.-G. Beyer, J.-L. Fernández-Villacanas, and H.-P. Schwefel, editors, Parallel Problem Solving from Nature -- PPSN VII, volume 2439 of LNCS, pages 665--675. Springer, 2002.
[4]
M. Biazzini, A. Montresor, and M. Brunato. Towards a decentralized architecture for optimization. In Proc. of the 22nd IEEE International Parallel and Distributed Processing Symposium (IPDPS'08), Miami, FL, USA, April 2008.
[5]
E. Burke, G. Kendall, J. Newall, E. Hart, P. Ross, and S. Schulenburg. Hyper-heuristics: An emerging direction in modern search technology. In Handbook of Metaheuristics, pages 457--474. 2003.
[6]
E.K. Burke, G. Kendall, and E. Soubeiga. A tabu-search hyperheuristic for timetabling and rostering. Journal of Heuristics, 9(6):451--470, 2003.
[7]
E. Cantu-Paz. Efficient and Accurate Parallel Genetic Algorithms. Springer, 2000.
[8]
A. Demers, D. Greene, C. Hauser, W. Irish, J. Larson, S. Shenker, H. Sturgis, D. Swinehart, and D. Terry. Epidemic algorithms for replicated database maintenance. In Proceedings of the 6th Annual ACM Symposium on Principles of Distributed Computing (PODC'87), pages 1--12. ACM Press, August 1987.
[9]
E. Hand. Head in the clouds. Nature, 449:963, 2007.
[10]
M. Hollander and D.A. Wolfe. Nonparametric Statistical Methods. Wiley, 2nd edition, 1999.
[11]
M. Jelasity and O. Babaoglu. T-Man: Gossip-based overlay topology management. In S.A. Brueckner, G. Di Marzo Serugendo, D. Hales, and F. Zambonelli, editors, Engineering Self-Organising Systems, volume 3910 of LNCS, pages 1--15. Springer, 2006.
[12]
M. Jelasity, A. Montresor, and O. Babaoglu. ACM Transactions on Computer Systems, 23(3):219--252, August 2005.
[13]
M. Jelasity, S. Voulgaris, R. Guerraoui, A.-M. Kermarrec, and M. van Steen. Gossip-based peer sampling. ACM Transactions on Computer Systems, 25(3):8, August 2007.
[14]
J. Joseph and C. Fellenstein. Grid Computing. Prentice Hall, 2003.
[15]
D. Ouelhadj and S. Petrovic. A cooperative distributed hyper-heuristic framework for scheduling. In Proc. of the IEEE Int conference on Systems, Man and Cybernetics (SMC 2008), Singapore, 2008.
[16]
E. Ozcan, B. Bilgin, and E.E. Korkmaz. A comprehensive analysis of hyper-heuristics. Intelligent Data Analysis, 12(1):3--23, 2008.
[17]
PeerSim. http://peersim.sourceforge.net/.
[18]
B. Pittel. On spreading a rumor. SIAM Journal on Applied Mathematics, 47(1):213--223, February 1987.
[19]
P. Rattadilok, A. Gaw, and R.S. Kwan. Distributed choice function hyper-heuristics for timetabling and scheduling. In Practice and Theory of Automated Timetabling PATAT V, number 3616 in LNCS, pages 51--67. Springer, 2005.
[20]
R. Storn and K. Price. Differential evolution: A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4):341--359, December 1997.
[21]
M. Tomassini. Spatially Structured Evolutionary Algorithms: Artificial Evolution in Space and Time. Springer, 2005.
[22]
T. Vinko and D. Izzo. Learning the best combination of solvers in a distributed global optimization environment. In Proceedings of AGO 2007, pages 13--17, Mykonos, Greece, 2007. Gossip-based aggregation in large dynamic networks.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '09: Proceedings of the 11th Annual conference on Genetic and evolutionary computation
July 2009
2036 pages
ISBN:9781605583259
DOI:10.1145/1569901
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. differential evolution
  2. distributed computing
  3. hyper-heuristics

Qualifiers

  • Research-article

Conference

GECCO09
Sponsor:
GECCO09: Genetic and Evolutionary Computation Conference
July 8 - 12, 2009
Québec, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 06 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media