skip to main content
10.1145/1007912.1007921acmconferencesArticle/Chapter ViewAbstractPublication PagesspaaConference Proceedingsconference-collections
Article

Geometric generalizations of the power of two choices

Published: 27 June 2004 Publication History

Abstract

A well-known paradigm for load balancing in parallel and distributed systems is the "power of two choices," whereby an item is stored at the less loaded of two (or more) random alternative servers. We investigate the power of two choices in natural settings where items and servers reside in a geometric space and each item is associated with the server that is its nearest neighbor. This is the setting for example in the Chord distributed hash table, where the geometric space is determined by clockwise distance on a one-dimensional ring. For example, our analysis shows that when $n$ items are placed at n servers with d choices per item, the maximum load at any server is log log n/ log d + O(1) with high probability, only an additive constant more than when servers are chosen uniformly at random. Our proofs are quite general, showing that the power of two choices works under a variety of distributions, with most geometric constructions having at most an additive O(1) penalty. We also show that these techniques still work under highly unbalanced distributions, and give sharp bounds on the necessary number of choices. Finally, we provide simulation results demonstrating the load balance that results as the system size scales into the millions.

References

[1]
Azar, Y., Broder, A., Karlin, A., and Upfal, E. Balanced allocations. SIAM Journal of Computing 29, 1 (1999), 180--200.
[2]
Berenbrink, P., Czumaj, A., Steger, A. and Vöcking, B. Balanced allocations: the heavily loaded case. In Proceedings of the 32nd ACM Symposium on Theory of Computing, pp. 745--754, 2000.
[3]
Byers, J., Considine, J., and Mitzenmacher, M. Simple Load Balancing for Distributed Hash Tables. In Proceedings of the 2nd International Peer-to-Peer Symposium, 2003.
[4]
Dabek, F., Kaashoek, M. F., Karger, D., Morris, R., and Stoica, I. Wide-area cooperative storage with CFS. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01) (Chateau Lake Louise, Banff, Canada, Oct. 2001).
[5]
Dubhashi, D.P. and Ranjan, D. Balls and bins: a case study in negative dependence. Random Structures and Algorithms, 13(2), pp. 99--124, 1998.
[6]
Kaashoek, M.F., and Karger, D.R. Koorde: A simple degree-optimal distributed hash table. In Proceedings of the 2nd International Peer-to-Peer Symposium, 2003.
[7]
Karger, D. R., Lehman, E., Leighton, F. T., Panigrahy, R., Levine, M. S., and Lewin, D. Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the world wide web. In ACM Symposium on Theory of Computing (May 1997), pp. 654--663.
[8]
Karger, D.R. and Ruhl, M. Simple Efficient Load Balancing Algorithms for Peer-to-Peer Systems. In Proceedings of the 3rd International Peer-to-Peer Symposium, 2004.
[9]
Malkhi, D., Naor, M., and Ratajczak, D. Viceroy: A scalable and dynamic emulation of the butterfly. In Proceedings of PODC '02, 2002.
[10]
Miles, R. E. A synopsis of 'Poisson flats in Euclidean spaces'. In: E. F. Harding and D. G. Kendall (eds), Stochastic Geometry. New York, John Wiley, pp. 202--227, 1974.
[11]
Mitzenmacher, M. The power of two choices in randomized load balancing. Ph.D. thesis, U.C. Berkeley, 1996.
[12]
Mitzenmacher, M., Richa, A., and Sitaraman, R. The Power of Two Choices: A Survey of Techniques and Results. Kluwer Academic Publishers, Norwell, MA, 2001, pp. 255--312. edited by P. Pardalos, S. Rajasekaran, J. Reif, and J. Rolim.
[13]
Moller, J. Random tesselations in Rd. Advances in Applied Probability, 21, pp. 37--73, 1989.
[14]
Motwani, R. and Raghavan, P. Randomized Algorithms. Cambridge University Press, 1995.
[15]
Naor, M. and Wieder, U. Novel architectures for P2P applications: the continuous-discrete approach. In Proceedings of SPAA 2003, pp. 50--60.
[16]
Ratnasamy, S., Francis, P., Handley, M., Karp, R., and Shenker, S. A scalable content addressable network. In ACM SIGCOMM (2001), pp. 161--172.
[17]
Ratnasamy, S., Karp, B., Shenker, S., Estrin, D., Govindan, R., Yin, L., and Yu, F. Data-Centric Storage in Sensornets with GHT, A Geographic Hash Table. In ACM MONET, (2003).
[18]
Rowstron, A., and Druschel, P. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proceedings of Middleware 2001 (2001).
[19]
Stoica, I., Morris, R., Karger, D., Kaashoek, M. F., and Balakrishnan, H. Chord: A scalable peer-to-peer lookup service for internet applications. In ACM SIGCOMM (2001), pp. 149--160.
[20]
Vöcking, B. How asymmetry helps load balancing. In Proceedings of the 40th IEEE-FOCS (1999), pp. 131--140.
[21]
Zhao, B. Y., Huang, L., Stribling, J., Rhea, S. C., Joseph, A. D., and Kubiatowicz, J. D. Tapestry: A Resilient Global-scale Overlay for Service Deployment. IEEE Journal on Selected Areas in Communications 22, 1 (2004), 41--53.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SPAA '04: Proceedings of the sixteenth annual ACM symposium on Parallelism in algorithms and architectures
June 2004
332 pages
ISBN:1581138407
DOI:10.1145/1007912
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 June 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. distributed hash tables
  2. load balancing
  3. two choices

Qualifiers

  • Article

Conference

SPAA04

Acceptance Rates

Overall Acceptance Rate 447 of 1,461 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)1
Reflects downloads up to 06 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media