Article

Scalability of the microsoft cluster service

Authors:

Katherine GuoAuthors Info & Claims

WINSYM'98: Proceedings of the 2nd conference on USENIX Windows NT Symposium - Volume 2

Page 2

Published: 03 August 1998 Publication History

Publisher Site

Abstract

An important argument for the introduction of software managed clusters is that of scale: By constructing the cluster out of commodity compute elements, one can, by simply adding new elements, improve the reliability of the overall system in terms of performance and in availability. The limits to how far such a cluster can be scaled seems to be dependent on the scalability of its management software, which in its core has a collection of distributed algorithms to guarantee the correct operation of the cluster. The complexity of these algorithms makes them a vulnerable component of the system in terms of their impact on the overall scalability of the system.

This paper examines two of the distributed components of the Microsoft Cluster Service [8] that are most likely to have an impact on its scalability: the membership and the global update managers. The first sections of the paper will provide some general background on these distributed services and scalability issues. After that the algorithms used to implement these service are described in detail and an analysis of their impact on scalability is given. The scalability analysis is based on an off-line analysis of the algorithms as well as the results of on-line experiments on a cluster with a, in MSCS terms, large number of nodes.

References

[1]

{1} Badovinatz, P., Chandra, T.D., Gopal, A., Jurgensen, D., Kirby, T., Krishnamur, S., and Pershing, J., "GroupServices: infrastructure for highly available, clustered computing", unpublished document, December 1997

Google Scholar

[2]

{2} Birman, K.P., Building Secure and Reliable Network Applications. Manning Publishing Company, and Prentice Hall, 1997

Crossref

Google Scholar

[3]

{3} Carr, R., "Tandem Global Update Protocol", Tandem Systems Review, V1.2 1985.

Google Scholar

[4]

{4} Katzman., J.A., et.al., "A Fault-tolerant multiprocessor system", United States Patent 4,817,091, March 28, 1989.

Google Scholar

[5]

{5} Moser, L., Melliar-Smith, M., D. A. Agarwal, D., Budhia, R., and Lingley-Papadopoulos, C., "Totem A Fault-Tolerant Multicast Group Communication System", Communications of the ACM, April 1996.

Digital Library

Google Scholar

[6]

{6} Renesse, R. van, Yaron Minsky, Y., and Hayden, M., "A Gossip-Based Failure Detection Service", in Proceedings. of Middleware '98, Lancaster, England, September 1998.

Crossref

Google Scholar

[7]

{7} Renesse, R. van, Birman, K., Hayden, M., Vaysburd, A., and Karr, D., "Building Adaptive Systems Using Ensemble", Software--Practice and Experience, August 1998.

Crossref

Google Scholar

[8]

{8} Vogels, W., Dumitriu, D., Birman, K. Gamache, R., Short, R., Vert, J., Massa, M., Barrera, J., and Gray, J., "The Design and Architecture of the Microsoft Cluster Service -- A Practical Approach to High-Availability and Scalability", Proceedings of the 28th symposium on Fault-Tolerant Computing, Munich, Germany, June 1998.

Crossref

Google Scholar

[9]

{9} Vogels, W., Dumitriu, D., Panitz, M., Chipalowsky, K., Pettis, J., "Quintet, Tools for Reliable Enterprise Computing", submitted for publication, June 1998.

Google Scholar

[10]

{10} Vogels, W., van Renesse, R., and Birman, K., "Six Misconceptions about Reliable Distributed Computing", Proceedings of the 8th ACM SIGOPS European Workshop, Sintra, Portugal, September 1998

Crossref

Google Scholar

[11]

{11} Vogels, W, "World Wide Failures", Proceeding of the 1996 ACM SIGOPS Workshop, Ireland 1996.

Crossref

Google Scholar

Cited By

View all

Kumar SChiky RLefebvre SSoudan EShyamasundar RShastri LJanakiram DPadmanabhuni S(2013)LibReProceedings of the 6th ACM India Computing Convention10.1145/2522548.2522605(1-9)Online publication date: 22-Aug-2013
https://dl.acm.org/doi/10.1145/2522548.2522605
Koromilas LMagoutis K(2011)CassMailProceedings of the 11th IFIP WG 6.1 international conference on Distributed applications and interoperable systems10.5555/2022090.2022113(278-291)Online publication date: 6-Jun-2011
https://dl.acm.org/doi/10.5555/2022090.2022113
Qin FTucek JZhou YSundaresan J(2007)RxACM Transactions on Computer Systems10.1145/1275517.127551925:3(7-es)Online publication date: 1-Aug-2007
https://dl.acm.org/doi/10.1145/1275517.1275519
Show More Cited By

Index Terms

Scalability of the microsoft cluster service

Recommendations

Improving scalability and availability of cluster-based internet services
Scalability of findability: effective and efficient IR operations in large information networks
SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval

It is crucial to study basic principles that support adaptive and scalable retrieval functions in large networked environments such as the Web, where information is distributed among dynamic systems. We conducted experiments on decentralized IR ...
Availability, scalability and cost-effectiveness of cluster-based internet infrastructures

Comments

Information & Contributors

Information

Published In

WINSYM'98: Proceedings of the 2nd conference on USENIX Windows NT Symposium - Volume 2

August 1998

188 pages

Publisher

USENIX Association

United States

Publication History

Published: 03 August 1998

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
27
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kumar SChiky RLefebvre SSoudan EShyamasundar RShastri LJanakiram DPadmanabhuni S(2013)LibReProceedings of the 6th ACM India Computing Convention10.1145/2522548.2522605(1-9)Online publication date: 22-Aug-2013
https://dl.acm.org/doi/10.1145/2522548.2522605
Koromilas LMagoutis K(2011)CassMailProceedings of the 11th IFIP WG 6.1 international conference on Distributed applications and interoperable systems10.5555/2022090.2022113(278-291)Online publication date: 6-Jun-2011
https://dl.acm.org/doi/10.5555/2022090.2022113
Qin FTucek JZhou YSundaresan J(2007)RxACM Transactions on Computer Systems10.1145/1275517.127551925:3(7-es)Online publication date: 1-Aug-2007
https://dl.acm.org/doi/10.1145/1275517.1275519
Tucek JNewsome JLu SHuang CXanthos SBrumley DZhou YSong D(2007)SweeperACM SIGOPS Operating Systems Review10.1145/1272998.127301041:3(115-128)Online publication date: 21-Mar-2007
https://dl.acm.org/doi/10.1145/1272998.1273010
Tucek JNewsome JLu SHuang CXanthos SBrumley DZhou YSong D(2007)SweeperProceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 200710.1145/1272996.1273010(115-128)Online publication date: 21-Mar-2007
https://dl.acm.org/doi/10.1145/1272996.1273010
Subramaniyan RRaman PGeorge ARadlinski M(2006)GEMSCluster Computing10.1007/s10586-006-4900-59:1(101-120)Online publication date: 1-Jan-2006
https://dl.acm.org/doi/10.1007/s10586-006-4900-5
Qin FTucek JZhou Y(2005)Treating bugs as allergiesProceedings of the 10th conference on Hot Topics in Operating Systems - Volume 1010.5555/1251123.1251142(19-19)Online publication date: 12-Jun-2005
https://dl.acm.org/doi/10.5555/1251123.1251142
Qin FTucek JSundaresan JZhou YHerbert ABirman K(2005)RxProceedings of the twentieth ACM symposium on Operating systems principles10.1145/1095810.1095833(235-248)Online publication date: 23-Oct-2005
https://dl.acm.org/doi/10.1145/1095810.1095833
Qin FTucek JSundaresan JZhou Y(2005)RxACM SIGOPS Operating Systems Review10.1145/1095809.109583339:5(235-248)Online publication date: 20-Oct-2005
https://dl.acm.org/doi/10.1145/1095809.1095833
Zhou YChen PLi KPapatheodorou TValero MPolychronopoulos CMuraoka YLabarta J(1999)Fast cluster failover using virtual memory-mapped communicationProceedings of the 13th international conference on Supercomputing10.1145/305138.305215(373-382)Online publication date: 20-Jun-1999
https://dl.acm.org/doi/10.1145/305138.305215

Abstract

References

Cited By

Index Terms

Recommendations

Improving scalability and availability of cluster-based internet services

Scalability of findability: effective and efficient IR operations in large information networks

Availability, scalability and cost-effectiveness of cluster-based internet infrastructures

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations