Article

Paxos made live: an engineering perspective

Authors:

Tushar D. Chandra,

Robert Griesemer,

Joshua RedstoneAuthors Info & Claims

PODC '07: Proceedings of the twenty-sixth annual ACM symposium on Principles of distributed computing

Pages 398 - 407

https://doi.org/10.1145/1281100.1281103

Published: 12 August 2007 Publication History

Abstract

We describe our experience in building a fault-tolerant data-base using the Paxos consensus algorithm. Despite the existing literature in the field, building such a database proved to be non-trivial. We describe selected algorithmic and engineering problems encountered, and the solutions we found for them. Our measurements indicate that we have built a competitive system.

References

[1]

Burrows, M. The Chubby lock service for loosely-coupled distributed systems. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation, pp. 335--350

Digital Library

[2]

Chang, F., Dean, J., Ghemawat, S., Hsieh, W. C., Wallach, D. A., Burrows, M., Chandra, T., Fikes, A., and Gruber, R. E. Bigtable: A distributed storage system for structured data. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation, pp. 205--218

Digital Library

[3]

Cristian, F. Reaching agreement on processor-group membership in synchronous distributed systems. Distributed Computing 4, 4 (1991), 175--188.

Digital Library

[4]

Ghemawat, S., Gobioff, H., and Leung, S.-T. The Google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (Dec. 2003), pp. 29--43.

Digital Library

[5]

Gray, C., Cheriton, D. Leases: An efficient fault-tolerant mechanism for distributed file cache consistency. In Proceedings of the 12th ACM Symposium on Operating Systems Principles (1989), pp. 202--210.

Digital Library

[6]

Johnson, S. C. Yacc: Yet another compiler-compiler.

[7]

Lamport, Shostak, and Pease. The byzantine generals problem. In Advances in Ultra-Dependable Distributed Systems, N. Suri, C. J. Walter, and M. M. Hugue (Eds.), IEEE Computer Society Press. 1995.

[8]

Lamport, L. The part-time parliament. ACM Transactions on Computer Systems 16, 2 (1998), 133--169.

Digital Library

[9]

Lamport, L. Paxos made simple. ACM SIGACT News 32, 4 (Dec. 2001), 18--25.

[10]

Lampson, B. W. How to build a highly available system using consensus. In 10th International Workshop on Distributed Algorithms (WDAG 96) (1996), Babaoglu and Marzullo, Eds., vol. 1151, Springer-Verlag, Berlin Germany, pp. 1--17.

Digital Library

[11]

Lee, E. K., and Thekkath, C. A. Petal: Distributed virtual disks. In Proceedings of the Seventh International Conference on Architectural Support for Programming Languages and Operating Systems (Cambridge, MA, 1996), pp. 84--92.

Digital Library

[12]

MacCormick, J., Murphy, N., Najork, M., Thekkath, C. A., and Zhou, L. Boxwood: Abstractions as the foundation for storage infrastructure. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (2004), pp. 105--120.

Digital Library

[13]

Moessenboeck, H. A generator for production quality compilers. In Proceedings of the 3rd International Workshop on Compiler Compilers - Lecture Notes in Computer Science 477 (Berlin, Heidelberg, New York, Tokyo, 1990), Springer-Verlag, pp. 42--55.

Digital Library

[14]

Oki, Brian M., and Liskov, Barbara H. Viewstamped Replication: A New Primary Copy Method to Support Highly-Available Distributed Systems. In Proceedings of the 7th annual ACM Symposium on Principles of Distributed Computing (1988), pp. 8--17.

Digital Library

[15]

Parr, T. J., and QUONG, R. W. Antlr: A predicated-ll(k) parser generator. Software-Practice and Experience 25, 7 (JULY 1995), 789--810.

Digital Library

[16]

Prisco, R. D., Lampson, B. W., and Lynch, N. A. Revisiting the paxos algorithm. In 11th International Workshop on Distributed Algorithms (WDAG 96) (1997), pp. 111--125.

Digital Library

[17]

Schneider, F. B. Implementing fault-tolerant services using the state machine approach: A tutorial. ACM Computing Surveys 22, 4 (1990), 299--319.

Digital Library

[18]

von Neumann, J. Probabilistic logics and synthesis of reliable organisms from unreliable components. Automata Studies (1956), 43--98.

Cited By

Pacini AScano DSgambelluri AValcarenghi LGiorgetti A(2025)Hybrid-Hierarchical Synchronization for Resilient Large-Scale SDN ArchitecturesIEEE Access10.1109/ACCESS.2025.352722413(9032-9046)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3527224
Zhang CWang LShang JXiao ZXiao LHan MWei BShen RWang J(2025)ICCG: low-cost and efficient consistency with adaptive synchronization for metadata replicationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-023-2772-y19:1Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1007/s11704-023-2772-y
Dong HLiu S(2024)Asynchronous Consensus Quorum Read: Pioneering Read Optimization for Asynchronous Consensus ProtocolsElectronics10.3390/electronics1303048113:3(481)Online publication date: 23-Jan-2024
https://doi.org/10.3390/electronics13030481
Show More Cited By

Index Terms

Paxos made live: an engineering perspective
1. Hardware
  1. Hardware test
2. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties
      1. Software fault tolerance

Recommendations

Relaxed Paxos: quorum intersection revisited (again)
PaPoC '22: Proceedings of the 9th Workshop on Principles and Practice of Consistency for Distributed Data

Distributed consensus, the ability to reach agreement in the face of failures, is a fundamental primitive for constructing reliable distributed systems. The Paxos algorithm is synonymous with consensus and widely utilized in production. Paxos uses two ...
S-Paxos: Offloading the Leader for High Throughput State Machine Replication
SRDS '12: Proceedings of the 2012 IEEE 31st Symposium on Reliable Distributed Systems

Implementations of state machine replication are prevalently using variants of Paxos or other leader-based protocols. Typically these protocols are also leader-centric, in the sense that the leader performs more work than the non-leader replicas. Such ...
Fast Flexible Paxos: Relaxing Quorum Intersection for Fast Paxos
ICDCN '21: Proceedings of the 22nd International Conference on Distributed Computing and Networking

Paxos, the de facto standard approach to solving distributed consensus, operates in two phases, each of which requires an intersecting quorum of nodes. Multi-Paxos reduces this to one phase by electing a leader but this leader is also a performance ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PODC '07: Proceedings of the twenty-sixth annual ACM symposium on Principles of distributed computing

August 2007

424 pages

ISBN:9781595936165

DOI:10.1145/1281100

General Chair:
Indranil Gupta
UIUC, USA
,
Program Chair:
Rogert Wattenhofer
ETH Zurich, Switzerland

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

PODC07

Sponsor:

PODC07: ACM Symposium on Principles of Distributed Computing 2007

August 12 - 15, 2007

Oregon, Portland, USA

Acceptance Rates

Overall Acceptance Rate 740 of 2,477 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

409
Total Citations
View Citations
6,525
Total Downloads

Downloads (Last 12 months)201
Downloads (Last 6 weeks)16

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pacini AScano DSgambelluri AValcarenghi LGiorgetti A(2025)Hybrid-Hierarchical Synchronization for Resilient Large-Scale SDN ArchitecturesIEEE Access10.1109/ACCESS.2025.352722413(9032-9046)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2025.3527224
Zhang CWang LShang JXiao ZXiao LHan MWei BShen RWang J(2025)ICCG: low-cost and efficient consistency with adaptive synchronization for metadata replicationFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-023-2772-y19:1Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1007/s11704-023-2772-y
Dong HLiu S(2024)Asynchronous Consensus Quorum Read: Pioneering Read Optimization for Asynchronous Consensus ProtocolsElectronics10.3390/electronics1303048113:3(481)Online publication date: 23-Jan-2024
https://doi.org/10.3390/electronics13030481
Han FLiu HChen BJia DZhou JTeng XYang CXi HTian WTao SWang SXu QYang Z(2024)PALF: Replicated Write-Ahead Logging for Distributed DatabasesProceedings of the VLDB Endowment10.14778/3685800.368580317:12(3745-3758)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685803
Zhang ZHu HZhou XTu YQian WZhou A(2024)Fast Commitment for Geo-Distributed Transactions via Decentralized Co-CoordinatorsProceedings of the VLDB Endowment10.14778/3675034.367504617:10(2555-2567)Online publication date: 6-Aug-2024
https://doi.org/10.14778/3675034.3675046
Lai ZCui FFan HLo EZhou WLi F(2024)Occam's Razor for Distributed ProtocolsProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698514(618-636)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698514
Alves CIdalino TMendizabal O(2024)Extending State Machine Replication through CompositionProceedings of the 13th Latin-American Symposium on Dependable and Secure Computing10.1145/3697090.3697106(231-240)Online publication date: 26-Nov-2024
https://dl.acm.org/doi/10.1145/3697090.3697106
Bolina JSutra PAntunes DCamargos L(2024)Generic MulticastProceedings of the 13th Latin-American Symposium on Dependable and Secure Computing10.1145/3697090.3697095(81-90)Online publication date: 26-Nov-2024
https://dl.acm.org/doi/10.1145/3697090.3697095
Wang BLiu SDong HWang XXu WZhang JZhong PZhang Y(2024)Bandle: Asynchronous State Machine Replication Made EfficientProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3650091(265-280)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3650091
Tang RSun XHuang YWei YOuyang LMa X(2024)SandTable: Scalable Distributed System Model Checking with Specification-Level State ExplorationProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3650077(736-753)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3650077
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten