research-article

Riak Core: building distributed applications without shared state

Author:

Rusty KlophausAuthors Info & Claims

CUFP '10: ACM SIGPLAN Commercial Users of Functional Programming

Article No.: 14, Page 1

https://doi.org/10.1145/1900160.1900176

Published: 01 October 2010 Publication History

Get Access

Abstract

Storing big data reliably is hard. Searching that data is just as hard. Basho Technologies, the company behind Riak KV and Riak Search, focuses on solving these two problems.

Both Riak KV (a key-value datastore and map/reduce platform) and Riak Search (a Solr-compatible full-text search and indexing engine) are built around a library called Riak Core that manages the mechanics of running a distributed application in a cluster without requiring a central coordinator or shared state. Using Riak Core, these applications can scale to hundreds of servers, handle enterprise-sized amounts of data, and remain operational in the face of server failure.* This talk will describe the implementation, responsibilities, and boundaries of Riak Core, including how Riak Core:

•Divides the data- or computing-domain of your application into separate virtual nodes located on different physical servers.

•Distributes data and operations to the correct virtual nodes within the cluster.

•Dynamically re-shapes the cluster without requiring a central coordinator when nodes enter, leave, crash, slow down, or go dark.

•Provides the Erlang community with a solid platform for creating other distributed applications.

Special attention will be paid to how Riak Core adopts common functional programming patterns and leverages OTP/Erlang libraries and behaviours.

Supplementary Material

MOV File (cufp-1530-klophaus.mov)

Download
128.25 MB

Cited By

View all

Almeida P(2024)Approaches to Conflict-free Replicated Data TypesACM Computing Surveys10.1145/369524957:2(1-36)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3695249
Csirmaz ECsirmaz L(2023)Synchronizing Many Filesystems in Near Linear TimeFuture Internet10.3390/fi1506019815:6(198)Online publication date: 30-May-2023
https://doi.org/10.3390/fi15060198
Haas JMogk RYanakieva EBieniusa AMezini M(2023)LoRe: A Programming Model for Verifiably Safe Local-first SoftwareACM Transactions on Programming Languages and Systems10.1145/363376946:1(1-26)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1145/3633769
Show More Cited By

Recommendations

Evaluating multi-core and many-core architectures through accelerating the three-dimensional Lax-Wendroff correction stencil

Wave propagation forward modeling is a widely used computational method in oil and gas exploration. The iterative stencil loops in such problems have broad applications in scientific computing. However, executing such loops can be highly time-consuming, ...
Vectorizing Unstructured Mesh Computations for Many-core Architectures
PMAM'14: Proceedings of Programming Models and Applications on Multicores and Manycores

Achieving optimal performance on the latest multi-core and many-core architectures depends more and more on making efficient use of the hardware's vector processing capabilities. While auto-vectorizing compilers do not require the use of vector ...
Vectorizing Unstructured Mesh Computations for Many-core Architectures
PMAM'14: Proceedings of Programming Models and Applications on Multicores and Manycores

Achieving optimal performance on the latest multi-core and many-core architectures depends more and more on making efficient use of the hardware's vector processing capabilities. While auto-vectorizing compilers do not require the use of vector ...

Comments

Information & Contributors

Information

Published In

CUFP '10: ACM SIGPLAN Commercial Users of Functional Programming

October 2010

16 pages

ISBN:9781450305167

DOI:10.1145/1900160

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

ICFP '10

Sponsor:

SIGPLAN

ICFP '10: ACM SIGPLAN International Conference on Functional Programming

October 1 - 2, 2010

Maryland, Baltimore

Upcoming Conference

ICFP '25

Sponsor:
sigplan

ACM SIGPLAN International Conference on Functional Programming

October 12 - 18, 2025

Singapore , Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

60
Total Citations
View Citations
279
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Almeida P(2024)Approaches to Conflict-free Replicated Data TypesACM Computing Surveys10.1145/369524957:2(1-36)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3695249
Csirmaz ECsirmaz L(2023)Synchronizing Many Filesystems in Near Linear TimeFuture Internet10.3390/fi1506019815:6(198)Online publication date: 30-May-2023
https://doi.org/10.3390/fi15060198
Haas JMogk RYanakieva EBieniusa AMezini M(2023)LoRe: A Programming Model for Verifiably Safe Local-first SoftwareACM Transactions on Programming Languages and Systems10.1145/363376946:1(1-26)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1145/3633769
Karras AKarras CSchizas NSioutas SZaroliagis C(2023)Algorithmic Aspects of Distributed Hash Tables on Cloud, Fog, and Edge Computing Applications: A SurveyAlgorithmic Aspects of Cloud Computing10.1007/978-3-031-49361-4_8(133-171)Online publication date: 5-Sep-2023
https://dl.acm.org/doi/10.1007/978-3-031-49361-4_8
Csirmaz ECsirmaz L(2022)Data Synchronization: A Complete Theoretical Solution for FilesystemsFuture Internet10.3390/fi1411034414:11(344)Online publication date: 21-Nov-2022
https://doi.org/10.3390/fi14110344
Laddad SPower CMilano MCheung ACrooks NHellerstein J(2022)Keep CALM and CRDT OnProceedings of the VLDB Endowment10.14778/3574245.357426816:4(856-863)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.14778/3574245.3574268
Rinberg ASolomon TShlomo RKhazma GLushi GKeidar ITa-Shma P(2022)DSONProceedings of the VLDB Endowment10.14778/3510397.351040315:5(1053-1065)Online publication date: 18-May-2022
https://dl.acm.org/doi/10.14778/3510397.3510403
Laddad SPower CMilano MCheung AHellerstein J(2022)Katara: synthesizing CRDTs with verified liftingProceedings of the ACM on Programming Languages10.1145/35633366:OOPSLA2(1349-1377)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3563336
Cazzola WCesarini FTansini L(2022)PerformERL: a performance testing framework for erlangDistributed Computing10.1007/s00446-022-00429-735:5(439-454)Online publication date: 1-Aug-2022
https://doi.org/10.1007/s00446-022-00429-7
Bannour FSouihi SMellouk A(2022)ReferencesSoftware‐Defined Networking10.1002/9781394186181.refs(121-137)Online publication date: 16-Dec-2022
https://doi.org/10.1002/9781394186181.refs
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Evaluating multi-core and many-core architectures through accelerating the three-dimensional Lax-Wendroff correction stencil

Vectorizing Unstructured Mesh Computations for Many-core Architectures

Vectorizing Unstructured Mesh Computations for Many-core Architectures

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

Abstract

Supplementary Material

Cited By

Recommendations

Evaluating multi-core and many-core architectures through accelerating the three-dimensional Lax-Wendroff correction stencil

Vectorizing Unstructured Mesh Computations for Many-core Architectures

Vectorizing Unstructured Mesh Computations for Many-core Architectures

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations