research-article

A Hybrid Partitioning Strategy for NewSQL Databases: The VoltDB Case

Authors:

Geomar A. Schreiner,

Guilherme Dal Bianco,

Ronaldo dos Santos MelloAuthors Info & Claims

iiWAS2019: Proceedings of the 21st International Conference on Information Integration and Web-based Applications & Services

Pages 353 - 360

https://doi.org/10.1145/3366030.3366062

Published: 22 February 2020 Publication History

Abstract

Several application domains deal with the management of massive data volumes and thousands of OLTP transactions per second. Traditional relational databases cannot cope with these requirements. NewSQL is a new generation of databases that provides both high scalability and availability and ACID properties support. Besides, it is a promising solution to handle these application data management needs. Although data partitioning is an essential feature for tuning relational databases, stills an open issue for NewSQL systems. In this paper, we propose a hybrid partitioning approach for NewSQL databases that allows the user to define the vertical and horizontal data partitions. In order to determine what site will store each data fragment, we propose a hash function that considers schema information and data access statistics. Our experimental evaluation compares our hybrid VoltDB version against the standard VoltDB. The results highlight that our strategy increases the number of single-site transactions from 37% to 76%.

References

[1]

Azza Abouzeid, Kamil Bajda-Pawlikowski, Daniel Abadi, Avi Silberschatz, and Alexander Rasin. 2009. HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. Proc. VLDB Endow. 2, 1 (Aug. 2009), 922--933.

Digital Library

[2]

Mohammed Al-Kateb, Paul Sinclair, Grace Au, and Carrie Ballinger. 2016. Hybrid Row-column Partitioning in Teradata®. Proc. VLDB Endow. 9, 13 (Sept. 2016), 1353--1364.

Digital Library

[3]

R. R. Amossen. 2010. Vertical partitioning of relational OLTP databases using integer programming. In 2010 IEEE 26th International Conference on Data Engineering Workshops (ICDEW 2010). 93--98. https://doi.org/10.1109/ICDEW.2010.5452739

[4]

Joy Arulraj, Andrew Pavlo, and Prashanth Menon. 2016. Bridging the Archipelago Between Row-Stores and Column-Stores for Hybrid Workloads. In Proceedings of the 2016 International Conference on Management of Data (SIGMOD '16). ACM, New York, NY, USA, 16.

Digital Library

[5]

E. Brewer. 2012. CAP twelve years later: How the "rules" have changed. Computer 45, 2 (Feb 2012), 23--29.

Digital Library

[6]

Ugur Cetintemel, Jiang Du, Tim Kraska, Samuel Madden, David Maier, John Meehan, Andrew Pavlo, Michael Stonebraker, Erik Sutherland, Nesime Tatbul, Kristin Tufte, Hao Wang, and Stanley Zdonik. 2014. S-Store: A Streaming NewSQL System for Big Velocity Applications. Proc. VLDB Endow. 7, 13 (Aug. 2014), 4.

Digital Library

[7]

Carlo Curino, Evan Jones, Yang Zhang, and Sam Madden. 2010. Schism: A Workload-driven Approach to Database Replication and Partitioning. Proc. VLDB Endow. 3, 1-2 (Sept. 2010), 48--57. https://doi.org/10.14778/1920841.1920853

Digital Library

[8]

Djellel Eddine Difallah, Andrew Pavlo, Carlo Curino, and Philippe Cudre-Mauroux. 2013. OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases. Proc. VLDB Endow. 7, 4 (Dec. 2013), 277--288. https://doi.org/10.14778/2732240.2732246

Digital Library

[9]

Aaron J. Elmore, Vaibhav Arora, Rebecca Taft, Andrew Pavlo, Divyakant Agrawal, and Amr El Abbadi. 2015. Squall: Fine-Grained Live Reconfiguration for Partitioned Main Memory Databases. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD '15). ACM, New York, NY, USA, 299--313.

Digital Library

[10]

Katarina Grolinger, Wilson A Higashino, Abhinav Tiwari, and Miriam AM Capretz. 2013. Data management in cloud environments: NoSQL and NewSQL data stores. Journal of Cloud Computing: Advances, Systems and Applications 2, 1 (2013), 22.

Digital Library

[11]

Robert Kallman, Hideaki Kimura, Jonathan Natkins, Andrew Pavlo, Alexander Rasin, Stanley Zdonik, Evan PC Jones, Samuel Madden, Michael Stonebraker, Yang Zhang, et al. 2008. H-store: a high-performance, distributed main memory transaction processing system. Proceedings of the VLDB Endowment 1, 2 (2008), 1496--1499.

Digital Library

[12]

Rakesh Kumar, Neha Gupta, Shilpi Charu, and Sunil Kumar Jangir. 2014. Manage Big Data through NewSQL. In National Conference on Innovation in Wireless Communication and Networking Technology-2014, Association with THE INSTITUTION OF ENGINEERS (INDIA).

[13]

Patrick Valduriez (auth.) M. Tamer Özsu. 2011. Principles of Distributed Database Systems, Third Edition (3 ed.). Springer-Verlag New York.

[14]

John Meehan, Nesime Tatbul, Stan Zdonik, Cansu Aslantas, Ugur Cetintemel, Jiang Du, Tim Kraska, Samuel Madden, David Maier, Andrew Pavlo, Michael Stonebraker, Kristin Tufte, and Hao Wang. 2015. S-Store: Streaming Meets Transaction Processing. Proc. VLDB Endow. 8, 13 (Sept. 2015), 12.

Digital Library

[15]

Shamkant Navathe, Stefano Ceri, Gio Wiederhold, and Jinglie Dou. 1984. Vertical partitioning algorithms for database design. ACM Transactions on Database Systems (TODS) 9, 4 (1984), 680--710.

Digital Library

[16]

Andrew Pavlo and Matthew Aslett. 2016. What's Really New with NewSQL? SIGMOD Rec. 45, 2 (Sept. 2016), 45--55.

Digital Library

[17]

Andrew Pavlo, Carlo Curino, and Stanley Zdonik. 2012. Skew-aware Automatic Database Partitioning in Shared-nothing, Parallel OLTP Systems. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data (SIGMOD '12). ACM, New York, NY, USA, 61--72.

Digital Library

[18]

Tilmann Rabl and Hans-Arno Jacobsen. 2017. Query Centric Partitioning and Allocation for Partially Replicated Database Systems. In Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD '17). ACM, New York, NY, USA, 315--330.

Digital Library

[19]

Pramod J Sadalage and Martin Fowler. 2012. NoSQL distilled: a brief guide to the emerging world of polyglot persistence. Pearson Education.

[20]

Marco Serafini, Essam Mansour, Ashraf Aboulnaga, Kenneth Salem, Taha Rafiq, and Umar Farooq Minhas. 2014. Accordion: Elastic Scalability for Database Systems Supporting Distributed Transactions. Proc. VLDB Endow. 7, 12 (Aug. 2014), 1035--1046.

Digital Library

[21]

Marco Serafini, Rebecca Taft, Aaron J. Elmore, Andrew Pavlo, Ashraf Aboulnaga, and Michael Stonebraker. 2016. Clay: Fine-grained Adaptive Partitioning for General Database Schemas. Proc. VLDB Endow. 10, 4 (Nov. 2016), 445--456.

Digital Library

[22]

Gitanjali Sharma and Pankaj Deep Kaur. 2015. Architecting Solutions for Scalable Databases in Cloud. In Proceedings of the Third International Symposium on Women in Computing and Informatics (WCI '15). ACM, New York, NY, USA, 469--476.

Digital Library

[23]

Michael Stonebraker. 2012. New Opportunities for New SQL. Commun. ACM 55, 11 (Nov. 2012), 10--11. https://doi.org/10.1145/2366316.2366319

Digital Library

[24]

Michael Stonebraker and Ariel Weisberg. 2013. The VoltDB Main Memory DBMS. IEEE Data Eng. Bull. 36, 2 (2013), 21--27.

[25]

Rebecca Taft, Essam Mansour, Marco Serafini, Jennie Duggan, Aaron J. Elmore, Ashraf Aboulnaga, Andrew Pavlo, and Michael Stonebraker. 2014. E-store: Finegrained Elastic Partitioning for Distributed Transaction Processing Systems. Proc. VLDB Endow. 8, 3 (Nov. 2014), 245--256. https://doi.org/10.14778/2735508.2735514

Digital Library

[26]

Li-Yan Yuan, Lengdong Wu, Jia-Huai You, and Yan Chi. 2015. A Demonstration of Rubato DB: A Highly Scalable NewSQL Database System for OLTP and Big Data Applications. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD '15). ACM, New York, NY, USA, 6.

Digital Library

Cited By

Cantini RMarozzo FOrsino ATalia DTrunfio PBadia REjarque JVázquez-Novoa F(2024)Block size estimation for data partitioning in HPC applications using machine learning techniquesJournal of Big Data10.1186/s40537-023-00862-w11:1Online publication date: 16-Jan-2024
https://doi.org/10.1186/s40537-023-00862-w
Bharati RAttar V(2022)Performance Analysis of Scalable Transactions in Distributed Data StoreApplied Computational Technologies10.1007/978-981-19-2719-5_51(542-548)Online publication date: 15-May-2022
https://doi.org/10.1007/978-981-19-2719-5_51
Castro-Medina FRodríguez-Mazahua LLópez-Chau ACervantes JAlor-Hernández GMachorro-Cano I(2020)Application of Dynamic Fragmentation Methods in Multimedia Databases: A ReviewEntropy10.3390/e2212135222:12(1352)Online publication date: 30-Nov-2020
https://doi.org/10.3390/e22121352

Index Terms

A Hybrid Partitioning Strategy for NewSQL Databases: The VoltDB Case
1. Information systems
  1. Data management systems

Recommendations

NewSQL Through the Looking Glass
iiWAS2019: Proceedings of the 21st International Conference on Information Integration and Web-based Applications & Services

Several applications require to handle large and heterogeneous data volumes as well as thousands of OLTP transactions per second. Traditional relational databases are not suitable for these requirements. On the other hand, NoSQL databases are able to ...
What's Really New with NewSQL?

A new class of database management systems (DBMSs) called NewSQL tout their ability to scale modern on-line transaction processing (OLTP) workloads in a way that is not possible with legacy systems. The term NewSQL was first used by one of the authors ...
An Open Source Cloud-Based NoSQL and NewSQL Database Benchmarking Platform for IoT Data
Benchmarking, Measuring, and Optimizing
Abstract
Internet of Things (IoT) is continually expanding, and the information being transmitted through IoT is often in large-scale in both volume and velocity. With its evolution, IoT raises new challenges such as throughput and scalability of software ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

iiWAS2019: Proceedings of the 21st International Conference on Information Integration and Web-based Applications & Services

December 2019

709 pages

ISBN:9781450371797

DOI:10.1145/3366030

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

JKU: Johannes Kepler Universität Linz
@WAS: International Organization of Information Integration and Web-based Applications and Services

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 February 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES)

Conference

iiWAS2019

iiWAS2019: The 21st International Conference on Information Integration and Web-based Applications & Services

December 2 - 4, 2019

Munich, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cantini RMarozzo FOrsino ATalia DTrunfio PBadia REjarque JVázquez-Novoa F(2024)Block size estimation for data partitioning in HPC applications using machine learning techniquesJournal of Big Data10.1186/s40537-023-00862-w11:1Online publication date: 16-Jan-2024
https://doi.org/10.1186/s40537-023-00862-w
Bharati RAttar V(2022)Performance Analysis of Scalable Transactions in Distributed Data StoreApplied Computational Technologies10.1007/978-981-19-2719-5_51(542-548)Online publication date: 15-May-2022
https://doi.org/10.1007/978-981-19-2719-5_51
Castro-Medina FRodríguez-Mazahua LLópez-Chau ACervantes JAlor-Hernández GMachorro-Cano I(2020)Application of Dynamic Fragmentation Methods in Multimedia Databases: A ReviewEntropy10.3390/e2212135222:12(1352)Online publication date: 30-Nov-2020
https://doi.org/10.3390/e22121352

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten