research-article

Pivotal Greenplum© for Kubernetes: Demonstration of Managing Greenplum Database on Kubernetes

Authors:

Xin ZhangAuthors Info & Claims

SIGMOD '19: Proceedings of the 2019 International Conference on Management of Data

Pages 1969 - 1972

https://doi.org/10.1145/3299869.3320229

Published: 25 June 2019 Publication History

Get Access

Abstract

Greenplum Database (GPDB) has many features designed to enable data scientists. Before a data scientist can use GPDB, a database administrator (DBA) must provision a cluster and install any required data science packages. Provisioning a GPDB cluster on bare metal requires a lengthy setup process. Scaling, recovering, and securing the cluster post-deployment are also complex. Greenplum for Kubernetes (GP4K) abstracts away these complexities, simplifying and automating the process for users. In this demonstration, we introduce GP4K with an opinionated deployment and a declarative manifest. We provide a brief overview of GP4K's architecture and discuss its implementation. We also demonstrate a full life cycle of managing a cluster from birth to retirement, including scale-up and self-healing all with minimal DBA inputs.

References

[1]

The Kubernetes Authors. 2018. What is Kubernetes. https://kubernetes. io/docs/concepts/overview/what-is-kubernetes/

Google Scholar

[2]

Benoit Dageville, Thierry Cruanes, Marcin Zukowski, Vadim Antonov, Artin Avanes, Jon Bock, Jonathan Claybaugh, Daniel Engovatov, Martin Hentschel, Jiansheng Huang, Allison W. Lee, Ashish Motivala, Abdul Q. Munir, Steven Pelley, Peter Povinec, Greg Rahn, Spyridon Triantafyllis, and Philipp Unterbrunner. 2016. The Snowflake Elastic DataWarehouse. In Proceedings of the 2016 International Conference on Management of Data (SIGMOD '16). ACM, New York, NY, USA, 215--226.

Digital Library

Google Scholar

[3]

David DeWitt and Jim Gray. 1992. Parallel Database Systems: The Future of High Performance Database Systems. Commun. ACM 35, 6 (June 1992), 85--98.

Digital Library

Google Scholar

[4]

Hemant Kumar (Red Hat). 2018. Resizing Persistent Volumes using Kubernetes. https://kubernetes.io/blog/2018/07/12/ resizing-persistent-volumes-using-kubernetes/

Google Scholar

[5]

Cockroach Labs. 2018. https://www.cockroachlabs.com/docs/stable/ orchestrate-cockroachdb-with-kubernetes.html

Google Scholar

[6]

Apache MADlib. 2018. http://madlib.apache.org/docs/latest/index.html

Google Scholar

[7]

Pivotal Software. 2018. https://gpdb.docs.pivotal.io/5130/admin_guide/ intro/arch_overview.html

Google Scholar

[8]

Pivotal Software. 2018. https://gpdb.docs.pivotal.io/590/utility_guide/ admin_utilities/gprecoverseg.html

Google Scholar

[9]

Ben Vandiver, Shreya Prasad, Pratibha Rana, Eden Zik, Amin Saeidi, Pratyush Parimal, Styliani Pantela, and Jaimin Dave. 2018. Eon Mode: Bringing the Vertica Columnar Database to the Cloud. In Proceedings of the 2018 International Conference on Management of Data (SIGMOD '18). ACM, New York, NY, USA, 797--809.

Digital Library

Google Scholar

Cited By

View all

Peng JZheng SLi YShuai Z(2023)From Source Code to Model Service: A Framework’s PerspectiveAdvances in Natural Computation, Fuzzy Systems and Knowledge Discovery10.1007/978-3-031-20738-9_147(1355-1362)Online publication date: 30-Jan-2023
https://doi.org/10.1007/978-3-031-20738-9_147
Wu AGuo JYang P(2020)Research on Data Sharing Architecture for Ecological Monitoring Using Iot Streaming DataIEEE Access10.1109/ACCESS.2020.30344668(195385-195397)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3034466

Index Terms

Recommendations

Greenplum: A Hybrid Database for Transactional and Analytical Workloads
SIGMOD '21: Proceedings of the 2021 International Conference on Management of Data

Demand for enterprise data warehouse solutions to support real-time Online Transaction Processing (OLTP) queries as well as long-running Online Analytical Processing (OLAP) workloads is growing. Greenplum database is traditionally known as an OLAP data ...
On the performance of SQL scalable systems on Kubernetes: a comparative study
Abstract
The popularization of Hadoop as the the-facto standard platform for data analytics in the context of Big Data applications has led to the upsurge of SQL-on-Hadoop systems, which provide scalable query execution engines allowing the use of SQL ...
Unified analytics platform for big data
WICSA/ECSA '12: Proceedings of the WICSA/ECSA 2012 Companion Volume

Greenplum is using Hadoop and several other open source tools in interesting ways as part of a big data architecture with their Greenplum Database (a scale-out MPP SQL database).

Comments

Information & Contributors

Information

Published In

SIGMOD '19: Proceedings of the 2019 International Conference on Management of Data

June 2019

2106 pages

ISBN:9781450356435

DOI:10.1145/3299869

General Chairs:
Peter Boncz
CWI & Vrije Universiteit Amsterdam, The Netherlands
,
Stefan Manegold
CWI & Universiteit Leiden, The Netherlands
,
Program Chairs:
Anastasia Ailamaki
EPFL, Switzerland
,
Amol Deshpande
University of Maryland, USA
,
Tim Kraska
MIT, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGMOD/PODS '19

Sponsor:

SIGMOD

SIGMOD/PODS '19: International Conference on Management of Data

June 30 - July 5, 2019

Amsterdam, Netherlands

Acceptance Rates

SIGMOD '19 Paper Acceptance Rate 88 of 430 submissions, 20%;

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
344
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Peng JZheng SLi YShuai Z(2023)From Source Code to Model Service: A Framework’s PerspectiveAdvances in Natural Computation, Fuzzy Systems and Knowledge Discovery10.1007/978-3-031-20738-9_147(1355-1362)Online publication date: 30-Jan-2023
https://doi.org/10.1007/978-3-031-20738-9_147
Wu AGuo JYang P(2020)Research on Data Sharing Architecture for Ecological Monitoring Using Iot Streaming DataIEEE Access10.1109/ACCESS.2020.30344668(195385-195397)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3034466

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Greenplum: A Hybrid Database for Transactional and Analytical Workloads

On the performance of SQL scalable systems on Kubernetes: a comparative study

Unified analytics platform for big data