research-article

Elastic Use of Far Memory for In-Memory Database Management Systems

Authors:

Thomas Willhalm,

Suprasad Mutalik Desai,

Oliver RebholzAuthors Info & Claims

DaMoN '23: Proceedings of the 19th International Workshop on Data Management on New Hardware

Pages 35 - 43

https://doi.org/10.1145/3592980.3595311

Published: 18 June 2023 Publication History

Abstract

The separation and independent scalability of compute and memory is one of the crucial aspects for modern in-memory database systems (IMDBMSs) in the cloud. The new, cache-coherent memory interconnect Compute Express Link (CXL) promises elastic memory capacity through memory pooling. In this work, we adapt the well-known IMDBMS, SAP HANA, for memory pools by features of table data placement and operational heap memory allocation on far memory, and study the impact of the limited bandwidth and higher latency of CXL. Our results show negligible performance degradation for TPC-C. For the analytical workloads of TPC-H, a notable impact on query processing is observed due to the limited bandwidth and long latency of our early CXL implementation. However, our emulation shows it would be acceptably smaller with the improved CXL memory devices.

References

[1]

Marcos K. Aguilera, Kimberly Keeton, Stanko Novakovic, and Sharad Singhal. 2019. Designing Far Memory Data Structures: Think Outside the Box. In HotOS. ACM, 120–126. https://doi.org/10.1145/3317550.3321433

Digital Library

[2]

Minseon Ahn, Andrew Chang, Donghun Lee, Jongmin Gim, Jungmin Kim, Jaemin Jung, Oliver Rebholz, Vincent Pham, Krishna T. Malladi, and Yang-Seok Ki. 2022. Enabling CXL Memory Expansion for In-Memory Database Management Systems. In DaMoN. ACM, 8:1–8:5. https://doi.org/10.1145/3533737.3535090

Digital Library

[3]

Emmanuel Amaro, Christopher Branner-Augmon, Zhihong Luo, Amy Ousterhout, Marcos K. Aguilera, Aurojit Panda, Sylvia Ratnasamy, and Scott Shenker. 2020. Can far memory improve job throughput?. In EuroSys. ACM, 14:1–14:16. https://doi.org/10.1145/3342195.3387522

Digital Library

[4]

Mihnea Andrei, Christian Lemke, Günter Radestock, 2017. SAP HANA adoption of non-volatile memory. Proceedings of the VLDB Endowment 10, 12 (2017), 1754–1765. https://doi.org/10.14778/3137765.3137780

Digital Library

[5]

AsteraLabs. 2022. CXL Memory Accelerators. https://www.asteralabs.com/products/cxl-memory-platform/

[6]

CCIX Consortium. 2017. CCIX. https://www.ccixconsortium.com/

[7]

Compute Express Link Consortium. 2019. CXL. https://www.computeexpresslink.org/

[8]

Gen-Z Consortium. 2016. Gen-Z. https://genzconsortium.org/

[9]

OpenCAPI Consortium. 2014. OpenCAPI. https://opencapi.org/

[10]

Franz Faerber, Alfons Kemper, Per-Åke Larson, Justin J. Levandoski, Thomas Neumann, and Andrew Pavlo. 2017. Main Memory Database Systems. Found. Trends Databases 8, 1-2 (2017), 1–130. https://doi.org/10.1561/1900000058

[11]

Andreas Geyer, Daniel Ritter, Dong Hun Lee, Minseon Ahn, Johannes Pietrzyk, Alexander Krause, Dirk Habich, and Wolfgang Lehner. 2023. Working with Disaggregated Systems. What are the Challenges and Opportunities of RDMA and CXL?. In BTW(LNI, Vol. P-331). Gesellschaft für Informatik e.V., 751–755. https://doi.org/10.18420/BTW2023-47

[12]

Donghyun Gouk, Sangwon Lee, Miryeong Kwon, and Myoungsoo Jung. 2022. Direct access, High-Performance memory disaggregation with DirectCXL. In USENIX ATC. 287–294. https://www.usenix.org/conference/atc22/presentation/gouk

[13]

Intel®. 2021. Intel® VTune™ Profiler. https://www.intel.com/content/www/us/en/developer/tools/oneapi/vtune-profiler.html

[14]

Robert Lasch, Thomas Legler, Norman May, Bernhard Scheirle, and Kai-Uwe Sattler. 2022. Cost modelling for optimal data placement in heterogeneous main memory. Proceedings of the VLDB Endowment 15, 11 (2022), 2867–2880. https://www.vldb.org/pvldb/vol15/p2867-lasch.pdf

Digital Library

[15]

Huaicheng Li, Daniel S Berger, Lisa Hsu, Daniel Ernst, Pantea Zardoshti, Stanko Novakovic, Monish Shah, Samir Rajadnya, Scott Lee, Ishwar Agarwal, 2023. Pond: Cxl-based memory pooling systems for cloud platforms. In ASPLOS. ACM, 574–587. https://doi.org/10.1145/3575693.3578835

Digital Library

[16]

Hasan Al Maruf, Hao Wang, Abhishek Dhanotia, Johannes Weiner, Niket Agarwal, Pallab Bhattacharya, Chris Petersen, Mosharaf Chowdhury, Shobhit O. Kanaujia, and Prakash Chauhan. 2022. TPP: Transparent Page Placement for CXL-Enabled Tiered Memory. CoRR abs/2206.02878 (2022). https://doi.org/10.48550/arXiv.2206.02878 arXiv:2206.02878

[17]

J. McGlone, P. Palazzari, and J. B. Leclere. 2018. Accelerating Key In-memory Database Functionality with FPGA Technology. In ReConFig. 1–8. https://doi.org/10.1109/RECONFIG.2018.8641722

[18]

Samsung Newsroom. 2022. Samsung Electronics Introduces Industry’s First 512GB CXL Memory Module. https://news.samsung.com/global/samsung-electronics-introduces-industrys-first-512gb-cxl-memory-module

[19]

SK Hynix Newsroom. 2022. SK hynix Develops DDR5 DRAM CXLTM Memory to Expand the CXL Memory Ecosystem. https://news.skhynix.com/sk-hynix-develops-ddr5-dram-cxltm-memory-to-expand-the-cxl-memory-ecosystem/

[20]

S. J. Park, H. Kim, K.-S. Kim, J. So, J. Ahn, W.-J. Lee, D. Kim, Y.-J. Kim, J. Seok, J.-G. Lee, H.-Y. Ryu, C. Y. Lee, J. Prout, K.-C. Ryoo, S.-J. Han, M.-K. Kook, J. S. Choi, J. Gim, Y. S. Ki, S. Ryu, C. Park, D.-G. Lee, J. Cho, H. Song, and J. Y. Lee. 2022. Scaling of Memory Performance and Capacity with CXL Memory Expander. In 2022 IEEE HCS. IEEE, 1–27. https://doi.org/10.1109/HCS55958.2022.9895633

[21]

Intel® PCM. 2023. Intel® Performance Counter Monitor. https://github.com/intel/pcm

[22]

Hasso Plattner. 2009. A common database approach for OLTP and OLAP using an in-memory column database. In SIGMOD. ACM, 1–2. https://doi.org/10.1145/1559845.1559846

Digital Library

[23]

Hasso Plattner. 2014. The Impact of Columnar In-memory Databases on Enterprise Systems: Implications of Eliminating Transaction-maintained Aggregates. Proc. VLDB Endow. 7, 13 (Aug. 2014), 1722–1729. https://doi.org/10.14778/2733004.2733074

Digital Library

[24]

Iraklis Psaroudakis, Florian Wolf, Norman May, Thomas Neumann, Alexander Boehm, Anastasia Ailamaki, and Kai-Uwe Sattler. 2015. Scaling Up Mixed Workloads: A Battle of Data Freshness, Flexibility, and Scheduling. Performance Characterization And Benchmarking: Traditional To Big Data 8904 (2015), 16. 97–112. https://doi.org/10.1007/978-3-319-15350-6_7

[25]

Reza Sherkat, Colin Florendo, Mihnea Andrei, Rolando Blanco, Adrian Dragusanu, Amit Pathak, Pushkar Khadilkar, Neeraj Kulkarni, Christian Lemke, Sebastian Seifert, Sarika Iyer, Sasikanth Gottapu, Robert Schulze, Chaitanya Gottipati, Nirvik Basak, Yanhong Wang, Vivek Kandiyanallur, Santosh Pendap, Dheren Gala, Rajesh Almeida, and Prasanta Ghosh. 2019. Native Store Extension for SAP HANA. Proc. VLDB Endow. 12, 12 (2019), 2047–2058. https://doi.org/10.14778/3352063.3352123

Digital Library

[26]

Vishal Sikka, Franz Färber, Wolfgang Lehner, Sang Kyun Cha, Thomas Peh, and Christof Bornhövd. 2012. Efficient Transaction Processing in SAP HANA Database: The End of a Column Store Myth. In SIGMOD. ACM, 731–742. https://doi.org/10.1145/2213836.2213946

Digital Library

[27]

Joonseop Sim, Soohong Ahn, Taeyoung Ahn, Seungyong Lee, Myunghyun Rhee, Jooyoung Kim, Kwangsik Shin, Donguk Moon, Euiseok Kim, and Kyoung Park. 2023. Computational CXL-Memory Solution for Accelerating Memory-Intensive Applications. IEEE Comput. Archit. Lett. 22, 1 (2023), 5–8. https://doi.org/10.1109/LCA.2022.3226482

[28]

Montage Technology. 2022. Montage Technology Delivers the World’s First CXL™ Memory eXpander Controller. https://www.montage-tech.com/Press_Releases/20220506

[29]

TPC-C. 2023. TPC-C. https://www.tpc.org/tpcc/

[30]

TPC-H. 2023. TPC-H. https://www.tpc.org/tpch/

[31]

Qirui Yang, Runyu Jin, Bridget Davis, Devasena Inupakutika, and Ming Zhao. 2022. Performance Evaluation on CXL-enabled Hybrid Memory Pool. In NAS. IEEE, 1–5. https://doi.org/10.1109/NAS55553.2022.9925356

Cited By

Ahn MWillhalm TMay NLee DDesai SBooss DKim JSingh NRitter DRebholz O(2024)An Examination of CXL Memory Use Cases for In-Memory Database Management Systems Using SAP HANAProceedings of the VLDB Endowment10.14778/3685800.368580917:12(3827-3840)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685809
Fridman YMutalik Desai SSingh NWillhalm TOren G(2023)CXL Memory as Persistent Memory for Disaggregated HPC: A Practical ApproachProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624175(983-994)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624175
Sano SBando YHiwada KKajihara HSuzuki TNakanishi YTaki DKaneko AShiozawa T(2023)GPU Graph Processing on CXL-Based Microsecond-Latency External MemoryProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624173(962-972)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624173

Index Terms

Elastic Use of Far Memory for In-Memory Database Management Systems
1. Hardware
  1. Emerging technologies
    1. Emerging interfaces
2. Information systems
  1. Data management systems
    1. Database management system engines

Recommendations

Enabling CXL Memory Expansion for In-Memory Database Management Systems
DaMoN '22: Proceedings of the 18th International Workshop on Data Management on New Hardware

Limited memory volume is always a performance bottleneck in an in-memory database management system (IMDBMS) as the data size keeps increasing. To overcome the physical memory limitation, heterogeneous and disaggregated computing platforms are proposed,...
Locality aware management on NAND flash-based main memory for in-memory database systems
EDB '16: Proceedings of the Sixth International Conference on Emerging Databases: Technologies, Applications, and Theory

Conventional database systems manage all data on hard disks, but due to a hard disk's frequent I/O operations, this kind of management exposes critical problems when data is huge or operations are complex and frequent. As the size of the main memory ...
Improving In-Memory Database Operations with Acceleration DIMM (AxDIMM)
DaMoN '22: Proceedings of the 18th International Workshop on Data Management on New Hardware

The significant overhead needed to transfer the data between CPUs and memory devices is one of the hottest issues in many areas of computing, such as database management systems. Disaggregated computing on the memory devices is being highlighted as one ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DaMoN '23: Proceedings of the 19th International Workshop on Data Management on New Hardware

June 2023

119 pages

ISBN:9798400701917

DOI:10.1145/3592980

Editors:
Norman May
SAP SE, Germany
,
Nesime Tatbul
Intel Labs and MIT, USA

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SIGMOD/PODS '23

Sponsor:

SIGMOD

SIGMOD/PODS '23: International Conference on Management of Data

June 18 - 23, 2023

WA, Seattle, USA

Acceptance Rates

DaMoN '23 Paper Acceptance Rate 17 of 23 submissions, 74%;

Overall Acceptance Rate 94 of 127 submissions, 74%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
745
Total Downloads

Downloads (Last 12 months)267
Downloads (Last 6 weeks)17

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ahn MWillhalm TMay NLee DDesai SBooss DKim JSingh NRitter DRebholz O(2024)An Examination of CXL Memory Use Cases for In-Memory Database Management Systems Using SAP HANAProceedings of the VLDB Endowment10.14778/3685800.368580917:12(3827-3840)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685809
Fridman YMutalik Desai SSingh NWillhalm TOren G(2023)CXL Memory as Persistent Memory for Disaggregated HPC: A Practical ApproachProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624175(983-994)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624175
Sano SBando YHiwada KKajihara HSuzuki TNakanishi YTaki DKaneko AShiozawa T(2023)GPU Graph Processing on CXL-Based Microsecond-Latency External MemoryProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624173(962-972)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624173

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents