short-paper

Open access

Enabling CXL Memory Expansion for In-Memory Database Management Systems

Authors:

Oliver Rebholz,

Krishna Malladi,

Yang Seok KiAuthors Info & Claims

DaMoN '22: Proceedings of the 18th International Workshop on Data Management on New Hardware

Article No.: 8, Pages 1 - 5

https://doi.org/10.1145/3533737.3535090

Published: 13 June 2022 Publication History

All formats PDF

Abstract

Limited memory volume is always a performance bottleneck in an in-memory database management system (IMDBMS) as the data size keeps increasing. To overcome the physical memory limitation, heterogeneous and disaggregated computing platforms are proposed, such as Gen-Z, CCIX, OpenCAPI, and CXL. In this work, we introduce flexible CXL memory expansion using a CXL type 3 prototype and evaluate its performance in an IMDBMS. Our evaluation shows that CXL memory devices interfaced with PCIe Gen5 are appropriate for memory expansion with nearly no throughput degradation in OLTP workloads and less than 8% throughput degradation in OLAP workloads. Thus, CXL memory is a good candidate for memory expansion with lower TCO in IMDBMSs.

References

[1]

2014. OpenCAPI Consortium. https://opencapi.org/

[2]

2016. Gen-Z Consortium. https://genzconsortium.org/

[3]

2016. NVM Express over Fabric 1.0. https://nvmexpress.org/

[4]

2017. CCIX Consortium. https://www.ccixconsortium.com/

[5]

2019. Compute Express Link. https://www.computeexpresslink.org/

[6]

2021. Device Mapper. https://www.kernel.org/doc/html/latest/admin-guide/device-mapper/index.html

[7]

2021. Intel® VTune™ Profiler. https://www.intel.com/content/www/us/en/developer/tools/oneapi/vtune-profiler.html

[8]

2022. NVLink. https://www.nvidia.com/en-us/data-center/nvlink/

[9]

Mihnea Andrei, Christian Lemke, Günter Radestock, Robert Schulze, Carsten Thiel, Rolando Blanco, Akanksha Meghlan, Muhammad Sharique, Sebastian Seifert, Surendra Vishnoi, 2017. SAP HANA adoption of non-volatile memory. Proceedings of the VLDB Endowment 10, 12 (2017), 1754–1765.

Digital Library

[10]

Franz Färber, Norman May, Wolfgang Lehner, Philipp Große, Ingo Müller, Hannes Rauhe, and Jonathan Dees. 2012. The SAP HANA Database–An Architecture Overview.IEEE Data Eng. Bull. 35, 1 (2012), 28–33.

[11]

Zvika Guz, Harry Li, Anahita Shayesteh, and Vijay Balakrishnan. 2017. NVMe-over-fabrics performance characterization and the path to low-overhead flash disaggregation. In Proceedings of the 10th ACM International Systems and Storage Conference. 1–9.

Digital Library

[12]

Kwangwon Koh, Kangho Kim, Seunghyub Jeon, and Jaehyuk Huh. 2018. Disaggregated cloud memory with elastic block management. IEEE Trans. Comput. 68, 1 (2018), 39–52.

Digital Library

[13]

Dario Korolija, Dimitrios Koutsoukos, Kimberly Keeton, Konstantin Taranov, Dejan Milojičić, and Gustavo Alonso. 2021. Farview: Disaggregated memory with operator off-loading for database engines. arXiv preprint arXiv:2106.07102(2021).

[14]

Clemens Lutz, Sebastian Breß, Steffen Zeuch, Tilmann Rabl, and Volker Markl. 2020. Pump up the volume: Processing large data on GPUs with fast interconnects. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. 1633–1649.

Digital Library

[15]

Hasso Plattner. 2014. The impact of columnar in-memory databases on enterprise systems: implications of eliminating transaction-maintained aggregates. Proceedings of the VLDB Endowment 7, 13 (2014), 1722–1729.

Digital Library

[16]

Iraklis Psaroudakis, Florian Wolf, Norman May, Thomas Neumann, Alexander Böhm, Anastasia Ailamaki, and Kai-Uwe Sattler. 2014. Scaling up mixed workloads: a battle of data freshness, flexibility, and scheduling. In Technology Conference on Performance Evaluation and Benchmarking. Springer, 97–112.

[17]

Konstantin Taranov, Salvatore Di Girolamo, and Torsten Hoefler. 2021. CoRM: Compactable Remote Memory over RDMA. In Proceedings of the 2021 International Conference on Management of Data. 1811–1824.

Digital Library

Cited By

Kim JPark HHong J(2024)Enhancing QoS in Multicore Systems with Heterogeneous Memory ConfigurationsElectronics10.3390/electronics1317349213:17(3492)Online publication date: 3-Sep-2024
https://doi.org/10.3390/electronics13173492
Chen YPan ALei HYe AHan STang YLu WChai YZhang FDu X(2024)TDSQL: Tencent Distributed Database SystemProceedings of the VLDB Endowment10.14778/3685800.368581217:12(3869-3882)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685812
Ahn MWillhalm TMay NLee DDesai SBooss DKim JSingh NRitter DRebholz O(2024)An Examination of CXL Memory Use Cases for In-Memory Database Management Systems Using SAP HANAProceedings of the VLDB Endowment10.14778/3685800.368580917:12(3827-3840)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685809
Show More Cited By

Recommendations

Rcmp: Reconstructing RDMA-Based Memory Disaggregation via CXL
Memory disaggregation is a promising architecture for modern datacenters that separates compute and memory resources into independent pools connected by ultra-fast networks, which can improve memory utilization, reduce cost, and enable elastic scaling of ...
Elastic Use of Far Memory for In-Memory Database Management Systems
DaMoN '23: Proceedings of the 19th International Workshop on Data Management on New Hardware

The separation and independent scalability of compute and memory is one of the crucial aspects for modern in-memory database systems (IMDBMSs) in the cloud. The new, cache-coherent memory interconnect Compute Express Link (CXL) promises elastic memory ...
Improving In-Memory Database Operations with Acceleration DIMM (AxDIMM)
DaMoN '22: Proceedings of the 18th International Workshop on Data Management on New Hardware

The significant overhead needed to transfer the data between CPUs and memory devices is one of the hottest issues in many areas of computing, such as database management systems. Disaggregated computing on the memory devices is being highlighted as one ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

DaMoN '22: Proceedings of the 18th International Workshop on Data Management on New Hardware

June 2022

83 pages

ISBN:9781450393782

DOI:10.1145/3533737

Editors:
Spyros Blanas
The Ohio State University
,
Norman May
SAP SE

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

SIGMOD/PODS '22

Sponsor:

SIGMOD

SIGMOD/PODS '22: International Conference on Management of Data

June 13, 2022

PA, Philadelphia, USA

Acceptance Rates

DaMoN '22 Paper Acceptance Rate 12 of 18 submissions, 67%;

Overall Acceptance Rate 94 of 127 submissions, 74%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
7,500
Total Downloads

Downloads (Last 12 months)2,182
Downloads (Last 6 weeks)194

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim JPark HHong J(2024)Enhancing QoS in Multicore Systems with Heterogeneous Memory ConfigurationsElectronics10.3390/electronics1317349213:17(3492)Online publication date: 3-Sep-2024
https://doi.org/10.3390/electronics13173492
Chen YPan ALei HYe AHan STang YLu WChai YZhang FDu X(2024)TDSQL: Tencent Distributed Database SystemProceedings of the VLDB Endowment10.14778/3685800.368581217:12(3869-3882)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685812
Ahn MWillhalm TMay NLee DDesai SBooss DKim JSingh NRitter DRebholz O(2024)An Examination of CXL Memory Use Cases for In-Memory Database Management Systems Using SAP HANAProceedings of the VLDB Endowment10.14778/3685800.368580917:12(3827-3840)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.14778/3685800.3685809
Baumstark AParadies MSattler KKläbe SBaumann S(2024)So Far and yet so Near - Accelerating Distributed Joins with CXLProceedings of the 20th International Workshop on Data Management on New Hardware10.1145/3662010.3663449(1-9)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3662010.3663449
Gouk DKang SBae HRyu ELee SKim DJang JJung M(2024)Breaking Barriers: Expanding GPU Memory with Sub-Two Digit Nanosecond Latency CXL ControllerProceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3655038.3665953(108-115)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3655038.3665953
Mavrogeorgis NVasiladiotis CMu PKhordadi AFranke BBarbalace ARodríguez GSadayappan PSukumaran-Rajam A(2024)UNIFICO: Thread Migration in Heterogeneous-ISA CPUs without State TransformationProceedings of the 33rd ACM SIGPLAN International Conference on Compiler Construction10.1145/3640537.3641565(86-99)Online publication date: 17-Feb-2024
https://dl.acm.org/doi/10.1145/3640537.3641565
Hao XZhou XYu XStonebraker M(2024)Towards Buffer Management with Tiered Main MemoryProceedings of the ACM on Management of Data10.1145/36392862:1(1-26)Online publication date: 26-Mar-2024
https://doi.org/10.1145/3639286
Tran TAbduljabbar MAhn HKim SPark YHan WAhn SSubramoni HPanda D(2024)OMB-CXL: A Micro-Benchmark Suite for Evaluating MPI Communication Utilizing Compute Express Link Memory DevicesPractice and Experience in Advanced Research Computing 2024: Human Powered Computing10.1145/3626203.3670533(1-8)Online publication date: 17-Jul-2024
https://dl.acm.org/doi/10.1145/3626203.3670533
Cho ASaxena AQureshi MDaglis A(2024)CoAXIAL: A CXL-Centric Memory System for Scalable ServersSC24: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41406.2024.00101(1-15)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SC41406.2024.00101
Huang JLou JVanavasam SKong XJi HJeong IZhuo DLee EKim N(2024)HAL: Hardware-assisted Load Balancing for Energy-efficient SNIC-Host Cooperative Computing2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00051(613-627)Online publication date: 29-Jun-2024
https://doi.org/10.1109/ISCA59077.2024.00051
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents