research-article

SAP HANA adoption of non-volatile memory

Authors:

Christian Lemke,

Günter Radestock,

Robert Schulze,

Rolando Blanco,

Akanksha Meghlan,

Muhammad Sharique,

Sebastian Seifert,

Surendra Vishnoi,

Werner Thesing,

Thomas WillhalmAuthors Info & Claims

Proceedings of the VLDB Endowment, Volume 10, Issue 12

Pages 1754 - 1765

https://doi.org/10.14778/3137765.3137780

Published: 01 August 2017 Publication History

Abstract

Non-Volatile RAM (NVRAM) is a novel class of hardware technology which is an interesting blend of two storage paradigms: byte-addressable DRAM and block-addressable storage (e.g. HDD/SSD). Most of the existing enterprise relational data management systems such as SAP HANA have their internal architecture based on the inherent assumption that memory is volatile and base their persistence on explicit handling of block-oriented storage devices. In this paper, we present the early adoption of Non-Volatile Memory within the SAP HANA Database, from the architectural and technical angles. We discuss our architectural choices, dive deeper into a few challenges of the NVRAM integration and their solutions, and share our experimental results. As we present our solutions for the NVRAM integration, we also give, as a basis, a detailed description of the relevant HANA internals.

References

[1]

Apalkov, D. et al. Spin-transfer torque magnetic random access memory (stt-mram). ACM J. Emerg. Technol. Comput. Syst., 9(2), 2013.

Digital Library

[2]

Arulraj, J., Pavlo, A., and Dulloor, S. R. Let's talk about storage & recovery methods for non-volatile memory database systems. In SIGMOD (2015), ACM, pp. 707--722.

Digital Library

[3]

Burr, G. W. et al. Phase change memory technology. Journal of Vacuum Science & Technology B, 28(2), 2010.

[4]

Dulloor, S. et al. System software for persistent memory. In EuroSys (2014).

Digital Library

[5]

Färber, Franz et al.: The SAP HANA Database - An Architecture Overview. IEEE Data Engineering Bulletin, Volume 35, Number 1, March 2012. 28--33.

[6]

Intel's NVML library http://pmem.io/nvml/

[7]

Intel and Micron Produce Breakthrough Memory Technology (3D XPoint). https://newsroom.intel.com/news-releases/intel-and-micron-produce-breakthrough-memory-technology/

[8]

Kemper, Alfons and Neumann, Thomas. HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots. ICDE 2011: 195--206

Digital Library

[9]

Kimura, H. FOEDUS: OLTP engine for a thousand cores and NVRAM. In SIGMOD (2015), ACM, pp. 691--706.

Digital Library

[10]

Krueger, Jens et al. 2011. Fast updates on read-optimized databases using multi-core CPUs. Proc. VLDB Endow. 5, 1 (September 2011), 61--72.

Digital Library

[11]

Linux DAX https://www.kernel.org/doc/Documentation/filesystems/dax.txt

[12]

Number of nines availability of systems http://tanejagroup.com/files/Compellent_TG_Opinion_5_Nines_Sept_20121.pdf

[13]

Oukid, Ismail et al.: Instant Recovery for Main Memory Databases. CIDR 2015

[14]

Oukid, Ismail et al.: On testing persistent-memory-based software. DaMoN 2016: 5:1--5:7

Digital Library

[15]

Oukid, Ismail et al.: FPTree: A Hybrid SCM-DRAM Persistent and Concurrent B-Tree for Storage Class Memory. SIGMOD Conference 2016: 371--386

Digital Library

[16]

Oukid, Ismail and Lehner, Wolfgang: Towards a Single-Level Database Architecture on Non-Volatile Main Memory. To be published

[17]

Pelley, S. et al. Storage management in the NVRAM era. PVLDB 7, 2 (2013), 121--132.

Digital Library

[18]

SNIA NVM Programming Model V1.1. Technical report, 2015. http://www.snia.org/sites/default/files/NVMProgrammingModel_v1.1.pdf.

[19]

Yang, J. J. and Williams, R. S. Memristive devices in computing system: Promises and challenges. ACM J. Emerg. Technol. Comput. Syst., 9(2), 2013.

Digital Library

Cited By

Ahn MWillhalm TMay NLee DDesai SBooss DKim JSingh NRitter DRebholz O(2024)An Examination of CXL Memory Use Cases for In-Memory Database Management Systems Using SAP HANAProceedings of the VLDB Endowment10.14778/3685800.368580917:12(3827-3840)Online publication date: 8-Nov-2024
https://doi.org/10.14778/3685800.3685809
Ren JXu DRyu JShin KKim DLi D(2024)MTM: Rethinking Memory Profiling and Migration for Multi-Tiered Large MemoryProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3650075(803-817)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3650075
Koutsoukos DBhartia RFriedman MKlimovic AAlonso G(2023)NVM: Is it Not Very Meaningful for Databases?Proceedings of the VLDB Endowment10.14778/3603581.360358616:10(2444-2457)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.14778/3603581.3603586
Show More Cited By

SAP HANA adoption of non-volatile memory
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

Redesign the Memory Allocator for Non-Volatile Main Memory
Special Issue on Hardware and Algorithms for Learning On-a-chip and Special Issue on Alternative Computing Systems

The non-volatile memory (NVM) has the merits of byte-addressability, fast speed, persistency and low power consumption, which make it attractive to be used as main memory. Commonly, user process dynamically acquires memory through memory allocators. ...
File-Based Memory Management for Non-volatile Main Memory
COMPSAC '13: Proceedings of the 2013 IEEE 37th Annual Computer Software and Applications Conference

Active research and development efforts on byte addressable non-volatile (NV) memory technologies, such as STT-RAM, PCM, and ReRAM, have been conducted in recent years. Because they are byte addressable, they can be used as main memory by directly ...
Managing Non-Volatile Memory in Database Systems
SIGMOD '18: Proceedings of the 2018 International Conference on Management of Data

Non-volatile memory (NVM) is a new storage technology that combines the performance and byte addressability of DRAM with the persistence of traditional storage devices like flash (SSD). While these properties make NVM highly promising, it is not yet ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment

Proceedings of the VLDB Endowment Volume 10, Issue 12

August 2017

427 pages

ISSN:2150-8097

Editors:
Peter Boncz
CWI
,
Ken Salem
University of Waterloo

Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 August 2017

Published in PVLDB Volume 10, Issue 12

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
459
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)4

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ahn MWillhalm TMay NLee DDesai SBooss DKim JSingh NRitter DRebholz O(2024)An Examination of CXL Memory Use Cases for In-Memory Database Management Systems Using SAP HANAProceedings of the VLDB Endowment10.14778/3685800.368580917:12(3827-3840)Online publication date: 8-Nov-2024
https://doi.org/10.14778/3685800.3685809
Ren JXu DRyu JShin KKim DLi D(2024)MTM: Rethinking Memory Profiling and Migration for Multi-Tiered Large MemoryProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3650075(803-817)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3650075
Koutsoukos DBhartia RFriedman MKlimovic AAlonso G(2023)NVM: Is it Not Very Meaningful for Databases?Proceedings of the VLDB Endowment10.14778/3603581.360358616:10(2444-2457)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.14778/3603581.3603586
Banakar VWu KPatel YKeeton KArpaci-Dusseau AArpaci-Dusseau R(2023)WiscSort: External Sorting for Byte-Addressable StorageProceedings of the VLDB Endowment10.14778/3598581.359858516:9(2103-2116)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.14778/3598581.3598585
Lee DWillhalm TAhn MMutalik Desai SBooss DSingh NRitter DKim JRebholz O(2023)Elastic Use of Far Memory for In-Memory Database Management SystemsProceedings of the 19th International Workshop on Data Management on New Hardware10.1145/3592980.3595311(35-43)Online publication date: 18-Jun-2023
https://dl.acm.org/doi/10.1145/3592980.3595311
Ruan CZhang YBi CMa XChen HLi FYang XLi CAboulnaga AXu YAamodt TJerger NSwift M(2023)Persistent Memory Disaggregation for Cloud-Native Relational DatabasesProceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3582016.3582055(498-512)Online publication date: 25-Mar-2023
https://dl.acm.org/doi/10.1145/3582016.3582055
Chiosa MMaschi FMüller IAlonso GMay N(2022)Hardware acceleration of compression and encryption in SAP HANAProceedings of the VLDB Endowment10.14778/3554821.355482215:12(3277-3291)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.14778/3554821.3554822
Lasch RLegler TMay NScheirle BSattler K(2022)Cost modelling for optimal data placement in heterogeneous main memoryProceedings of the VLDB Endowment10.14778/3551793.355183715:11(2867-2880)Online publication date: 29-Sep-2022
https://dl.acm.org/doi/10.14778/3551793.3551837
Ahn MChang ALee DGim JKim JJung JRebholz OPham VMalladi KKi Y(2022)Enabling CXL Memory Expansion for In-Memory Database Management SystemsProceedings of the 18th International Workshop on Data Management on New Hardware10.1145/3533737.3535090(1-5)Online publication date: 12-Jun-2022
https://dl.acm.org/doi/10.1145/3533737.3535090
Choi WPark S(2022)A write-friendly approach to manage namespace of Hadoop distributed file system by utilizing nonvolatile memoryThe Journal of Supercomputing10.1007/s11227-019-02876-975:10(6632-6662)Online publication date: 11-Mar-2022
https://dl.acm.org/doi/10.1007/s11227-019-02876-9
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents