research-article

Accelerating RocksDB for small-zone ZNS SSDs by parallel I/O mechanism

Authors:

Heonyoung YeomAuthors Info & Claims

Middleware Industrial Track '22: Proceedings of the 23rd International Middleware Conference Industrial Track

Pages 15 - 21

https://doi.org/10.1145/3564695.3564774

Published: 22 November 2022 Publication History

Abstract

Zoned Namespace (ZNS) is a novel storage interface that offers logical zones aligned to a physical media (e.g., NAND flash) to the host system. Due to the out-of-place updating scheme of the physical media, a log-structured merged-tree (LSM-Tree)-based key-value store, such as RocksDB, fits well with the append-only constraint of ZNS SSDs. Even though ZenFS, which is a file system plugin of RocksDB, shows a decent throughput with a large-zone ZNS SSD, the performance with a small-zone ZNS SSD is disappointing because the small-sized zone has no room to exploit the internal parallelism. In this paper, we propose two parallel I/O mechanisms to exploit the external parallelism by distributing I/O data to multiple zones in parallel. The proposed I/O mechanisms are applied to ZenFS according to the characteristic of LSM-tree levels. In addition, a dynamic zone management policy is proposed to maximize the space utilization by placing the data chunks with similar lifetime to the same zone so that the files placed in one zone are deleted at around the same time. This enables the zones to be reused without garbage collection. The proposed methods are evaluated with various workloads in db_bench benchmarking tool (i.e., fillrandom, fillseq, readseq, overwrite) in RocksDB. Experimental results show that the proposed method achieves outstanding improvements compared to the conventional ZenFS. It shows 7.5× for the I/O performance in average while keeping nearly the same degree of spatial efficiency.

References

[1]

Nvm express - scalable, efficient, and industry standard, 2022. https://nvmexpress.org/, Accessed on 2022-04-15.

[2]

Zoned namespace command set specification - nvm express, 2021. https://nvmexpress.org/wp-content/uploads/NVM-Express-Zoned-Namespace-Command-Set-Specification-1.1-2021.06.02-Ratified-1.pdf, Accessed on 2022-04-15.

[3]

Matias Bjørling, Abutalib Aghayev, Hans Holmberg, Aravind Ramesh, Damien Le Moal, Gregory R Ganger, and George Amvrosiadis. {ZNS}: Avoiding the block interface tax for flash-based {SSDs}. In 2021 USENIX Annual Technical Conference (USENIX ATC 21), pages 689--703, 2021.

[4]

Aayush Gupta, Youngjae Kim, and Bhuvan Urgaonkar. Dftl: a flash translation layer employing demand-based selective caching of page-level address mappings. Acm Sigplan Notices, 44(3):229--240, 2009.

Digital Library

[5]

Theano Stavrinos, Daniel S Berger, Ethan Katz-Bassett, and Wyatt Lloyd. Don't be a blockhead: zoned namespaces make work on conventional ssds obsolete. In Proceedings of the Workshop on Hot Topics in Operating Systems, pages 144--151, 2021.

Digital Library

[6]

Hojin Shin, Myounghoon Oh, Gunhee Choi, and Jongmoo Choi. Exploring performance characteristics of zns ssds: Observation and implication. In 2020 9th Non-Volatile Memory Systems and Applications Symposium (NVMSA), pages 1--5. IEEE, 2020.

[7]

Samsung introduces its first zns ssd with maximized user capacity and enhanced lifespan, 2021. https://news.samsung.com/global/samsung-introduces-its-first-zns-ssd-with-maximized-user-capacity-and-enhanced-lifespan, Accessed on 2022-04-15.

[8]

Rocksdb, 2021. https://rocksdb.org/, Accessed on 2022-04-15.

[9]

Siying Dong, Andrew Kryczka, Yanqin Jin, and Michael Stumm. Rocksdb: Evolution of development priorities in a key-value store serving large-scale applications. ACM Transactions on Storage (TOS), 17(4):1--32, 2021.

[10]

Zhichao Cao, Siying Dong, Sagar Vemuri, and David HC Du. Characterizing, modeling, and benchmarking {RocksDB} {Key-Value} workloads at facebook. In 18th USENIX Conference on File and Storage Technologies (FAST 20), pages 209--223, 2020.

[11]

Patrick O'Neil, Edward Cheng, Dieter Gawlick, and Elizabeth O'Neil. The log-structured merge-tree (lsm-tree). Acta Informatica, 33(4):351--385, 1996.

Digital Library

[12]

Gijun Oh, Junseok Yang, and Sungyong Ahn. Efficient key-value data placement for zns ssd. Applied Sciences, 11(24):11842, 2021.

[13]

Zenfs: Rocksdb storage backend for zns ssds and smr hdds, 2021. https://github.com/westerndigitalcorporation/zenfs, Accessed on 2022-04-15.

[14]

Hans Holmberg. Zenfs, zones and rocksdb, 2020. https://snia.org/sites/default/files/SDC/2020/074-Holmberg-ZenFS-Zones-and-RocksDB.pdf, Accessed on 2022-04-15.

[15]

Zoned storage, 2022. https://zonedstorage.io/, Accessed on 2022-04-15.

[16]

Kyuhwa Han, Hyunho Gwak, Dongkun Shin, and Jooyoung Hwang. Zns+: Advanced zoned namespace interface for supporting in-storage zone compaction. In 15th {USENIX} Symposium on Operating Systems Design and Implementation ({OSDI} 21), pages 147--162, 2021.

[17]

Devashish R Purandare, Peter Wilcox, Heiner Litz, and Shel Finkelstein. Append is near: Log-based data management on zns ssds. In 12th Annual Conference on Innovative Data Systems Research (CIDR'22)., 2022.

[18]

Matias Bjørling. From open-channel ssds to zoned namespaces. In Linux Storage and Filesystems Conference (Vault 19), volume 1, 2019.

[19]

Matias Bjørling. Zone append: A new way of writing to zoned storage. Santa Clara, CA, February. USENIX Association.[Cited on page.], 2020.

[20]

Hans Holmberg. Accelerating rocksdb with nvme zoned ssds, 2019. https://www.snia.org/sites/default/files/SDC/2019/presentations/NVMe/Holmberg_Hans_Accelerating_RocksDB_with_Zoned_Namespaces.pdf, Accessed on 2022-04-15.

[21]

Javier Gonzalez. Zoned namespaces: Standardization and linux ecosystem, 2020. https://www.snia.org/educational-library/zoned-namespaces-standardization-and-linux-ecosystem%C2%A0-2020, Accessed on 2022-04-15.

[22]

Bob Varney. Radian's zns ssd with rocksdb, zenfs, and gzbd-viewer, 2020. https://www.radianmemory.com/wp-content/uploads/2020/09/Radian-Rocksdb-ZenFS-Demo-v2.1b.pdf, Accessed on 2022-04-15.

[23]

Chun Liu. Beyond zoned namespace - what do applications want?, 2021. https://www.snia.org/educational-library/beyond-zoned-namespace-what-do-applications-want-2021, Accessed on 2022-04-15.

[24]

Adam Manzanares Joel Granados, Jesper Devantier. Flexalloc a lightweight building block for user space data management, 2021. https://www.snia.org/sites/default/files/SDC/2021/pdfs/SNIA-SDC21-Devantier-Granados-Manzanares-FlexAlloc-a-lightweight-building-block-for-user-space-data.pdf, Accessed on 2022-04-15.

[25]

Gunhee Choi, Kwanghee Lee, Myunghoon Oh, Jongmoo Choi, Jhuyeong Jhin, and Yongseok Oh. A new {LSM-style} garbage collection scheme for {ZNS} {SSDs}. In 12th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 20), 2020.

[26]

Hanyeoreum Bae, Jiseon Kim, Miryeong Kwon, and Myoungsoo Jung. What you can't forget: exploiting parallelism for zoned namespaces. In Proceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems, pages 79--85, 2022.

Digital Library

Cited By

Yi SSun SPeng LSun YYang MCao ZLi QJung MZhou KZhang JWitchel EArpaci-Dusseau ARossbach CKeeton K(2024)BIZA: Design of Self-Governing Block-Interface ZNS AFA for Endurance and PerformanceProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695953(313-329)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3694715.3695953
Choi JJun YKim JJeong JSeo E(2024)An Adaptive Zone-Grouping Scheme Enabling General-Purpose File Systems on ZNS SSDsProceedings of the 17th ACM International Systems and Storage Conference10.1145/3688351.3689151(132-145)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3688351.3689151
Min JZhao CLiu MKrishnamurthy A(2024)eZNS: Elastic Zoned Namespace for Enhanced Performance Isolation and Device UtilizationACM Transactions on Storage10.1145/365371620:3(1-41)Online publication date: 6-Jun-2024
https://dl.acm.org/doi/10.1145/3653716
Show More Cited By

Index Terms

Accelerating RocksDB for small-zone ZNS SSDs by parallel I/O mechanism
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Parallel and distributed DBMSs
        Key-value stores
  2. Information storage systems
    1. Storage management

Recommendations

Lifetime-leveling LSM-tree compaction for ZNS SSD
HotStorage '22: Proceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems

The Log-Structured Merge (LSM) tree is considered well-suited to zoned namespace (ZNS) storage devices since the write requests to LSM-tree is sequential. However, zones can be partially invalidated and be fragmented during LSM-tree compaction. The ...
ConfZNS : A Novel Emulator for Exploring Design Space of ZNS SSDs
SYSTOR '23: Proceedings of the 16th ACM International Conference on Systems and Storage

The ZNS (Zoned NameSpace) interface shifts much of the storage maintenance responsibility to the host from the underlying SSDs (Solid-State Drives). In addition, it opens a new opportunity to exploit the internal parallelism of SSDs at both hardware ...
An Adaptive Zone-Grouping Scheme Enabling General-Purpose File Systems on ZNS SSDs
SYSTOR '24: Proceedings of the 17th ACM International Systems and Storage Conference

Zoned namespace solid state drives (ZNS SSDs) provide superior capacity and life span compared to conventional namespace (CNS) SSDs at the same cost. Especially, a small-zone ZNS SSD can achieve a low write amplification factor (WAF) and performance ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Middleware Industrial Track '22: Proceedings of the 23rd International Middleware Conference Industrial Track

November 2022

61 pages

ISBN:9781450399173

DOI:10.1145/3564695

General Chairs:
Kaiwen Zhang
ETS
,
Abdelouahed Gherbi
ETS
,
Paolo Bellavista
University of Bologna, Italy

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery

In-Cooperation

USENIX Assoc: USENIX Assoc
IFIP

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Samsung
National Research Foundation of Korea(NRF)

Conference

Middleware '22

Sponsor:

ACM

Middleware '22: 23rd International Middleware Conference

November 7 - 11, 2022

Quebec City, Quebec, Canada

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
1,116
Total Downloads

Downloads (Last 12 months)361
Downloads (Last 6 weeks)35

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yi SSun SPeng LSun YYang MCao ZLi QJung MZhou KZhang JWitchel EArpaci-Dusseau ARossbach CKeeton K(2024)BIZA: Design of Self-Governing Block-Interface ZNS AFA for Endurance and PerformanceProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695953(313-329)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3694715.3695953
Choi JJun YKim JJeong JSeo E(2024)An Adaptive Zone-Grouping Scheme Enabling General-Purpose File Systems on ZNS SSDsProceedings of the 17th ACM International Systems and Storage Conference10.1145/3688351.3689151(132-145)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3688351.3689151
Min JZhao CLiu MKrishnamurthy A(2024)eZNS: Elastic Zoned Namespace for Enhanced Performance Isolation and Device UtilizationACM Transactions on Storage10.1145/365371620:3(1-41)Online publication date: 6-Jun-2024
https://dl.acm.org/doi/10.1145/3653716
Hwangbo HRo JByeon SJamil SHan JHwang JKim Y(2024)Towards A Unified Garbage Collection Strategy in ZNS Key-Value Store File Systems Using Same-Victim GC2024 32nd International Conference on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS)10.1109/MASCOTS64422.2024.10786550(1-8)Online publication date: 21-Oct-2024
https://doi.org/10.1109/MASCOTS64422.2024.10786550
Jung SChung E(2024)ZTBP:eBPF-Driven Analysis for Improved Random Read Performance in ZNS Devices via DB Clustering2024 International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC)10.1109/ITC-CSCC62988.2024.10628420(1-6)Online publication date: 2-Jul-2024
https://doi.org/10.1109/ITC-CSCC62988.2024.10628420
Jamil SRo JHwang JKim Y(2024)Efficient Data Placement in Deduplication Enabled ZenFS via CRC-Based PredictionIEEE Access10.1109/ACCESS.2024.352018412(197233-197246)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3520184
Kim DKim JChoi KHan HRyu MKang S(2024)Dynamic zone redistribution for key-value stores on zoned namespaces SSDsJournal of Systems Architecture10.1016/j.sysarc.2024.103159152(103159)Online publication date: Jul-2024
https://doi.org/10.1016/j.sysarc.2024.103159
Lee JKim DLee J(2023)WALTZ: Leveraging Zone Append to Tighten the Tail Latency of LSM Tree on ZNS SSDProceedings of the VLDB Endowment10.14778/3611479.361149516:11(2884-2896)Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.14778/3611479.3611495
Long LHe SShen JLiu RTan ZGao CLiu DZhong KJiang Y(2023)WA-Zone: Wear-Aware Zone Management Optimization for LSM-Tree on ZNS SSDsACM Transactions on Architecture and Code Optimization10.1145/363748821:1(1-23)Online publication date: 13-Dec-2023
https://dl.acm.org/doi/10.1145/3637488
Wang ZYin S(2023)RBC: A bandwidth controller to reduce write-stalls and tail latencyProceedings of the 52nd International Conference on Parallel Processing10.1145/3605573.3605601(213-222)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3605573.3605601
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents