research-article

Open access

Zerializer: towards zero-copy serialization

Authors:

Adam Wolnikowski,

Stephen Ibanez,

Jonathan Stone,

Robert SouléAuthors Info & Claims

HotOS '21: Proceedings of the Workshop on Hot Topics in Operating Systems

Pages 206 - 212

https://doi.org/10.1145/3458336.3465283

Published: 03 June 2021 Publication History

Abstract

Achieving zero-copy I/O has long been an important goal in the networking community. However, data serialization obviates the benefits of zero-copy I/O, because it requires the CPU to read, transform, and write message data, resulting in additional memory copies between the real object instances and the contiguous socket buffer. Therefore, we argue for offloading serialization logic to the DMA path via specialized hardware. We propose an initial hardware design for such an accelerator, and give preliminary evidence of its feasibility and expected benefits.

References

[1]

Apache Kafka 2021. Apache Kafka. https://kafka.apache.org.

[2]

Apache Thrift 2021. Apache Thrift. https://thrift.apache.org.

[3]

Mina Tahmasbi Arashloo, Alexey Lavrov, Manya Ghobadi, Jennifer Rexford, David Walker, and David Wentzlaff. 2020. Enabling Programmable Transport Protocols in High-Speed NICs. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

[4]

Krste Asanović, Rimas Avizienis, Jonathan Bachrach, Scott Beamer, David Biancolin, Christopher Celio, Henry Cook, Daniel Dabbelt, John Hauser, Adam Izraelevitz, Sagar Karandikar, Ben Keller, Donggyu Kim, John Koenig, Yunsup Lee, Eric Love, Martin Maas, Albert Magyar, Howard Mao, Miquel Moreto, Albert Ou, David A. Patterson, Brian Richards, Colin Schmidt, Stephen Twigg, Huy Vo, and Andrew Waterman. 2016. The Rocket Chip Generator. Technical Report UCB/EECS-2016-17. EECS Department, University of California, Berkeley.

[5]

Brian N. Bershad, Thomas E. Anderson, Edward D. Lazowska, and Henry M. Levy. 1990. Lightweight Remote Procedure Call. ACM Transactions on Computer Systems (TOCS) 8, 1 (1990), 37--55.

Digital Library

[6]

Cap'n proto 2021. Cap'nproto. https://capnproto.org.

[7]

Aleksandar Dragojević, Dushyanth Narayanan, Miguel Castro, and Orion Hodson. 2014. FaRM: Fast Remote Memory. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[8]

Daniel Firestone, Andrew Putnam, Sambhrama Mundkur, Derek Chiou, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Adrian Caulfield, Eric Chung, Harish Kumar Chandrappa, Somesh Chaturmohta, Matt Humphrey, Jack Lavier, Norman Lam, Fengfen Liu, Kalin Ovtcharov, Jitu Padhye, Gautham Popuri, Shachar Raindel, Tejas Sapre, Mark Shaw, Gabriel Silva, Madhan Sivakumar, Nisheeth Srivastava, Anshuman Verma, Qasim Zuhair, Deepak Bansal, Doug Burger, Kushagra Vaid, David A. Maltz, and Albert Greenberg. 2018. Azure Accelerated Networking: SmartNICs in the Public Cloud. In USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[9]

FlatBuffers 2021. FlatBuffers. https://google.github.io/flatbuffers/.

[10]

Alex Forencich, Alex C. Snoeren, George Porter, and George Papen. 2020. Corundum: An Open-Source 100-Gbps NIC. In 28th IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM). IEEE, 38--46.

[11]

Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, David Mazières, and Nick McKeown. 2014. I Know What Your Packet Did Last Hop: Using Packet Histories to Troubleshoot Networks. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[12]

Stephen Ibanez, Muhammad Shahbaz, and Nick McKeown. 2019. The Case for a Network Fast Path to the CPU. In 17th Workshop on Hot Topics in Operating Systems (HotOS).

Digital Library

[13]

Interface Serializable 2021. Interface Serializable. https://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html.

[14]

Jaeyoung Jang, Sung Jun Jung, Sunmin Jeong, Jun Heo, Hoon Shin, Tae Jun Ham, and Jae W. Lee. 2020. A Specialized Architecture for Object Serialization with Applications to Big Data Analytics. In 47th International Symposium on Computer Architecture (ISCA).

Digital Library

[15]

Anuj Kalia, Michael Kaminsky, and David Andersen. 2019. Datacenter RPCs can be General and Fast. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[16]

Svilen Kanev, Juan Pablo Darago, Kim Hazelwood, Parthasarathy Ranganathan, Tipp Moseley, Gu-Yeon Wei, and David Brooks. 2015. Profiling a Warehouse-Scale Computer. In 42nd International Symposium on Computer Architecture (ISCA).

Digital Library

[17]

Svilen Kanev, Sam Likun Xi, Gu-Yeon Wei, and David Brooks. 2017. Mallacc: Accelerating Memory Allocation. Notices of the ACM Special Interest Group on Programming Languages (SIGPLAN Notices) 52, 4 (2017), 33--45.

Digital Library

[18]

Sagar Karandikar, Howard Mao, Donggyu Kim, David Biancolin, Alon Amid, Dayeol Lee, Nathan Pemberton, Emmanuel Amaro, Colin Schmidt, Aditya Chopra, et al. 2018. FireSim: FPGA-Accelerated Cycle-Exact Scale-Out System Simulation in the Public Cloud. In 45th International Symposium on Computer Architecture (ISCA).

Digital Library

[19]

Antoine Kaufmann, Simon Peter, Naveen Kr Sharma, Thomas Anderson, and Arvind Krishnamurthy. 2016. High Performance Packet Processing with Flex NIC. In 21st ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[20]

Yanfang Le, Hyunseok Chang, Sarit Mukherjee, Limin Wang, Aditya Akella, Michael M Swift, and TV Lakshman. 2017. UNO: Unifying Host and Smart NIC Offload for Flexible Packet Processing. In 8th ACM Symposium on Cloud Computing (SOCC).

Digital Library

[21]

Bojie Li, Kun Tan, Layong Luo, Yanqing Peng, Renqian Luo, Ningyi Xu, Yongqiang Xiong, Peng Cheng, and Enhong Chen. 2016. ClickNP: Highly Flexible and High Performance Network Processing with Re-configurable Hardware. In ACM Annual Conference of the Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM).

Digital Library

[22]

librdkafka 2021. librdkafka. https://github.com/edenhill/librdkafka.

[23]

Ming Liu, Tianyi Cui, Henry Schuh, Arvind Krishnamurthy, Simon Peter, and Karan Gupta. 2019. Offloading Distributed Applications onto SmartNICs Using IPipe. In ACM Annual Conference of the Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM).

Digital Library

[24]

Jeffrey C. Mogul. 2003. TCP Offload is a Dumb Idea Whose Time Has Come. In 9th Workshop on Hot Topics in Operating Systems (HotOS).

Digital Library

[25]

Performance Application Programming Interface 2021. Performance Application Programming Interface. https://icl.utk.edu/papi/.

[26]

Phitchaya Mangpo Phothilimthana, Ming Liu, Antoine Kaufmann, Simon Peter, Rastislav Bodik, and Thomas Anderson. 2018. Floem: A Programming System for NIC-Accelerated Network Applications. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI).

Digital Library

[27]

Salvatore Pontarelli, Roberto Bifulco, Marco Bonola, Carmelo Cascone, Marco Spaziani, Valerio Bruschi, Davide Sanvito, Giuseppe Siracusano, Antonio Capone, Michio Honda, Felipe Huici, and Giuseppe Bianchi. 2019. Flowblaze: Stateful Packet Processing in Hardware. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[28]

Arash Pourhabibi, Siddharth Gupta, Hussein Kassir, Mark Sutherland, Zilu Tian, Mario Paulo Drumond, Babak Falsafi, and Christoph Koch. 2020. Optimus Prime: Accelerating Data Transformation in Servers. In 25th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[29]

Protocol Buffers 2021. Protocol Buffers. https://developers.google.com/protocol-buffers.

[30]

Protocol Buffers Encoding 2021. Protocol Buffers Encoding. https://developers.google.com/protocol-buffers/docs/encoding.

[31]

Deepti Raghavan, Philip Levis, Matei Zaharia, and Irene Zhang. 2021. Breakfast of Champions: Efficient Datacenter Serialization. In 18th Workshop on Hot Topics in Operating Systems (HotOS).

[32]

Brent Stephens, Aditya Akella, and Michael M Swift. 2018. Your Programmable NIC Should be a Programmable Switch. In 17th Workshop on Hot Topics in Networks (HotNets).

Digital Library

[33]

Maomeng Su, Mingxing Zhang, Kang Chen, Zhenyu Guo, and Yongwei Wu. 2017. RFP: When RPC is Faster than Server-Bypass with RDMA. In 12th European Conference on Computer Systems (EuroSys).

Digital Library

[34]

George Varghese. 2010. Network Algorithmics (2nd ed.). Chapman & Hall/CRC.

[35]

Kaiyuan Zhang, Danyang Zhuo, and Arvind Krishnamurthy. 2020. Gallium: Automated Software Middlebox Offloading to Programmable Switches. In ACM Annual Conference of the Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM).

Digital Library

[36]

S. Zhang, H. Angepat, and D. Chiou. 2017. HGum: Messaging Framework for Hardware Accelerators. In International Conference on Re-ConFigurable Computing and FPGAs (ReConFig).

Digital Library

Cited By

Kolokasis IEvdorou GAkram SKozanitis CPapagiannis AZakkak FPratikakis PBilas A(2024)TeraHeap: Exploiting Flash Storage for Mitigating DRAM Pressure in Managed Big Data FrameworksACM Transactions on Programming Languages and Systems10.1145/370059346:4(1-37)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3700593
Alvaro PAdiletta MCheng DCockroft AHady FIllikkal RRamos ESoulé R(2024)NotNets: Accelerating Microservices by Bypassing the NetworkProceedings of the 15th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3678015.3680494(67-73)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1145/3678015.3680494
Ramos ESoulé RAlvaro PBressana PChen ECummings ULi RTsai JManohar R(2024)Split gRPC: An Isolation Architecture for RPC Software StacksProceedings of the 15th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3678015.3680484(81-87)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1145/3678015.3680484
Show More Cited By

Index Terms

Zerializer: towards zero-copy serialization
1. Hardware
  1. Communication hardware, interfaces and storage
2. Networks
  1. Network algorithms
    1. Data path algorithms
  2. Network protocols
    1. Application layer protocols

Recommendations

Accelerating Critical Section Execution with Asymmetric Multicore Architectures

Contention for critical sections can reduce performance and scalability by causing thread serialization. The proposed accelerated critical sections mechanism reduces this limitation. ACS executes critical sections on the high-performance core of an ...
Fastmove: A Comprehensive Study of On-Chip DMA and its Demonstration for Accelerating Data Movement in NVM-based Storage Systems
Data-intensive applications executing on NVM-based storage systems experience serious bottlenecks when moving data between DRAM and NVM. We advocate for the use of the long-existing but recently neglected on-chip DMA to expedite data movement with three ...
Memory streaming acceleration for embedded systems with CPU-accelerator cooperative data processing
Abstract
Memory streaming operations (i.e., memory-to-memory data transfer with or without simple arithmetic/logical operations) are one of the most important tasks in general embedded/mobile computer systems. In this paper, we propose a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotOS '21: Proceedings of the Workshop on Hot Topics in Operating Systems

June 2021

251 pages

ISBN:9781450384384

DOI:10.1145/3458336

General Chair:
Sebastian Angel
University of Pennsylvania
,
Program Chairs:
Baris Kasikci
University of Michigan
,
Eddie Kohler
Harvard University

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

DARPA

Conference

HotOS '21

Sponsor:

SIGOPS

HotOS '21: Workshop on Hot Topics in Operating Systems

June 1 - 3, 2021

Michigan, Ann Arbor

Upcoming Conference

HOTOS '25

Sponsor:
sigops

Workshop on Hot Topics in Operating Systems

May 14 - 16, 2025

Banff or Lake Louise , AB , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
1,085
Total Downloads

Downloads (Last 12 months)260
Downloads (Last 6 weeks)31

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kolokasis IEvdorou GAkram SKozanitis CPapagiannis AZakkak FPratikakis PBilas A(2024)TeraHeap: Exploiting Flash Storage for Mitigating DRAM Pressure in Managed Big Data FrameworksACM Transactions on Programming Languages and Systems10.1145/370059346:4(1-37)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3700593
Alvaro PAdiletta MCheng DCockroft AHady FIllikkal RRamos ESoulé R(2024)NotNets: Accelerating Microservices by Bypassing the NetworkProceedings of the 15th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3678015.3680494(67-73)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1145/3678015.3680494
Ramos ESoulé RAlvaro PBressana PChen ECummings ULi RTsai JManohar R(2024)Split gRPC: An Isolation Architecture for RPC Software StacksProceedings of the 15th ACM SIGOPS Asia-Pacific Workshop on Systems10.1145/3678015.3680484(81-87)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1145/3678015.3680484
Qi SMonis LZeng ZWang IRamakrishnan K(2024)SPRIGHT: High-Performance eBPF-Based Event-Driven, Shared-Memory Processing for Serverless ComputingIEEE/ACM Transactions on Networking10.1109/TNET.2024.336656132:3(2539-2554)Online publication date: Jun-2024
https://doi.org/10.1109/TNET.2024.3366561
Frantz RGarcía JCopik MMonroy IOlmos JBloch GDi Girolamo S(2024)Protocol Buffer Deserialization DPU Offloading in the RPC DatapathSC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SCW63240.2024.00126(886-895)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SCW63240.2024.00126
Kamath APeter S(2024) (MC) 2 : Lazy MemCopy at the Memory Controller 2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00084(1112-1128)Online publication date: 29-Jun-2024
https://doi.org/10.1109/ISCA59077.2024.00084
Jackson SCummings NKhan S(2024)Streaming Technologies and Serialization Protocols: Empirical Performance AnalysisIEEE Access10.1109/ACCESS.2024.348605412(158025-158039)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3486054
Seemakhupt KStephens BKhan SLiu SWassel HYeganeh SSnoeren AKrishnamurthy ACuller DLevy HDruschel PKaufmann AMace JFlinn JSeltzer M(2023)A Cloud-Scale Characterization of Remote Procedure CallsProceedings of the 29th Symposium on Operating Systems Principles10.1145/3600006.3613156(498-514)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3600006.3613156
Kumar ASivasubramaniam AZhu T(2023)SplitRPC: A {Control + Data} Path Splitting RPC Stack for ML Inference ServingProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/35899747:2(1-26)Online publication date: 22-May-2023
https://dl.acm.org/doi/10.1145/3589974
Krakowski FRuhland FSchöttner M(2023)High-Performance Object Serialization based on Ahead-of-Time Schema Generation2023 IEEE 22nd International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)10.1109/TrustCom60117.2023.00335(2378-2385)Online publication date: 1-Nov-2023
https://doi.org/10.1109/TrustCom60117.2023.00335
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten