extended-abstract

Public Access

Exploiting content similarity to address cold start in container deployments

Authors:

Dan RubensteinAuthors Info & Claims

CoNEXT '19 Companion: Proceedings of the 15th International Conference on emerging Networking EXperiments and Technologies

Pages 37 - 39

https://doi.org/10.1145/3360468.3366781

Published: 09 December 2019 Publication History

Abstract

Serverless computing is an emerging Cloud paradigm that allows users to claim and pay for resources only when their jobs are executing. While this paradigm offers several advantages, the phenomenon of "cold start" reduces its inherent efficiency with respect to the utilization of compute, storage and network resources that support its existing virtualization deployment systems. We analyze current modes of deployment and identify data similarities across applications. Based on these observations, we propose a new deployment system that is built atop a peer-to-peer network, virtual file-system and content-addressable storage, which will increase compute availability, reduce storage requirement, and prevent network bottlenecks.

References

[1]

2017. Apache Openwhisk: https://github.com/apache/incubator-openwhisk. (2017). https://github.com/apache/incubator-openwhisk

[2]

2019. Amazon S3. https://aws.amazon.com/s3/. (2019).

[3]

2019. Apache Spark. https://spark.apache.org/. (2019).

[4]

2019. AWS. https://aws.amazon.com. (2019).

[5]

2019. AWS Lambda. https://aws.amazon.com/lambda/. (2019).

[6]

2019. AWS Lambda Function Versioning and Aliases. https://docs.aws.amazon.com/lambda/latest/dg/versioning-aliases.html. (2019).

[7]

2019. Azure Functions. https://azure.microsoft.com/en-us/services/functions/. (2019).

[8]

2019. CISCO. https://www.cisco.com/. (2019).

[9]

2019. CRIU live migration. https://criu.org/Live_migration. (2019).

[10]

2019. Google Cloud Functions. https://cloud.google.com/functions/. (2019).

[11]

2019. Kubernetes-Engine: Scaling an application. https://cloud.google.com/kubernetes-engine/docs/how-to/scaling-apps. (2019).

[12]

2019. Pandas: Python Data Analysis Library. https://pandas.pydata.org/. (2019).

[13]

2019. PrestaShop. https://github.com/PrestaShop/docker. (2019).

[14]

2019. Python Package Index. https://pypi.org/. (2019).

[15]

2019. Rsync. https://linux.die.net/man/1/rsync. (2019).

[16]

2019. T2 micro instance. https://aws.amazon.com/ec2/instance-types/t2/. (2019).

[17]

The Kubernetes Authors. 2019. Kubernetes. https://kubernetes.io/. (2019).

[18]

Ioana Baldini, Paul Castro, Kerry Chang, Perry Cheng, Stephen Fink, Vatche Ishakian, Nick Mitchell, Vinod Muthusamy, Rodric Rabbah, Aleksander Slominski, and Philippe Suter. 2017. Serverless Computing: Current Trends and Open Problems.

[19]

Juan Benet. 2014. IPFS - Content Addressed, Versioned, P2P File System. CoRR (2014).

[20]

Renato Byrro. 2019. Can we solve serverless cold starts? https://dashbird.io/blog/can-we-solve-serverless-cold-starts/. (2019).

[21]

Cisco. 2018. CISCO white paper. https://www.cisco.com/c/en/us/solutions/collateral/service-provider/global-cloud-index-gci/white-paper-c11-738085.html. (2018).

[22]

Matt Crane and Jimmy Lin. 2017. An Exploration of Serverless Architectures for Information Retrieval. In ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR).

[23]

Scott Hendrickson, Stephen Sturdevant, Tyler Harter, Venkateshwaran Venkataramani, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. 2016. Serverless Computation with OpenLambda. In USENIX Workshop on Hot Topics in Cloud Computing.

[24]

Qingye Jiang, Young Choon Lee, and Albert Y. Zomaya. 2017. Serverless Execution of Scientific Workflows. In Service-Oriented Computing.

[25]

Eric Jonas, Shivaram Venkataraman, Ion Stoica, and Benjamin Recht. 2017. Occupy the Cloud: Distributed Computing for the 99%. In ACM Symposium on Cloud Computing (SoCC).

Digital Library

[26]

Kunal Mahajan, Daniel R Figueiredo, Vishal Misra, and Dan Rubenstein. In Press. Optimal Pricing for Serverless Computing. In IEEE Global Communications Conference (Globecom 2019).

[27]

G. McGrath and P. R. Brenner. 2017. Serverless Computing: Design, Implementation, and Performance. In IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW).

[28]

Ralph Merkle. 1987. A Digital Signature Based on a Conventional Encryption Function. LNCS.

[29]

Edward Oakes, Leon Yang, Dennis Zhou, Kevin Houck, Tyler Harter, Andrea Arpaci-Dusseau, and Remzi Arpaci-Dusseau. 2018. SOCK: Rapid Task Provisioning with Serverless-Optimized Containers. In USENIX Annual Technical Conference (ATC).

[30]

Qifan Pu, Shivaram Venkataraman, and Ion Stoica. 2019. Shuffling, Fast and Slow: Scalable Analytics on Serverless Infrastructure. In USENIX Symposium on Networked Systems Design and Implementation (NSDI).

[31]

Joshua Reich, Oren Laadan, Eli Brosh, Alex Sherman, Vishal Misra, Jason Nieh, and Dan Rubenstein. 2012. VMTorrent: scalable P2P virtual machine streaming. In CoNEXT.

[32]

Mikhail Shilkov. 2019. Cold Starts in AWS Lambda. https://mikhail.io/serverless/coldstarts/aws/. (2019).

[33]

Mengting Yan, Paul Castro, Perry Cheng, and Vatche Ishakian. 2016. Building a Chatbot with Serverless Computing. In ACM International Workshop on Mashups of Things and APIs (MOTA).

Digital Library

[34]

Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan. 2019. MArk: Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving. In USENIX Annual Technical Conference (ATC).

Cited By

Bauer AGonthier MPan HChard RGrzenda DStraesser MPauloski JKamatar ABaughman MHudson NFoster IChard K(2024)An Empirical Investigation of Container Building Strategies and Warm Times to Reduce Cold Starts in Scientific Computing Serverless Functions2024 IEEE 20th International Conference on e-Science (e-Science)10.1109/e-Science62913.2024.10678668(1-10)Online publication date: 16-Sep-2024
https://doi.org/10.1109/e-Science62913.2024.10678668
Zou WZhang ZWang NTan XTian L(2024)A Time-Saving Task Scheduling Algorithm Based on Deep Reinforcement Learning for Edge Cloud Collaborative Computing2024 IEEE 99th Vehicular Technology Conference (VTC2024-Spring)10.1109/VTC2024-Spring62846.2024.10683187(01-06)Online publication date: 24-Jun-2024
https://doi.org/10.1109/VTC2024-Spring62846.2024.10683187
Hu SQu ZTang BYe BLi GShi W(2024)Joint Service Request Scheduling and Container Retention in Serverless Edge Computing for Vehicle-Infrastructure CollaborationIEEE Transactions on Mobile Computing10.1109/TMC.2023.332352423:6(6508-6521)Online publication date: Jun-2024
https://doi.org/10.1109/TMC.2023.3323524
Show More Cited By

Index Terms

Exploiting content similarity to address cold start in container deployments

Recommendations

Minimizing Cold Start Times in Serverless Deployments
IC3-2022: Proceedings of the 2022 Fourteenth International Conference on Contemporary Computing

Serverless deployments of Cloud Applications involve containerizing an application that then remains dormant(cold) until a trigger event like a user visiting an endpoint occurs. The host machine then provisions this dormant container into a Virtual ...
Exploiting Neigborhood Similarity for Virtual Machine Migration over Wide-Area Network
SERE '13: Proceedings of the 2013 IEEE 7th International Conference on Software Security and Reliability

Conventional virtual machine (VM) migration focuses on transferring a VM's memory and CPU states across host machines. The VM's disk image has to remain accessible to both the source and destination host machines through shared storage during the ...
Towards Secure Cloud Orchestration for Multi-Cloud Deployments
CrossCloud'18: Proceedings of the 5th Workshop on CrossCloud Infrastructures & Platforms

Cloud orchestration frameworks are commonly used to deploy and operate cloud infrastructure. Their role spans both vertically (deployment on infrastructure, platform, application and microservice levels) and horizontally (deployments from many distinct ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '19 Companion: Proceedings of the 15th International Conference on emerging Networking EXperiments and Technologies

December 2019

93 pages

ISBN:9781450370066

DOI:10.1145/3360468

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 December 2019

Check for updates

Qualifiers

Extended-abstract
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

CoNEXT '19

Sponsor:

SIGCOMM

CoNEXT '19: The 15th International Conference on emerging Networking EXperiments and Technologies

December 9 - 12, 2019

FL, Orlando, USA

Acceptance Rates

CoNEXT '19 Companion Paper Acceptance Rate 34 of 52 submissions, 65%;

Overall Acceptance Rate 198 of 789 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
578
Total Downloads

Downloads (Last 12 months)109
Downloads (Last 6 weeks)13

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bauer AGonthier MPan HChard RGrzenda DStraesser MPauloski JKamatar ABaughman MHudson NFoster IChard K(2024)An Empirical Investigation of Container Building Strategies and Warm Times to Reduce Cold Starts in Scientific Computing Serverless Functions2024 IEEE 20th International Conference on e-Science (e-Science)10.1109/e-Science62913.2024.10678668(1-10)Online publication date: 16-Sep-2024
https://doi.org/10.1109/e-Science62913.2024.10678668
Zou WZhang ZWang NTan XTian L(2024)A Time-Saving Task Scheduling Algorithm Based on Deep Reinforcement Learning for Edge Cloud Collaborative Computing2024 IEEE 99th Vehicular Technology Conference (VTC2024-Spring)10.1109/VTC2024-Spring62846.2024.10683187(01-06)Online publication date: 24-Jun-2024
https://doi.org/10.1109/VTC2024-Spring62846.2024.10683187
Hu SQu ZTang BYe BLi GShi W(2024)Joint Service Request Scheduling and Container Retention in Serverless Edge Computing for Vehicle-Infrastructure CollaborationIEEE Transactions on Mobile Computing10.1109/TMC.2023.332352423:6(6508-6521)Online publication date: Jun-2024
https://doi.org/10.1109/TMC.2023.3323524
Nguyen KSimonovski FLoh FHoßfeld TThanh N(2024)Investigation of Container Network Function Deployment Costs in the Edge Cloud2024 27th Conference on Innovation in Clouds, Internet and Networks (ICIN)10.1109/ICIN60470.2024.10494438(9-16)Online publication date: 11-Mar-2024
https://doi.org/10.1109/ICIN60470.2024.10494438
Hu SShi WLi G(2023)CEC: A Containerized Edge Computing Framework for Dynamic Resource ProvisioningIEEE Transactions on Mobile Computing10.1109/TMC.2022.314780022:7(3840-3854)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TMC.2022.3147800
Gu LHuang JHuang SZeng DLi BJin H(2023)LOPO: An Out-of-order Layer Pulling Orchestration Strategy for Fast Microservice StartupIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10229072(1-9)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10229072
Hu SQu ZTang BYe B(2023)Joint Service Placement and Container Retention for Serverless-Based Vehicular Edge Computing2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS60453.2023.00307(2286-2294)Online publication date: 17-Dec-2023
https://doi.org/10.1109/ICPADS60453.2023.00307
Nguyen KLoh FNguyen TDoan DThanh NHoßfeld T(2023)Serverless Computing Lifecycle Model for Edge Cloud Deployments2023 IEEE International Conference on Communications Workshops (ICC Workshops)10.1109/ICCWorkshops57953.2023.10283589(145-150)Online publication date: 28-May-2023
https://doi.org/10.1109/ICCWorkshops57953.2023.10283589
Mahajan KDesai R(2022)Serving distributed inference deep learning models in serverless computing2022 IEEE 15th International Conference on Cloud Computing (CLOUD)10.1109/CLOUD55607.2022.00029(109-111)Online publication date: Jul-2022
https://doi.org/10.1109/CLOUD55607.2022.00029
Chiang YZhu CLin HJi Y(2021)Hysteretic Optimality of Container Warming Control in Serverless Computing SystemsIEEE Networking Letters10.1109/LNET.2021.30864893:3(138-141)Online publication date: Sep-2021
https://doi.org/10.1109/LNET.2021.3086489
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten