research-article

A SPEC RG Cloud Group's Vision on the Performance Challenges of FaaS Cloud Architectures

Authors:

Alexandru Iosup,

Cristina L. Abad,

Johannes Grohmann,

Simon EismannAuthors Info & Claims

ICPE '18: Companion of the 2018 ACM/SPEC International Conference on Performance Engineering

Pages 21 - 24

https://doi.org/10.1145/3185768.3186308

Published: 02 April 2018 Publication History

Abstract

As a key part of the serverless computing paradigm, Function-as-a-Service (FaaS) platforms enable users to run arbitrary functions without being concerned about operational issues. However, there are several performance-related issues surrounding the state-of-the-art FaaS platforms that can deter widespread adoption of FaaS, including sizeable overheads, unreliable performance, and new forms of the cost-performance trade-off. In this work we, the SPEC RG Cloud Group, identify six performance-related challenges that arise specifically in this FaaS model, and present our roadmap to tackle these problems in the near future. This paper aims at motivating the community to solve these challenges together.

References

[1]

S. Bast, M. Silva, and N. Wakou. 2017. SPEC Cloud IaaS 2016 Benchmark. In ACM/SPEC ICPE.

Digital Library

[2]

M. Billock. 2017 (accessed January 6, 2018). Serverless Performance Shootout. http://blog.backand.com/serverless-shootout/. (2017 (accessed January 6, 2018)).

[3]

F. Brosig, N. Huber, and S. Kounev. 2011. Automated Extraction of Architecture-Level Performance Models of Distributed Component-Based Systems. In IEEE/ACM ASE.

Digital Library

[4]

A. Eivy. 2017. Be Wary of the Economics of "Serverless" Cloud Computing. IEEE Cloud Computing Vol. 4, 2 (2017).

[5]

B. Ghit, N. Yigitbasi, A. Iosup, and D. Epema. 2014. Balanced resource allocations across multiple dynamic MapReduce clusters ACM SIGMETRICS.

Digital Library

[6]

X. He, P. Shenoy, R. Sitaraman, and D. Irwin. 2015. Cutting the cost of hosting online services using cloud spot markets HPDC.

Digital Library

[7]

S. Hendrickson, S. Sturdevant, T. Harter, V. Venkataramani, A. Arpaci-Dusseau, and R. Arpaci-Dusseau. 2016. Serverless Computation with OpenLambda. In USENIX HotCloud.

Digital Library

[8]

H. Huang, L. Wang, B. Tak, L. Wang, and C. Tang. 2013. CAP3: A cloud auto-provisioning framework for parallel processing using on-demand and spot instances. In IEEE CLOUD.

Digital Library

[9]

R. Jain. 1990. The art of computer systems performance analysis: Techniques for experimental design, measurement, simulation, and modeling. John Wiley &Sons.

[10]

E. Jonas, Q. Pu, S. Venkataraman, I. Stoica, and B. Recht. 2017. Occupy the cloud: Distributed computing for the 99% ACM SoCC.

Digital Library

[11]

R. Koller and D. Williams. 2017. Will Serverless End the Dominance of Linux in the Cloud? HotOS 2017.

Digital Library

[12]

R. Krebs, C. Momm, and S. Kounev. 2014. Metrics and Techniques for Quantifying Performance Isolation in Cloud Environments. Elsevier SciCo (2014).

[13]

W. Lloyd, S. Ramesh, S. Chinthalapati, L. Ly, and S. Pallickara. 2018. Serverless Computing: An Investigation of Factors Influencing Microservice Performance IEEE IC2E, to appear.

[14]

Y. Lu, Q. Xie, G. Kliot, A. Geller, J. Larus, and A. Greenberg. 2011. Join-Idle-Queue: A Novel Load Balancing Algorithm for Dynamically Scalable Web Services. Perf. Eval., Vol. 68, 11 (2011).

Digital Library

[15]

S. Mohammadi, S. Kounev, Juan-Verdejo, and B. Surajbali. 2013. Soft Reservations: Uncertainty-Aware Resource Reservations in IaaS Environments BMSD.

[16]

S. Mortazavi, M. Salehe, C. Simoes, C. Phillips, and E. de Lara. 2017. CloudPath: A Multi-Tier Cloud Computing Framework ACM/IEEE Symp. Edge Comp. (SEC).

Digital Library

[17]

E. Oakes, L. Yang, K. Houck, T. Harter, A. Arpaci-Dusseau, and R. Arpaci-Dusseau. 2017. Pipsqueak: Lean Lambdas with Large Libraries. ICDCS-W (WoSC).

[18]

V. Pai, M. Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel, and E. Nahum. 1998. Locality-aware Request Distribution in Cluster-based Network Servers. SIGOPS Oper. Syst. Rev. Vol. 32, 5 (1998).

Digital Library

[19]

R. Reussner, S. Becker, J. Happe, R. Heinrich, A. Koziolek, H. Koziolek, M. Kramer, and K. Krogmann. 2016. Modeling and simulating software architectures: The Palladio approach. MIT Press.

Digital Library

[20]

M. Satya. 2017. The emergence of edge computing. Computer, Vol. 50, 1 (2017).

Digital Library

[21]

S. Shen, K. Deng, A. Iosup, and D. Epema. 2013. Scheduling Jobs in the Cloud Using On-Demand and Reserved Instances Euro-Par.

Digital Library

[22]

E. van Eyk, A. Iosup, S. Seif, and M. Thömmes. 2017. The SPEC cloud group's research vision on FaaS and serverless architectures WoSC held with ACM/IFIP/Usenix Middleware.

Digital Library

[23]

M. Xavier, I. De Oliveira, F. Rossi, R. Dos Passos, K. Matteussi, and C. De Rose. 2015. A performance isolation analysis of disk-intensive workloads on container-based clouds IEEE Euromicro PDP.

Digital Library

[24]

Q. Xie, M. Pundir, Y. Lu, C. Abad, and R. Campbell. 2017. Pandas: Robust Locality-Aware Scheduling With Stochastic Delay Optimality. IEEE/ACM TON Vol. 25:2 (2017).

Digital Library

[25]

M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, and I. Stoica. 2010. Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling. In ACM EuroSys.

Digital Library

Cited By

Kathirvel NAyyaswamy KSubramanian C(2024)Intelligent Serverless Computing Technology and Recent TrendsDriving Transformative Technology Trends With Cloud Computing10.4018/979-8-3693-2869-9.ch002(23-42)Online publication date: 21-Jun-2024
https://doi.org/10.4018/979-8-3693-2869-9.ch002
Kaur JChana IBala A(2024)An Autoscalable Approach to Optimize Energy Consumption using Smart Meters data in Serverless ComputingScience and Technology for Energy Transition10.2516/stet/2024078Online publication date: 3-Sep-2024
https://doi.org/10.2516/stet/2024078
Anselmi J(2024)Asynchronous Load Balancing and Auto-Scaling: Mean-Field Limit and Optimal DesignIEEE/ACM Transactions on Networking10.1109/TNET.2024.336813032:4(2960-2971)Online publication date: Aug-2024
https://doi.org/10.1109/TNET.2024.3368130
Show More Cited By

Index Terms

A SPEC RG Cloud Group's Vision on the Performance Challenges of FaaS Cloud Architectures

Recommendations

The SPEC cloud group's research vision on FaaS and serverless architectures
WoSC '17: Proceedings of the 2nd International Workshop on Serverless Computing

Cloud computing enables an entire ecosystem of developing, composing, and providing IT services. An emerging class of cloud-based software architectures, serverless, focuses on providing software architects the ability to execute arbitrary functions ...
Supporting Multi-Provider Serverless Computing on the Edge
ICPP Workshops '18: Workshop Proceedings of the 47th International Conference on Parallel Processing

Serverless computing has recently emerged as a new execution model for cloud computing, in which service providers offer compute runtimes, also known as Function-as-a-Service (FaaS) platforms, allowing users to develop, execute and manage application ...
Beyond Microbenchmarks: The SPEC-RG Vision for a Comprehensive Serverless Benchmark
ICPE '20: Companion of the ACM/SPEC International Conference on Performance Engineering

Serverless computing services, such as Function-as-a-Service (FaaS), hold the attractive promise of a high level of abstraction and high performance, combined with the minimization of operational logic. Several large ecosystems of serverless platforms, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '18: Companion of the 2018 ACM/SPEC International Conference on Performance Engineering

April 2018

212 pages

ISBN:9781450356299

DOI:10.1145/3185768

General Chairs:
Katinka Wolter
Free University of Berlin, Germany
,
Will Knottenbelt
Imperial College London, UK
,
Program Chairs:
André van Hoorn
University of Stuttgart, Germany
,
Manoj Nambiar
Tata Consultancy Services, India
,
Heiko Koziolek
ABB, Germany

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICPE '18

Sponsor:

ICPE '18: ACM/SPEC International Conference on Performance Engineering

April 9 - 13, 2018

Berlin, Germany

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
712
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)5

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kathirvel NAyyaswamy KSubramanian C(2024)Intelligent Serverless Computing Technology and Recent TrendsDriving Transformative Technology Trends With Cloud Computing10.4018/979-8-3693-2869-9.ch002(23-42)Online publication date: 21-Jun-2024
https://doi.org/10.4018/979-8-3693-2869-9.ch002
Kaur JChana IBala A(2024)An Autoscalable Approach to Optimize Energy Consumption using Smart Meters data in Serverless ComputingScience and Technology for Energy Transition10.2516/stet/2024078Online publication date: 3-Sep-2024
https://doi.org/10.2516/stet/2024078
Anselmi J(2024)Asynchronous Load Balancing and Auto-Scaling: Mean-Field Limit and Optimal DesignIEEE/ACM Transactions on Networking10.1109/TNET.2024.336813032:4(2960-2971)Online publication date: Aug-2024
https://doi.org/10.1109/TNET.2024.3368130
Lin CMahmoudi NFan CKhazaei H(2023)Fine-Grained Performance and Cost Modeling and Optimization for FaaS ApplicationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.321478334:1(180-194)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TPDS.2022.3214783
Vahidinia PFarahani BAliee F(2023)Mitigating Cold Start Problem in Serverless Computing: A Reinforcement Learning ApproachIEEE Internet of Things Journal10.1109/JIOT.2022.316512710:5(3917-3927)Online publication date: 1-Mar-2023
https://doi.org/10.1109/JIOT.2022.3165127
Lannurien VD'Orazio LBarais OBernard EWeppe OBeaulieu LKacete APaquelet SBoukhobza J(2023)HeROfake: Heterogeneous Resources Orchestration in a Serverless Cloud – An Application to Deepfake Detection2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid57682.2023.00024(154-165)Online publication date: May-2023
https://doi.org/10.1109/CCGrid57682.2023.00024
Lannurien VD’Orazio LBarais OBoukhobza J(2023)Serverless Cloud Computing: State of the Art and ChallengesServerless Computing: Principles and Paradigms10.1007/978-3-031-26633-1_11(275-316)Online publication date: 12-May-2023
https://doi.org/10.1007/978-3-031-26633-1_11
Sadaqat MSánchez-Gordón MColomo-Palacios R(2022)Benchmarking Serverless ComputingJournal of Information Technology Research10.4018/JITR.29937415:1(1-17)Online publication date: 3-Jun-2022
https://doi.org/10.4018/JITR.299374
Ahmed KSahu ASahu ASahu N(2022)Quantify the Behaviour Intention of Individuals to Control SC Performance by Exploring Cloud Storage ServicesInternational Journal of Technology and Human Interaction10.4018/IJTHI.30622718:7(1-28)Online publication date: 9-Sep-2022
https://dl.acm.org/doi/10.4018/IJTHI.306227
Decker JKasprzak PKunkel J(2022)Performance Evaluation of Open-Source Serverless Platforms for KubernetesAlgorithms10.3390/a1507023415:7(234)Online publication date: 2-Jul-2022
https://doi.org/10.3390/a15070234
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents