Wide Area Network Autoscaling for Cloud Applications
Authors: 
Berta Serracanta, Jordi Paillisse, Albert Cabellos, Anna Claiborne, Alberto Rodriguez-Natal, Dave Ward, Fabio MainoAuthors Info & Claims
Berta Serracanta, Jordi Paillisse, Albert Cabellos, Anna Claiborne, Alberto Rodriguez-Natal, Dave Ward, Fabio MainoAuthors Info & ClaimsPages 1 - 6
Abstract
Modern cloud orchestrators like Kubernetes provide a versatile and robust way to host applications at scale. One of their key features is autoscaling, which automatically adjusts cloud resources (compute, memory, storage) in order to adapt to the demands of applications. However, the scope of cloud autoscaling is limited to the datacenter hosting the cloud and it doesn't apply uniformly to the allocation of network resources. In I/O-constrained or data-in-motion use cases this can lead to severe performance degradation for the application. For example, when the load on a cloud service increases and the Wide Area Network (WAN) connecting the datacenter to the Internet becomes saturated, the application flows experience an increase in delay and loss. In many cases this is dealt with overprovisioning network capacity, which introduces additional costs and inefficiencies.
On the other hand, thanks to the concept of "Network as Code", the WAN exposes a set of APIs that can be used to dynamically allocate and de-allocate capacity on-demand. In this paper we propose extending the concept of cloud autoscaling into the network to address this limitation. This way, applications running in the cloud can communicate their networking requirements, like bandwidth or traffic profile, to a Software-Defined Networking (SDN) controller or Network as a Service (NaaS) platform. Moreover, we aim to define the concepts of vertical and horizontal autoscaling applied to networking. We present a prototype that automatically allocates bandwidth to the underlay network, according to the requirements of the applications hosted in Kubernetes. Finally, we discuss open research challenges.
References
[1]
Gianni Antichi and Gábor Rétvári. 2020. Full-Stack SDN: The Next Big Challenge?. In Proceedings of the Symposium on SDN Research (San Jose, CA, USA) (SOSR '20). Association for Computing Machinery, New York, NY, USA, 48--54. https://doi.org/10.1145/3373360.3380834
[2]
Hitesh Ballani, Paolo Costa, Thomas Karagiannis, and Ant Rowstron. 2011. Towards Predictable Datacenter Networks. SIGCOMM Comput. Commun. Rev. 41, 4 (Aug. 2011), 242--253. https://doi.org/10.1145/2043164.2018465
[3]
D. Bernstein. 2014. Containers and Cloud: From LXC to Docker to Kubernetes. IEEE Cloud Computing 1, 3 (2014), 81--84. https://doi.org/10.1109/MCC.2014.51
[4]
M. El-Gendy, A. Bose, S.-T. Park, and K.G. Shin. 2004. Paving the first mile for QoS-dependent applications and appliances. In Twelfth IEEE International Workshop on Quality of Service, 2004. IWQOS 2004. 245--254. https://doi.org/10.1109/IWQOS.2004.1309390
[5]
Google. 2021. Google Cloud Platform. https://cloud.google.com/
[6]
Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, Jon Zolla, Urs Hölzle, Stephen Stuart, and Amin Vahdat. 2013. B4: Experience with a Globally-Deployed Software Defined Wan. In Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM (Hong Kong, China) (SIGCOMM '13). Association for Computing Machinery, New York, NY, USA, 3--14. https://doi.org/10.1145/2486001.2486019
[7]
Kubernetes 2021. Annotations in Kubernetes. https://kubernetes.io/docs/concepts/overview/working-with-objects/annotations/
[8]
Wubin Li, Yves Lemieux, Jing Gao, Zhuofeng Zhao, and Yanbo Han. 2019. Service Mesh: Challenges, State of the Art, and Future Research Opportunities. In 2019 IEEE International Conference on Service-Oriented System Engineering (SOSE). 122--1225. https://doi.org/10.1109/SOSE.2019.00026
[9]
Hongqiang Harry Liu, Ye Wang, Yang Richard Yang, Hao Wang, and Chen Tian. 2012. Optimizing Cost and Performance for Content Multihoming. In Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (Helsinki, Finland) (SIGCOMM '12). Association for Computing Machinery, New York, NY, USA, 371--382. https://doi.org/10.1145/2342356.2342432
[10]
Elis Lulja. 2021. Echo-server. https://github.com/SunSince90/echo-server
[11]
Fabio Maino, Alberto Rodriguez-Natal, Lori Jakab, and Elis Lulja. 2021. Cloud-Native SD-WAN. https://github.com/CloudNativeSDWAN/cnwan-docs
[12]
Di Niu, Hong Xu, Baochun Li, and Shuqiao Zhao. 2012. Quality-assured cloud bandwidth auto-scaling for video-on-demand applications. In 2012 Proceedings IEEE INFOCOM. 460--468. https://doi.org/10.1109/INFCOM.2012.6195785
[13]
Packet Fabric 2021. What is NaaS? https://packetfabric.com/blog/what-is-naas
[14]
Jordi Paillisse, Marc Portoles, Albert Lopez, Alberto Rodriguez-Natal, David Iacobacci, Johnson Leong, Victor Moreno, Albert Cabellos, Fabio Maino, and Sanjay Hooda. 2020. SD-Access: Practical Experiences in Designing and Deploying Software Defined Enterprise Networks. In Proceedings of the 16th International Conference on Emerging Networking Experiments and Technologies (Barcelona, Spain) (CoNEXT '20). Association for Computing Machinery, New York, NY, USA, 496--508. https://doi.org/10.1145/3386367.3431288
[15]
R. Prasad, C. Dovrolis, M. Murray, and K. Claffy. 2003. Bandwidth estimation: metrics, measurement techniques, and tools. IEEE Network 17, 6 (2003), 27--35. https://doi.org/10.1109/MNET.2003.1248658
[16]
Sabidur Rahman, Tanjila Ahmed, Minh Huynh, Massimo Tornatore, and Biswanath Mukherjee. 2018. Auto-Scaling VNFs Using Machine Learning to Improve QoS and Reduce Cost. In 2018 IEEE International Conference on Communications (ICC). 1--6. https://doi.org/10.1109/ICC.2018.8422788
[17]
Felipe Rodriguez Yaguache. 2019. Enabling Edge Computing Using Container Orchestration and Software Defined Networking. Master's thesis. Aalto University. School of Electrical Engineering. http://urn.fi/URN:NBN:fi:aalto-201910275814
[18]
Tiago Rosado and Jorge Bernardino. 2014. An Overview of Openstack Architecture. In Proceedings of the 18th International Database Engineering & Applications Symposium (Porto, Portugal) (IDEAS '14). Association for Computing Machinery, New York, NY, USA, 366--367. https://doi.org/10.1145/2628194.2628195
[19]
N. Sadek and A. Khotanzad. 2004. Multi-scale high-speed network traffic prediction using k-factor Gegenbauer ARMA model. In 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577), Vol. 4. 2148-2152 Vol.4. https://doi.org/10.1109/ICC.2004.1312898
[20]
Philipp S. Schmidt, Theresa Enghardt, Ramin Khalili, and Anja Feldmann. 2013. Socket Intents: Leveraging Application Awareness for Multi-Access Connectivity. In Proceedings of the Ninth ACM Conference on Emerging Networking Experiments and Technologies (Santa Barbara, California, USA) (CoNEXT '13). Association for Computing Machinery, New York, NY, USA, 295--300. https://doi.org/10.1145/2535372.2535405
[21]
Shuhe Wang, Dong Guo, Wei Jiang, Haizhou Du, and Mingwei Xu. 2020. Dawn: Co-Programming Distributed Applications with Network Control. In Proceedings of the Workshop on Network Application Integration/CoDesign (Virtual Event, USA) (NAI '20). Association for Computing Machinery, New York, NY, USA, 14--19. https://doi.org/10.1145/3405672.3405808
[22]
Shu Yang, Laizhong Cui, Mingwei Xu, Y. Richard Yang, and Rui Huang. 2020. Delivering Functions over Networks: Traffic and Performance Optimization for Edge Computing using ALTO. Internet-Draft draft-yang-alto-deliver-functions-over-networks-01. Internet Engineering Task Force. https://datatracker.ietf.org/doc/html/draft-yang-alto-deliver-functions-over-networks-01, Work in Progress.
[23]
Hao Yin, Chuang Lin, Berton Sebastien, Bo Li, and Geyong Min. 2005. Network traffic prediction based on a new time series model. International Journal of Communication Systems 18, 8 (2005), 711--729. https://doi.org/10.1002/dac.721
Index Terms
- Wide Area Network Autoscaling for Cloud Applications
Recommendations
Portable Autoscaler for Managing Multi-cloud Elasticity
CUBE '13: Proceedings of the 2013 International Conference on Cloud & Ubiquitous Computing & Emerging TechnologiesAbility to scale resources up or down dynamically as per changes in workload conditions is one of the key features of clouds. We present here a framework for elastic scaling of cloud resources that is portable across clouds from a wide range of private ...
Optimal autoscaling in a IaaS cloud
ICAC '12: Proceedings of the 9th international conference on Autonomic computingAn application provider leases resources (i.e., virtual machine instances) of variable configurations from a IaaS provider over some lease duration (typically one hour). The application provider (i.e., consumer) would like to minimize their cost while ...
A virtual machine re-packing approach to the horizontal vs. vertical elasticity trade-off for cloud autoscaling
CAC '13: Proceedings of the 2013 ACM Cloud and Autonomic Computing ConferenceAn automated solution to horizontal vs. vertical elasticity problem is central to make cloud autoscalers truly autonomous. Today's cloud autoscalers are typically varying the capacity allocated by increasing and decreasing the number of virtual machines ...
Comments
Information & Contributors
Information
Published In
August 2021
77 pages
ISBN:9781450386333
DOI:10.1145/3472727
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 August 2021
Check for updates
Author Tags
Qualifiers
- Article
- Research
- Refereed limited
Funding Sources
- MINECO
- Catalan Institution for Research and Advanced Studies (ICREA)
Conference
SIGCOMM '21
Sponsor:
Acceptance Rates
NAI'21 Paper Acceptance Rate 12 of 24 submissions, 50%;
Overall Acceptance Rate 12 of 24 submissions, 50%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 421Total Downloads
- Downloads (Last 12 months)50
- Downloads (Last 6 weeks)5
Reflects downloads up to 06 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in