research-article

Dealer: application-aware request splitting for interactive cloud applications

Authors:

Mohammad Hajjat,

Shankaranarayanan P. N,

Kunwadee SripanidkulchaiAuthors Info & Claims

CoNEXT '12: Proceedings of the 8th international conference on Emerging networking experiments and technologies

Pages 157 - 168

https://doi.org/10.1145/2413176.2413195

Published: 10 December 2012 Publication History

Abstract

Deploying interactive applications in the cloud is a challenge due to the high variability in performance of cloud services. In this paper, we present Dealer-- a system that helps geo-distributed, interactive and multi-tier applications meet their stringent requirements on response time despite such variability. Our approach is motivated by the fact that, at any time, only a small number of application components of large multi-tier applications experience poor performance. Dealer abstracts application structure as a component graph, with nodes being application components and edges capturing inter-component communication patterns. Dealer continually monitors the performance of individual component replicas and communication latencies between replica pairs. In serving any given user request, Dealer seeks to minimize user response times by picking the best combination of replicas (potentially located across different data-centers). While Dealer does require modifications to application code, we show through integration with two multi-tier applications that the changes required are modest. Our evaluations on two multi-tier applications using real cloud deployments indicate the 90%ile of application response times could be reduced by a factor of 3 under natural cloud dynamics compared to conventional data-center redirection techniques which are agnostic of application structure.

References

[1]

Amazon cloud outage. http://aws.amazon.com/message/2329B7/.

[2]

Amazon EC2 pricing. http://aws.amazon.com/ec2/pricing/.

[3]

Apache, Project Stonehenge. http://wiki.apache.org/incubator/StonehengeProposal.

[4]

Architecting for the Cloud: Best Practices. http://jineshvaria.s3.amazonaws.com/public/cloudbestpractices-jvaria.pdf.

[5]

Aspect Oriented Programming. http://msdn.microsoft.com/en-us/library/aa288717%28v=vs.7129.aspx.

[6]

Coding in the Cloud. Use a stateless design whenever possible. http://www.rackspace.com/blog/coding-in-the-cloud-rule-3-use-a-stateless-design-whenever-possible/.

[7]

Event Tracing for Windows (ETW). http://msdn.microsoft.com/en-us/library/aa363668.aspx.

[8]

Grinder Load Testing Framework. http://grinder.sourceforge.net/index.html.

[9]

Latency - it costs you. http://highscalability.com/latency-everywhere-and-it-costs-you-sales-how-crush-it}.

[10]

Microsoft Live outage due to DNS corruption. http://windowsteamblog.com/windows_live/b/windowslive/archive/2011/09/20/follow-up-on-the-sept-8-service-outage.aspx}.

[11]

Microsoft Windows Azure. http://www.microsoft.com/windowsazure/.

[12]

Response Time Metric for SLAs. http://testnscale.com/blog/performance/response-time-metric-for-slas.

[13]

Slow pages lose users. http://radar.oreilly.com/2009/06/bing-and-google-agree-slow-pag.html.

[14]

SQL Azure Data Sync. http://social.technet.microsoft.com/wiki/contents/articles/sql-azure-data-sync-overview.aspx}.

[15]

SQL Azure Performance Issue. http://cloudfail.net/513962}.

[16]

Using SOAP Extensions in ASP.NET. http://msdn.microsoft.com/en-us/magazine/cc164007.aspx.

[17]

Windows Azure SLA. http://www.microsoft.com/windowsazure/sla/.

[18]

Windows Azure Thumbnails Sample. http://code.msdn.microsoft.com/windowsazure/Windows-Azure-Thumbnails-c001c8d7.

[19]

Windows Azure Traffic Manager (WATM). http://msdn.microsoft.com/en-us/gg197529.

[20]

Ahmad, F., et al. Joint optimization of idle and cooling power in data centers while maintaining response time. ASPLOS 2010.

Digital Library

[21]

Armbrust, M., et al. Above the Clouds: A Berkeley View of Cloud Computing. Tech. rep., EECS, University of California, Berkeley, 2009.

[22]

Barham, P., et al. Magpie: Online modelling and performance-aware systems. In HOTOS 2003.

Digital Library

[23]

Barker, S., and Shenoy, P. Empirical evaluation of latency-sensitive application performance in the cloud. In MMSys 2010.

Digital Library

[24]

Blackburn, S. M., and et al. The DaCapo benchmarks: Java benchmarking development and analysis. In OOPSLA 2006.

Digital Library

[25]

Chen, Y., Iyer, S., Liu, X., Milojicic, D., and Sahai, A. SLA decomposition: Translating service level objectives to system level thresholds. In ICAC'07.

Digital Library

[26]

Dilley, J., et al. Globally distributed content delivery. Internet Computing, IEEE (2002).

Digital Library

[27]

Fonseca, R., Porter, G., Katz, R., Shenker, S., and Stoica, I. X-trace: A pervasive network tracing framework. In NSDI 2007.

Digital Library

[28]

Hajjat, M., et al. Cloudward bound: Planning for beneficial migration of enterprise applications to the cloud. SIGCOMM 2010.

Digital Library

[29]

Hastorun, D., et al. Dynamo: amazons highly available key-value store. In In Proc. SOSP (2007).

Digital Library

[30]

Hong, Y.-J., et al. Dynamic server provisioning to minimize cost in an iaas cloud. In ACM SIGMETRICS, 2011.

Digital Library

[31]

Kamra, A., Misra, V., and Nahum, E. Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites. In IWQOS 2004.

[32]

Lagar-Cavilla, et al. SnowFlock: rapid virtual machine cloning for cloud computing. In ACM EuroSys, 2009.

Digital Library

[33]

Li, A., Yang, X., Kandula, S., and Zhang, M. CloudCmp: comparing public cloud providers. In IMC 2010.

Digital Library

[34]

Pang, J., et al. On the responsiveness of DNS-based network control. In IMC 2004.

Digital Library

[35]

Ranjan, S., Karrer, R., and Knightly, E. Wide area redirection of dynamic content by Internet data centers. In INFOCOM 2004.

[36]

RightScale Inc. Cloud computing management platform. http://www.rightscale.com.

[37]

Satopaa, V., et al. Finding a 'Kneedle' in a Haystack: Detecting Knee Points in System Behavior. In SIMPLEX Workshop, 2011.

Digital Library

[38]

Shivam, P., Babu, S., and Chase, J. Learning application models for utility resource planning. In ICAC'06.

Digital Library

[39]

Su, A., Choffnes, D., Kuzmanovic, A., and Bustamante, F. Drafting behind Akamai. SIGCOMM 2006.

[40]

Symantec. 2010 State of the Data Center Global Data. http://www.symantec.com/content/en/us/about/media/pdfs/Symantec_DataCenter10_Report_Global.pdf.

[41]

Urgaonkar, B., and Shenoy, P. Cataclysm: Handling extreme overloads in internet services. In PODC 2004.

Digital Library

[42]

Urgaonkar, B., Shenoy, P., Chandra, A., and Goyal, P. Dynamic provisioning of multi-tier internet applications. In ICAC 2005.

Digital Library

[43]

Vrable, M., et al. Scalability, fidelity, and containment in the potemkin virtual honeyfarm. In ACM SOSP, 2005.

Digital Library

[44]

Wang, G., and Ng, T. S. E. The impact of virtualization on network performance of Amazon EC2 data center. In IEEE INFOCOM 2010.

Digital Library

[45]

Wendell, P., et al. DONAR: decentralized server selection for cloud services. In SIGCOMM 2010.

Digital Library

[46]

Zhang, Q., Cherkasova, L., and Smirni, E. A regression-based analytic model for dynamic resource provisioning of multi-tier applications. In ICAC'07.

Digital Library

Cited By

Mostofi VKrul EKrishnamurthy DArlitt M(2023)Trace-Driven Scaling of Microservice ApplicationsIEEE Access10.1109/ACCESS.2023.326006911(29360-29379)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3260069
Shekhar SChhokra ABhattacharjee ABarve YKhare SPallez GSun HGokhale AKarsai G(2023)INDICES: Applying DDDAS Principles for Performance Interference-aware Cloud-to-Fog Application MigrationHandbook of Dynamic Data Driven Applications Systems10.1007/978-3-031-27986-7_33(869-902)Online publication date: 31-Mar-2023
https://doi.org/10.1007/978-3-031-27986-7_33
Tao XOta KDong MBorjigin WQi HLi K(2022)Congestion-Aware Traffic Allocation for Geo-Distributed Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2020.300119210:3(1675-1687)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TCC.2020.3001192
Show More Cited By

Index Terms

Dealer: application-aware request splitting for interactive cloud applications

Recommendations

SLA-Based Resource Allocation for Software as a Service Provider (SaaS) in Cloud Computing Environments
CCGRID '11: Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

Cloud computing has been considered as a solution for solving enterprise application distribution and configuration challenges in the traditional software sales model. Migrating from traditional software to Cloud enables on-going revenue for software ...
Meryn: open, SLA-driven, cloud bursting PaaS
ORMaCloud '13: Proceedings of the first ACM workshop on Optimization techniques for resources management in clouds

PaaS (Platform as a service) systems are revolutionizing the way modern applications are developed and hosted. Current PaaS offerings provide limited support for managing SLAs (Service Level Agreements) that constrain application quality properties, ...
A business-oriented Cloud federation model for real-time applications

Cloud federation can allow individual Cloud providers working collaboratively to offer best-effort services to service customers. However, the current federated Cloud computing model is not appropriate for computationally intensive Real-time Online ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '12: Proceedings of the 8th international conference on Emerging networking experiments and technologies

December 2012

384 pages

ISBN:9781450317757

DOI:10.1145/2413176

General Chairs:
Chadi Barakat
INRIA, Sophia Antipolis, France
,
Renata Teixeira
UPMC Sorbonne Universités and CNRS, Paris, France
,
Program Chairs:
K. K. Ramakrishnan
AT&T Labs Research, Florham Park, NJ, USA
,
Patrick Thiran
EPFL, Lausanne, Swizerland

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 December 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CoNEXT '12

Sponsor:

SIGCOMM

CoNEXT '12: Conference on emerging Networking Experiments and Technologies

December 10 - 13, 2012

Nice, France

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
189
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mostofi VKrul EKrishnamurthy DArlitt M(2023)Trace-Driven Scaling of Microservice ApplicationsIEEE Access10.1109/ACCESS.2023.326006911(29360-29379)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3260069
Shekhar SChhokra ABhattacharjee ABarve YKhare SPallez GSun HGokhale AKarsai G(2023)INDICES: Applying DDDAS Principles for Performance Interference-aware Cloud-to-Fog Application MigrationHandbook of Dynamic Data Driven Applications Systems10.1007/978-3-031-27986-7_33(869-902)Online publication date: 31-Mar-2023
https://doi.org/10.1007/978-3-031-27986-7_33
Tao XOta KDong MBorjigin WQi HLi K(2022)Congestion-Aware Traffic Allocation for Geo-Distributed Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2020.300119210:3(1675-1687)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TCC.2020.3001192
Miao WZeng ZWang CQian Z(2021)SmartDis: Near-Optimal Task Scheduling in Multi-edge NetworksEdge Computing and IoT: Systems, Management and Security10.1007/978-3-030-73429-9_2(15-34)Online publication date: 9-Apr-2021
https://doi.org/10.1007/978-3-030-73429-9_2
Lee GMoon TJang MKim H(2020)eAPT: enhancing APT with a mirror site resolver2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW)10.1109/ISSREW51248.2020.00048(117-122)Online publication date: Oct-2020
https://doi.org/10.1109/ISSREW51248.2020.00048
Murray RKhuller SChao M(2018)Scheduling Distributed Clusters of Parallel MachinesAlgorithmica10.1007/s00453-017-0345-x80:10(2777-2798)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1007/s00453-017-0345-x
Li PGuo SMiyazaki TLiao XJin HZomaya AWang K(2017)Traffic-Aware Geo-Distributed Big Data Analytics with Predictable Job Completion TimeIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.262628528:6(1785-1796)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1109/TPDS.2016.2626285
Shekhar SChhokra ABhattacharjee AAupy GGokhale A(2017)INDICES: Exploiting Edge Resources for Performance-Aware Cloud-Hosted Services2017 IEEE 1st International Conference on Fog and Edge Computing (ICFEC)10.1109/ICFEC.2017.16(75-80)Online publication date: May-2017
https://doi.org/10.1109/ICFEC.2017.16
Li PMiyazaki TGuo S(2017)Traffic-aware task placement with guaranteed job completion time for geo-distributed big data2017 IEEE International Conference on Communications (ICC)10.1109/ICC.2017.7996541(1-6)Online publication date: May-2017
https://doi.org/10.1109/ICC.2017.7996541
Li TSantini S(2017)Energy-aware coflow and antenna scheduling for hybrid server-centric data center networks2017 IEEE International Conference on Communications (ICC)10.1109/ICC.2017.7996422(1-7)Online publication date: May-2017
https://doi.org/10.1109/ICC.2017.7996422
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents