Statistics-driven datacenter resources provisioning
Pages 185 - 190
Abstract
The virtualization concept along with its underlying technologies has been warmly adopted in many fields of computer science. In modern datacenters, the convergence of communications and computing to a common design and operational entity has proved an inevitable reality, introducing virtual servers as active network elements thus increasing the infrastructure complexity. Effective resource management in such architectures is crucial, impacting both service delivery and the resulting infrastructure operating costs. We propose a novel approach, based on Statistical Process Control (SPC), for the dynamic resource provisioning of datacenter virtualized resources. Our work provides an integrated, platform-independent and technology-neutral, framework consisting of a Common Information Model (CIM) based resource controller which allows for the on-line, adaptive, management of a virtual machine's CPU allocation. The controller can be extended to manage other types of hypervisor-provisioned resources. We provide a successful proof-of-concept of our work, deploying the controller on an IBM pSeries UNIX system running a core banking environment software with actual business data. Given the platform agnostic description of the controller and the managed environment it is, thus, possible to easily provide different operating system and hardware platform ports.
References
[1]
Abdelzaher, T.F., Shin, K.G. and Bhatti, N., 2002. Performance guarantees for web server end-systems: A control-theoretical approach. IEEE Trans. Parallel Distrib. Syst. 13 (2002), 80--96.
[2]
Armstrong, W., et al. 2005. Advanced virtualization capabilities of POWER5 systems. IBM J. Res. Dev. 49 (2005), 523--532.
[3]
Bain, S., Bradfield, A., Guizan, J., Read, J., Rogers, R., Shedlersky, J., Thomas, J. and Willner, B. 2009. A Benchmark Study on Virtualization Platforms for Private Clouds, Technical Report ZSW03125-USEN-01. IBM Corporation, (2009), IBM Systems and Technology Group, New York, USA, available at http://www.ibm.com/
[4]
Bari, M.F., Boutaba, R., Esteves, R. and Granville, L.Z., 2013. Data Center Network Virtualization: A Survey. IEEE Commun. Surv. Tutor. 15 (2013), 909--928.
[5]
Bennani, M. and Menasce, D., 2005. Resource allocation for autonomic data centers using analytic performance models. In Proceedings of the 2nd Int. Conf. Auton. Comput., IEEE, (2005), 229--240.
[6]
Bersimis, S., Psarakis, S. and Panaretos, J., 2007. Multivariate statistical process control charts. Qual. Reliab. Eng. Int. 23 (2007) 517--543.
[7]
Boffoli N., Bruno G., Caivano D., and Mastelloni G., 2008. Statistical process control for software: a systematic approach. In: Proceedings of the 2nd ACM-IEEE Int. Symp. Empir. Softw. Eng. Meas., ACM, Kaiserslautern, Germany, (2008), 327--329.
[8]
Breitgand, D. and Epstein, A., 2012. Improving consolidation of virtual machines with risk-aware bandwidth oversubscription in compute clouds. In Proceedings of the 2012 IEEE Int. Conf. Comput. Commun., (2012), 2861--2865.
[9]
Brendan, J. and Stadler, R., 2014. Resource management in clouds: Survey and research challenges. J. Netw. Syst. Manag., (2014), 1--53.
[10]
Chandra, A., Gong, W. and Shenoy, P., 2003. Dynamic Resource Allocation for Shared Data Centers Using Online Measurements. In Proceedings of the IWQoS, Springer Berlin Heidelberg, Monterey, CA, (2003), 381--398.
[11]
Chase, J., Anderson, D., Thakar, P., Vahdat, A. and Doyle, R., 2001. Managing energy and server resources in hosting centers. ACM SIGOPS Oper. Syst. Rev. 35 (2001), 103--116.
[12]
Chenyang, L., Abdelzaher, T.F., Stankovic, J.A. and Son, S.H., 2001. A feedback control approach for guaranteeing relative delays in web servers. In Proceedings of the 7th IEEE Real-Time Technol. Appl. Symp., Taipei, (2001), 51--62.
[13]
Chen, Z., Lu, S. and Lam, S., 2007. A hybrid system for SPC concurrent pattern recognition. Adv. Eng. Inform. 21 (2007), 303--310.
[14]
Diao, Y., Hellerstein, J.L., Parekh, S. and Griffith, R., 2005. A control theory foundation for self-managing computing systems. IEEE J. Sel. Areas Commun. 23 (2005), 2213--2222.
[15]
Dong, Y., Xiaowei, Y., Jianhui, L., Guangdeng, L., Kun, T. and Haibing, G., 2012. High performance network virtualization with SR-IOV. J. Parallel Distrib. Comput. 72 (2012), 1471--1480.
[16]
Ali-Eldin, A., Tordsson, J. and Elmroth, E., 2012. An adaptive hybrid elasticity controller for cloud infrastructures. In Proceedings of the 13th IEEE Netw. Oper. Manag. Symp., IEEE, (2012), 204--2012.
[17]
Gandhi, N. and Tilbury, D.M., 2002. MIMO control of an apache web server: Modeling and controller design. In Proceedings of the Am. Control Conf., Anchorage, USA, (2002), 4922--4927.
[18]
Guh, R.S., Tannock, J.D.T. and O'Brien, C., 1999. IntelliSPC: a hybrid intelligent tool for on-line economical statistical process control. Expert Syst. Appl. 17 (1999), 195--212.
[19]
Hellerstein, J.L., Diao, Y., Parekh, S. and Tilbury, D.M., 2004. Feedback Control of Computing Systems, John Wiley & Sons, (2004), ISBN 0471668818.
[20]
Huber, N., Von Quast, M., Hauck, M. and Kounev, S., 2011. Evaluating and modeling virtualization performance overhead for cloud environments. In Proceedings of the 1st Int. Conf. Cloud Comput. Serv. Sci., Noordwijkerhout, the Netherlands, (2011), 563--573.
[21]
Hayashi, K., Ji, K., Lascu, O., Pienaar, H., Schreitmueller, S., Tarquino, T. and Thompson, J., 2007. IBM AIX 5L Practical Performance Tools and Tuning Guide. (2007), available at http://www.redbooks.ibm.com/redbooks/pdfs/sg246478.pdf
[22]
Jones, M., Rosu, D. and Rosu, M.C., 1997. CPU Reservations and Time Constraints: Efficient, Predictable Scheduling of Independent Activities. ACM SIGOPS Oper. Syst. Rev. 31 (1997), 198--211.
[23]
Kontoudis, D. and Fouliras, P., 2013. Modelling and managing virtual network environments. In Proceedings of the 17th PanHellenic Conf. Inform. PCI '13, ACM, Thessaloniki, Greece, (2013), 39--46.
[24]
Kontoudis, D. and Fouliras, P., 2014. A survey of models for computer networks management. Int. J. Comput. Netw. Commun. 6 (2014), 157--176.
[25]
Lee, C., Lee, D., Koo, J. and Chung, J., 2009. Proactive Fault Detection Schema for Enterprise Information System Using Statistical Process Control. In Proceedings of the Symp. Hum. Interface (2009) Conf. Access Hum-Comput. Interact. Springer-Verlag, Berlin, Heidelberg, San Diego, Ca, USA, (2009), 113--122.
[26]
Meng, X., Isci, C., Kephart, J., Zhang, L., Bouillet, E. and Pendarakis, D., 2010. Efficient Resource Provisioning in Compute Clouds via VM Multiplexing. In Proceedings of the 7th Int. Conf. Auton. Comput., ACM, (2010), 11--20.
[27]
Mohit, A., Druschel, P. and Zwaenepoel, W., 2000. Cluster reserves: a mechanism for resource management in cluster-based network servers. ACM SIGMETRICS Perform. Eval. Rev. 28 (2000), 90--101.
[28]
Nguyen, T.H., Adams, B., Jiang, Z.M., Hassan, A.E., Nasser, M. and Flora, P., 2012. Automated Detection of Performance Regressions Using Statistical Process Control Techniques. In Proceedings of the 3rd ACMSPEC Int. Conf. Perform. Eng., ACM, Boston, MA, USA, (2012), 299--310.
[29]
Nong, Y., Emran, S.M., Xiangyang, L. and Qiang, C., 2001. Statistical process control for computer intrusion detection. In Proceedings of the DARPA Inf. Surviv. Conf. Expo., IEEE, Anaheim, CA, USA, (2001), 3--14.
[30]
Oakland, J.S., 2003. Statistical Process Control, Butterworth-Heinemann, Burlington, MA, (2003), ISBN 0750657669.
[31]
Oliveira, R.R., Loureiro, A.A. and Frery, A.C., 2009. A Multi-Scale Statistical Control Process for Mobility and Interference Identification in IEEE 802.11. Mob. Netw. Appl. 14 (2009), 725--743.
[32]
Oliveira, R.R., Pereira, R.R. and Loureiro, A.A., 2007. Adaptive configuration of wpans and wlans communications using multi-scale statistical process control. In Proceedings of the 10th ACM Symp. Model. Anal. Simul. Wirel. Mob. Syst., ACM, Chania, Crete, Greece, (2007), 138--142.
[33]
Padala, P., et al., 2007. Adaptive control of virtualized resources in utility computing environments. In Proceedings of the 2nd ACM SIGOPSEuroSys Eur. Conf. Comput. Syst., ACM, (2007), 289--302.
[34]
Patil, S. and Lilja, D., 2012. Statistical methods for computer performance evaluation. WIREs Comput. Stat. 4 (2012), 98--106.
[35]
Pham, D.T. and Oztemel, E., 1992. XPC: an on-line expert system for statistical process control. Int. J. Prod. Res. 30 (1992), 2857--2872.
[36]
Qi, Z., Lu, C. and Boutaba, R., 2010. Cloud computing: state-of-the-art and research challenges. J. Internet Serv. Appl. 1 (2010), 7--18.
[37]
Rygielski, P. and Kounev, S., 2013. Network Virtualization for QoS-Aware Resource Management in Cloud Data Centers: A Survey. PIK - Prax. Informationsverarbeitung Kommun. 36 (2013), 55--64.
[38]
Sakr, S., Liu, A., Batista, D.M. and Alomari, M., 2011. A survey of Large Scale Data Management Approaches in Cloud Environments. IEEE Commun. Surv. Tutor. 13 (2011), 311--336.
[39]
Scordaki, A. and Psarakis, S., 2005. Statistical Process Control in Service Industry - an Application with Real Data in a Commercial Company. In Proceedings of the 7th Hell. Eur. Conf. Comput. Math. Its Appl., (2005), Athens, Greece.
[40]
Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M. and Tantawi, A., 2005. An analytical model for multi-tier internet services and its applications. ACM SIGMETRICS Perform. Eval. Rev. 33 (2005), 291--302.
[41]
Wetherill, B. and Brown, W., 1991. Statistical Process Control: Theory and Practice, Chapman and Hall/CRC, (1991), ISBN 978-0412357008
[42]
Wheeler, D.J. and Chambers, D., 2010. Understanding Statistical Process Control, SPC Press, Knoxville, TN., USA, (2010), ISBN 978-0-945320-69-2
[43]
Ying, L. and Abdelzaher, T.F., 2004. Design, implementation, and evaluation of differentiated caching services. IEEE Trans. Parallel Distrib. Syst. 15 (2004), 440--452.
[44]
Zhang, B., Wang, X., Lai, R., Yang, L., Luo, Y. and Li, X., 2010. Evaluating and optimizing I/O virtualization in kernel-based virtual machine (KVM). In Proceedings of the Netw. Parallel Comput., Springer Berlin Heidelberg, (2010), 220--231.
[45]
Zhang, Q.L. and Gao, J., 2004. Applying SPC to autonomic computing. In Proceedings of the Int. Conf. Mach. Learn. Cybern., IEEE, Shanghai, China, (2004), 744--749.
[46]
Zhang, Y., Bestavros, A., Guirguis, M., Matta, I. and West, R., 2005. Friendly virtual machines: leveraging a feedback-control model for application adaptation. In Proceedings of the 1st ACM USENIX Int. Conf. Virtual Exec. Environ., Chicago, USA, (2005), 2--12.
[47]
Hiep, N., Shen, Z., Gu, X., Subbiah, S. and Wilkes, J., 2013. AGILE: elastic distributed resource scaling for infrastructure-as-a-service. In Proceedings of the 10th Int. Conf. Auton. Comput., USENIX, San Jose, CA, USA, (2013), 69--82.
[48]
T24 Core Banking Software, Temenos, Geneva, Switzerland, (2014), available at http://www.temenos.com/en/products-and-services/front-and-middle-office/t24-core-banking
[49]
Chelmis, N., Kyriazis, D., Themistocleous, M., 2015. Optimized Cloud Resources Management Based on Dynamic Scheduling policies and Elasticity Models. In Proceedings of the CLOUD COMPUTING 2015: The 6th Int. Conf. on Cloud Computing, GRIDs, and Virtualization, Nice, France, (2015), 20--26.
Index Terms
- Statistics-driven datacenter resources provisioning
Recommendations
Cache isolation and thin provisioning of hypervisor caches
LCN '12: Proceedings of the 2012 IEEE 37th Conference on Local Computer Networks (LCN 2012)Server virtualization has enabled resource consolidation and has minimized the need for additional and expensive hardware. Server virtualization has been widely deployed in a lot of organizations, because of the attractive benefits it offers like ...
Performance Analysis of Network I/O Workloads in Virtualized Data Centers
Server consolidation and application consolidation through virtualization are key performance optimizations in cloud-based service delivery industry. In this paper, we argue that it is important for both cloud consumers and cloud providers to understand ...
Performance Evaluation of Xen, KVM, and Proxmox Hypervisors
Hardware virtualization plays a major role in IT infrastructure optimization in private data centers and public cloud platforms. Though there are many advancements in CPU architecture and hypervisors recently, but overhead still exists as there is a ...
Comments
Information & Contributors
Information
Published In
October 2015
438 pages
ISBN:9781450335515
DOI:10.1145/2801948
Copyright © 2015 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 October 2015
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
PCI '15
Acceptance Rates
PCI '15 Paper Acceptance Rate 64 of 148 submissions, 43%;
Overall Acceptance Rate 190 of 390 submissions, 49%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 88Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 31 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in