research-article

Thermal-aware MapReduce Real-Time Scheduling in Heterogeneous Server Systems

Authors:

Ya-Shu ChenAuthors Info & Claims

RACS '16: Proceedings of the International Conference on Research in Adaptive and Convergent Systems

Pages 207 - 212

https://doi.org/10.1145/2987386.2987409

Published: 11 October 2016 Publication History

Abstract

With the increased requirements of cloud computing, the cooling cost is getting serious in data centers. However, thermal management has proven to be challenging due to the tradeoff that occurs between performance requirements and overheating. To provide quality of service for interactive web services, this study explores thermal-aware MapReduce real-time scheduling in heterogeneous server systems. A data-locality-aware power controller with thermal consideration is proposed to dynamically switch the power state and to switch the executing frequency of each server. The thermal efficiency of the proposed method was evaluated using a series of workloads, and impressive results were obtained.

References

[1]

"Nvidia tesla gpu accelerators." http://international.download.nvidia.com/pdf/kepler/TeslaK80-datasheet.pdf.

[2]

G. Liu, M. Zhang, and F. Yan, "Large-scale social network analysis based on mapreduce," in Proceedings of the Computational Aspects of Social Networks (CASoN), pp. 487--490, 2010.

Digital Library

[3]

Y. C. Lee and A. Y. Zomaya, "Energy conscious scheduling for distributed computing systems under different operating conditions," IEEE Transactions on Parallel and Distributed Systems, vol. 22, no. 8, pp. 1374--1381, 2011.

Digital Library

[4]

Z. Du, H. Sun, Y. He, Y. He, D. A. Bader, and H. Zhang, "Energy-efficient scheduling for best-effort interactive services to achieve high response quality," in IEEE International Symposium on Parallel & Distributed Processing (IPDPS), pp. 637--648, IEEE, 2013.

Digital Library

[5]

M. Alrokayan, A. V. Dastjerdi, and R. Buyya, "Sla-aware provisioning and scheduling of cloud resources for big data analytics," in Cloud Computing in Emerging Markets (CCEM), 2014 IEEE International Conference on, pp. 1--8, IEEE, 2014.

[6]

Y.-C. Kao and Y.-S. Chen, "Data-locality-aware mapreduce real-time scheduling framework," Journal of Systems and Software, vol. 112, pp. 65--77, 2016.

Digital Library

[7]

H. Sun, P. Stolf, J.-M. Pierson, and G. da Costa, "Multi-objective scheduling for heterogeneous server systems with machine placement," in Cluster, Cloud and Grid Computing (CCGrid), 2014 14th IEEE/ACM International Symposium on, pp. 334--343, IEEE, 2014.

Digital Library

[8]

H. Duan, C. Chen, G. Min, and Y. Wu, "Energy-aware scheduling of virtual machines in heterogeneous cloud computing systems," Future Generation Computer Systems, 2016.

[9]

L. T. X. Phan, Z. Zhang, Q. Zheng, B. T. Loo, and I. Lee, "An empirical analysis of scheduling techniques for real-time cloud-based data processing," in Proceedings of the IEEE International Conference on Service-Oriented Computing and Application, pp. 1--8, 2011.

Digital Library

[10]

Z. Tang, J. Zhou, K. Li, and R. Li, "A mapreduce task scheduling algorithm for deadline constraints," Cluster Computing, vol. 16, pp. 651--662, 2013.

Digital Library

[11]

G. Caruana, M. Li, M. Qi, M. Khan, and O. Rana, "gsched: a resource aware hadoop scheduler for heterogeneous cloud computing environments," Concurrency and Computation: Practice and Experience, 2016.

[12]

S.-J. Yang and Y.-R. Chen, "Design adaptive task allocation scheduler to improve mapreduce performance in heterogeneous clouds," Journal of Network and Computer Applications, vol. 57, pp. 61--70, 2015.

Digital Library

[13]

"Apache, mapreduce." http://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html.

[14]

"File transfer time - data transfer speed calculator." http://www.t1shopper.com/tools/calculate/downloadcalculator.php.

[15]

"Project recs." http://shared.christmann.info/download/project-recs.pdf.

[16]

M. Vor Dem Berge, G. Da Costa, M. Jarus, A. Oleksiak, W. Piatek, and E. Volk, "Modeling data center building blocks for energy-efficiency and thermal simulations," in Energy-Efficient Data Centers, pp. 66--82, Springer, 2014.

[17]

S. Baruah and N. Fisher, "The partitioned multiprocessor scheduling of sporadic task systems," in 26th IEEE International Real-Time Systems Symposium (RTSS'05), pp. 9--pp, IEEE, 2005.

Digital Library

[18]

J. Leverich and C. Kozyrakis, "On the energy (in) efficiency of hadoop clusters," ACM SIGOPS Operating Systems Review, vol. 44, no. 1, pp. 61--65, 2010.

Digital Library

[19]

Y. Chen, S. Alspaugh, D. Borthakur, and R. Katz, "Energy efficiency for large-scale mapreduce workloads with significant interactive analysis," in Proceedings of the 7th ACM european conference on Computer Systems, pp. 43--56, ACM, 2012.

Digital Library

[20]

A. Verma, L. Cherkasova, and R. H. Campbell, "Two sides of a coin: Optimizing the schedule of mapreduce jobs to minimize their makespan and improve cluster performance," in 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pp. 11--18, IEEE, 2012.

Digital Library

[21]

E. M. Elnozahy, M. Kistler, and R. Rajamony, "Energy-efficient server clusters," in International Workshop on Power-Aware Computer Systems, pp. 179--197, Springer, 2002.

Digital Library

Cited By

Sharma YMoulik S(2022)HEATACM SIGAPP Applied Computing Review10.1145/3558053.355805622:2(34-43)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1145/3558053.3558056
Sharma YChakraborty SMoulik S(2022)ETA-HP: an energy and temperature-aware real-time scheduler for heterogeneous platformsThe Journal of Supercomputing10.1007/s11227-021-04257-778:8(1-25)Online publication date: 24-Jan-2022
https://doi.org/10.1007/s11227-021-04257-7
Sharma YDas ZDas AMoulik S(2020)TA-HRT: A Temperature-Aware Scheduler for Heterogeneous Real-Time Multicore Systems2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)10.1109/TrustCom50675.2020.00027(104-111)Online publication date: Dec-2020
https://doi.org/10.1109/TrustCom50675.2020.00027
Show More Cited By

Thermal-aware MapReduce Real-Time Scheduling in Heterogeneous Server Systems
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Process management

Recommendations

Data-locality-aware mapreduce real-time scheduling framework

A framework to manage interactive MapReduce applications with deadline constraint.A dispatcher to assign jobs to resources considering blocking and data-locality.A dynamic power management for MapReduce tasks to improve run-time energy efficiency.A ...
Design space exploration of thermal-aware many-core systems

Higher temperatures or uneven distribution of temperatures result in timing uncertainties which induces performance and reliability concerns for the system. Future 3D IC technology offers greater device integration, reduced signal delay and reduced ...
Thermal-aware adaptive VM allocation considering server locations in heterogeneous data centers
Abstract
Virtualized data centers usually consist of heterogeneous servers which have different specifications (performance). Though there usually exist unused heterogeneous servers in such data centers, conventional DVFS (Dynamic Voltage and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

RACS '16: Proceedings of the International Conference on Research in Adaptive and Convergent Systems

October 2016

266 pages

ISBN:9781450344555

DOI:10.1145/2987386

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing
ACCT: Association of Convergent Computing Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Ministry of Science and Technology, Taiwan

Conference

RACS '16

Sponsor:

SIGAPP
ACCT

RACS '16: International Conference on Research in Adaptive and Convergent Systems

October 11 - 14, 2016

Odense, Denmark

Acceptance Rates

RACS '16 Paper Acceptance Rate 40 of 161 submissions, 25%;

Overall Acceptance Rate 393 of 1,581 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
71
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sharma YMoulik S(2022)HEATACM SIGAPP Applied Computing Review10.1145/3558053.355805622:2(34-43)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1145/3558053.3558056
Sharma YChakraborty SMoulik S(2022)ETA-HP: an energy and temperature-aware real-time scheduler for heterogeneous platformsThe Journal of Supercomputing10.1007/s11227-021-04257-778:8(1-25)Online publication date: 24-Jan-2022
https://doi.org/10.1007/s11227-021-04257-7
Sharma YDas ZDas AMoulik S(2020)TA-HRT: A Temperature-Aware Scheduler for Heterogeneous Real-Time Multicore Systems2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)10.1109/TrustCom50675.2020.00027(104-111)Online publication date: Dec-2020
https://doi.org/10.1109/TrustCom50675.2020.00027
Sharma YChanda RMoulik S(2020)TEARS: A temperature-aware real-time scheduler for heterogeneous multi-core systems2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC42975.2020.9283134(936-943)Online publication date: 11-Oct-2020
https://doi.org/10.1109/SMC42975.2020.9283134
SONG YZHAO XWANG BSUN Y(2018)Trading-Off Computing and Cooling Energies by VM Migration in Data CentersIEICE Transactions on Information and Systems10.1587/transinf.2017EDP7329E101.D:9(2224-2234)Online publication date: 1-Sep-2018
https://doi.org/10.1587/transinf.2017EDP7329

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents